Function Evaluation Using RMSE and R2
Evaluation of R2
The most important variable is the coefficient of determination R2. This measure results in the following evaluations:
-
The coefficient of determination, R2, can be maximal 1. In this case, the function prediction fits exactly to each measured value.
-
If the function would simply predict the mean of the measured output for any input data, an R2 of 0 would be the result. A negative R2 would mean that the prediction is worse than that simple prediction.
-
An R2 of 1 means a perfect fit, every prediction of the function is the same as the measured data. Typically, the measured data has added noise. In this case, an R2 of 1 means overfitting. You should be interested in a high R2 with consideration of the noise.
-
Keep in mind that different signals can be measured with different quality. There might be signals where an R2 of 0.6 might already be a good value. In contrast, a model for a different signal can be seen as good only if the R2 is above 0.99.
Evaluation of RMSE
The absolute error RMSE must be evaluated individually:
- At best, the RMSE can be as good as the experimental repeatability.
- Despite a good R2, the RMSE can be too low, e. g. in case of a very large variation range of the modeled variable.
- Despite a small R2, the RMSE can be good enough, e. g. if the modeled variable features only a minor variance over the input parameters of the function.
See also
RMSE (Root Mean Squared Error)
Coefficient of Determination R2