Analyze model Leave-One-Out error for <output>

Model menu > Error (Leave-One-Out)> Error over Training Data Size

First, you have to specify the quantity for the investigation to start (Start Training Size), the quantity for the investigation to end (End Training Size) the interval to the next data size (Step Width) and the Closednumber of subsets (Number of Repetitions) used for the calculation of the error.

After you click OK, <Number of Repetitions> different subsets of the training data record are selected for the analysis, and the leave-one-out error is determined in each case. The bar shows the variance of these <Number of Repetitions> results, the solid line the mean value of the results.

This allows identifying whether the model improves if more training data are used or if the size of the training data can even be reduced since no appreciable model improvement can be achieved starting at a certain size.

The larger the subsets, the more time is required for the calculation!

An Analyze model Leave-One-Out error for <output> window opens for each output. Those windows show the average model error (RMSE) for each output depending on the number of training data used.

The Analyze model Leave-One-Out error for <output> window contains the following elements:

ClosedFile

  • Export Results

    Stores the results, i.e. the <Number of Repetitions> values and the average for each training data size in an Excel (*.xls, *.xlsx) or CSV (*.csv) file.

  • Close

    Closes the window.

ClosedView

  • Save as Bitmap

    The content of the window is saved to a graphic (*.bmp, *.png,*.jpg).

ClosedHelp

    • User Guide: Opens the PDF User Guide.

    • Online Help: Opens the online help (F1).

    • Interface Help: Opens the interface help.

    • License: Opens the ETAS License Manager.

    • Support: Displays contact information for various ETAS support channels.

    • Safety Advice: Opens the ETAS safety advice.

    • About: Opens the About window, where you can also get information about OSS used in ASCMO.

ClosedToolbar

    This table shows a selection of possible toolbar buttons.

    Zoom in

    By clicking in the plot, the visualization becomes larger.

    Zoom out

    By clicking in the plot, the visualization becomes smaller.

    Pan

    This allows you to move the plot within the window.

    Mouse selection in plot with rectangle

    Sets the selection tool in the scatter plots to a rectangle.

    Mouse selection in plot with lasso

    Sets the selection tool in the scatter plots to a lasso.

    Update

    Updates the plots in the window.