Data Step

The Data step contains the following elements.

Data tab(no data set has been loaded)

Import Static Data

Starts the import of static data, i.e., data with time-independent behavior (no time channel, system without inner states).

Available import formats: Excel (*.xls, *.xlsx, *.xlsm), MDA export (*.ascii), comma-separated values (*.csv, *.txt), Measurement Data Format (*.dat, *.mf4, *.mdf, *.mdf3), binary MATLAB fiel (*.mat).

Import Dynamic Data

Starts the import of dynamic data, i.e., data with time-dependent behavior (time channel, system without inner states).

Available import formats: Excel (*.xls, *.xlsx, *.xlsm), MDA export (*.ascii), comma-separated values (*.csv, *.txt), Measurement Data Format (*.dat, *.mf4, *.mdf, *.mdf3), binary MATLAB fiel (*.mat).

See also Loading the measurement file.

Data tab (at least one dataset has been loaded)

Dataset

Select a dataset from the drop-down list.

opens the Manage Datasets window.

Weight

Enter the weight of the selected dataset for the optimization, if the datasets should be weighted unequally. A value of 0 disables the data set. See also Adjusting the weights of the entire data set.

Import Data

Click to add or replace a training or test dataset. See also Loading the measurement file.

The button opens a drop-down menu with the following entries:

Import Training Data (default): Imports the data as training data.

Import Test Data: Imports the data as test data.

Add Channel to current Dataset: Adds a channel from the same file to the current dataset after the initial import. Re-importing the same channel will overwrite the existing one.

Add Channel to all Datasets: Adds a channel from the same file to all datasets after the initial import. Re-importing the same channel will overwrite the existing one.

The file location is retrieved from the Info field of each dataset (Data menu > Manage Datasets > Info). Therefore, the files must be available at this location during the initial import, or the location must be updated accordingly.

Dataset table

Each imported dataset is shown in a table named <#>: <dataset_name> for training data or <#>: (Test) <dataset_name> for test data. <#> is the numeric identifier of the dataset.

You can sort the table by clicking the head of each column. The sorting is indicated by and .

Double-click in a cell to edit it.

The table contains the following columns:

  • No.: Shows the number of the data point.
  • Weight: Shows the optimization weight of the data points, 0 means inactive.
  • <data channel>: Shows the values of the measured channels.
  • Comments: To add a comment, click the cell and start typing. To edit an existing comment, double-click the cell. To delete an existing comment, click the cell and press ← Backspace.
Data Sampling area
  • Static (no time): No time dependency due to no time channel.
  • Fixed Rate: Usually required for external models, all channels are sampled with the same sampling rate.
  • Multirate (for TSiM Plugin only): Synchronous and various fixed step sample rates.

    Note  

    To change the data sampling mode, delete all datasets and re-import it as static or dynamic with fixed step sample rate.

Rows

Select at least one row or several rows to apply the following buttons.

Columns

Select at least one column to apply the following.

Filter

Displays the name of the active global filter.

To open the Filter Data window and configure the global filer, click .

Datasets (All)

To remove all data points with non-numeric values from all data sets in the project, click the Remove NaN button. See also Removing NaN Values.

Channel Name Mapping table

By default, function inputs are named based on the first dataset. You can rename inputs within your project by double-clicking in the column Name in Project. The columns Name in <Dataset Name> show the mapped channels of the respective dataset. Channels are mapped automatically when you import (further) datasets based on the first dataset. You can change the mapping with the drop-down list.

  • Map Selected Dataset

    Removes existing mappings and maps all channels of the currently visible data set to variables of identical names.

    Channels of other data sets are mapped if they have identical names.

    • >  Map all Datasets: Removes existing mappings and maps all channels.

  • Delete: Deletes the selected mappings. See also Deleting a Mapping.

  • Import: Imports a CSV data channel mapping file.

  • Export: Exports a CSV file of data channel mapping.

    • >  Export Channel List: Use to export the channel list (channel names as shown in the table above) as a LAB file(*.lab).

  • mapping table

    The mapping table contains one column for the variable names in the project, and another column for each imported data set. The cells in the data set columns are dropdown lists that contain all channels of the respective data set.

    See also Changing the Variable Name.

  • >>/<<:Shows/hides the search list for quicker selection of mapped channels. First select a drop-down list within the table to browse through the list.

For multirate data (for TSiM Plugin only):

  • Use column

    Use the checkboxes to select the inputs for mapping. A column for the input is added to the Dataset table above.

    You can select all inputs with the Activate "Use" all Inputs option of the Import split button.

    You can deselect all inputs with the Desctivate "Use" all Inputs option of the Import split button.

Use the checkboxes to select the inputs for mapping. A column for the input is added to the "Dataset" table above.

You can select all inputs with the Activate "Use" all Inputs option of the Import split button.

You can deselect all inputs with the Desctivate "Use" all Inputs option of the Import split button.

  • Import split button

    • Import Mapping: Imports a CSV data channel mapping file.

    • Import Used Inputs: Imports a LAB file for data channel mapping. Used inputs will automatically have the "Use" checkbox selected and will only be used.

    • Activate "Use" all Inputs: Activates the Use checkbox of all inputs.

    • Deactivate "Use" all Inputs: Deactivates the Use checkbox of all inputs.

  • Export split button

    • Export Mapping: export a CSV file of data channel mapping.

    • Export Used Inputs: export a LAB file for data channel mapping.

Conversion Formulas tab

Conversion formulas can be used to transform data channels. They also support conversion parameters. These parameters can be created in the Parameters Step after selecting the conversion parameterset. Alternatively, they can be added with Edit.

Insert

Use to insert a new conversion formula using the formula editor.

Delete

Deletes the selected conversion formulas. You can use the standard Ctrl/Shift selection functions in the table, or click and hold Lmb and drag the cursor over the cells/rows you want to select.

Edit

Use to edit the selected conversion formula using the formula editor. You can also double-click the conversion formula to edit it.

Validate All

Use to validate all available conversion formulas.

Dependency Graph

Opens the "Dependency Graph for Conversion Rules" window where you can see the graphical representation of the conversion formula and analyze dependencies.

Note  

Syntax Highlighting with different colors for Node, Input or Parameter (see Legend).

Edit Mode

Activate the checkbox to edit the formulas in the table directly. Names must be enclosed in %. Use this mode to copy formulas.

See also

Step 1: Data Import (tutorial)

Step 2: Data Analysis (tutorial)

Data

Assessment of the Input Data

Variables RMSE and R2

Function Evaluation Using RMSE and R2

Instructions (Data Step)