Data Step

The Data step contains the following elements.

Data tab(no data set has been loaded)

Import Static Data

Starts the import of static data, i.e., data with time-independent behavior (no time channel, system without inner states).

Available import formats: Excel (*.xls, *.xlsx, *.xlsm), MDA export (*.ascii), comma-separated values (*.csv, *.txt), Measurement Data Format (*.dat, *.mf4, *.mdf, *.mdf3), binary MATLAB fiel (*.mat).

Import Dynamic Data

Starts the import of dynamic data, i.e., data with time-dependent behavior (time channel, system without inner states).

Available import formats: Excel (*.xls, *.xlsx, *.xlsm), MDA export (*.ascii), comma-separated values (*.csv, *.txt), Measurement Data Format (*.dat, *.mf4, *.mdf, *.mdf3), binary MATLAB fiel (*.mat).

See also Loading the measurement file.

Data tab (at least one dataset has been loaded)

Dataset

Select a dataset from the drop-down list.

opens the Manage Datasets window.

Weight

Enter the weight of the selected dataset for the optimization, if the datasets should be weighted unequally. A value of 0 disables the data set. See also Adjusting the weights of the entire data set.

Import Data

Click to add or replace a training or test dataset. See also Loading the measurement file.

The button opens a drop-down menu with the following entries:

Import New Dataset (Default): Opens the ASCMO Data Import window to import a new dataset.

Import New Dataset with Channel Mapping (Default): Opens the ASCMO Data Import window to import a new dataset and apply channel mapping.

Import Additional Channels: Opens the ASCMO Data Import window to add additional channels from the same file to the current dataset after the initial import. Re-importing the same channel overwrites the existing one.

Import Additional Channels (All Datasets): Opens the ASCMO Data Import window to add additional channels from the same file to all datasets after the initial import. Re-importing the same channel overwrites the existing one.

The file location is retrieved from the Info field of each dataset (Data menu > Manage Datasets > Info). Therefore, the files must be available at this location during the initial import, or the location must be updated accordingly.

Create Constant Channel: Opens the Add Constant Channel window, where you can define a new channel with a fixed value by entering its name, unit, and constant value for the current dataset.

Create Constant Channel (All Datasets): Opens the Add Constant Channel window, where you can define a new channel with a fixed value by entering its name, unit, and constant value for all datasets.

Dataset table

Each imported dataset is shown in a table named <#>: <dataset_name> for training data or <#>: (Test) <dataset_name> for test data. <#> is the numeric identifier of the dataset.

You can sort the table by clicking the head of each column. The sorting is indicated by and .

Double-click in a cell to edit it.

The table contains the following columns:

  • No.: Shows the number of the data point.
  • Weight: Shows the optimization weight of the data points, 0 means inactive.
  • <data channel>: Shows the values of the measured channels.
  • Comments: To add a comment, click the cell and start typing. To edit an existing comment, double-click the cell. To delete an existing comment, click the cell and press ← Backspace.
Data Sampling
  • Static (no time): No time dependency due to no time channel.
  • Fixed Rate: Usually required for external models, all channels are sampled with the same sampling rate.
  • Multirate (for TSiM Plugin only): Synchronous and various fixed step sample rates.

    Note  

    To change the data sampling mode, delete all datasets and re-import it as static or dynamic with fixed step sample rate.

Rows

Select at least one row or several rows to apply the following buttons.

Columns

Select at least one column to apply the following.

Filter

Displays the name of the active global filter.

To open the Filter Data window and configure the global filer, click .

Datasets (All)

To remove all data points with non-numeric values from all data sets in the project, click the Remove NaN button. See also Removing NaN Values.

Channel Name Mapping

The Channel Name Mapping table links project variables to channels in each dataset.

  • Automatic Mapping

    Automatically maps channels to variables with identical names.

    • >Automatic Mapping of Current Dataset (default): Removes existing mappings of the current dataset and remaps by identical names.

    • >Automatic Mapping of All Datasets: Removes existing mappings and remaps all datasets by identical names.

  • Delete: Deletes the selected mapping rows.

  • Import: Imports a CSV file with data-channel mappings.

  • Export…: Exports mapping information.

    • >Export Mapping (default) Exports the current data-channel mapping to CSV.

    • >Export Channel List Exports the channel list from the dataset table as a LAB file (*.lab).

  • Table behavior

    The left column shows the variable Name in Project. Each dataset adds a column Name in <Dataset Name> with a drop-down list containing all channels of that dataset.

    • Sorting: Click a column header (e.g., Name in Project or Name in Dataset) to sort ascending or descending. The sort order is indicated by ↑ or ↓.
    • Rename: Double-click a cell in Name in Project, type the new name, and press Enter.
    • Change mapping: Open the drop-down in a dataset column and select the desired channel.
    • Add mapping: Enter a new variable name in the input field below the table and click +. A new row is added with the entered name on the left and a drop-down on the right to select the channel in the dataset.

    See also Changing the Variable Name.

  • >>/<<: Shows or hides the search list for quicker selection in drop-down cells. First select a drop-down cell in the table, then browse the list.

For multirate data (for TSiM Plugin only):
  • Use column

    Use the checkboxes to select the inputs for mapping. A column for the input is added to the Dataset table above.

    You can select all inputs with the Activate "Use" all Inputs option of the Import split button.

    You can deselect all inputs with the Desctivate "Use" all Inputs option of the Import split button.

Use the checkboxes to select the inputs for mapping. A column for the input is added to the "Dataset" table above.

You can select all inputs with the Activate "Use" all Inputs option of the Import split button.

You can deselect all inputs with the Desctivate "Use" all Inputs option of the Import split button.

  • Import split button

    • Import Mapping: Imports a CSV data channel mapping file.

    • Import Used Inputs: Imports a LAB file for data channel mapping. Used inputs will automatically have the "Use" checkbox selected and will only be used.

    • Activate "Use" all Inputs: Activates the Use checkbox of all inputs.

    • Deactivate "Use" all Inputs: Deactivates the Use checkbox of all inputs.

  • Export split button

    • Export Mapping: export a CSV file of data channel mapping.

    • Export Used Inputs: export a LAB file for data channel mapping.

Conversion Formulas tab

Conversion formulas can be used to transform data channels. They also support conversion parameters. These parameters can be created in the Parameters Step after selecting the conversion parameterset. Alternatively, they can be added with Edit.

Insert

Use to insert a new conversion formula using the formula editor.

Delete

Deletes the selected conversion formulas. You can use the standard Ctrl/Shift selection functions in the table, or click and hold Lmb and drag the cursor over the cells/rows you want to select.

Edit

Use to edit the selected conversion formula using the formula editor. You can also double-click the conversion formula to edit it.

Validate All

Use to validate all available conversion formulas.

Dependency Graph

Opens the "Dependency Graph for Conversion Rules" window where you can see the graphical representation of the conversion formula and analyze dependencies.

Note  

Syntax Highlighting with different colors for Node, Input or Parameter (see Legend).

Edit Mode

Activate the checkbox to edit the formulas in the table directly. Names must be enclosed in %. Use this mode to copy formulas.

See also

Step 1: Data Import (tutorial)

Step 2: Data Analysis (tutorial)

Data

Assessment of the Input Data

Variables RMSE and R2

Function Evaluation Using RMSE and R2

Instructions (Data Step)