Data Step
The Data step contains the following elements.
Data tab(no data set has been loaded)
Import Static Data
Starts the import of static data, i.e., data with time-independent behavior (no time channel, system without inner states).
Available import formats: Excel (*.xls, *.xlsx, *.xlsm), MDA export (*.ascii), comma-separated values (*.csv, *.txt), Measurement Data Format (*.dat, *.mf4, *.mdf, *.mdf3), binary MATLAB fiel (*.mat).
Import Dynamic Data
Starts the import of dynamic data, i.e., data with time-dependent behavior (time channel, system without inner states).
Available import formats: Excel (*.xls, *.xlsx, *.xlsm), MDA export (*.ascii), comma-separated values (*.csv, *.txt), Measurement Data Format (*.dat, *.mf4, *.mdf, *.mdf3), binary MATLAB fiel (*.mat).
See also Loading the measurement file.
Data tab (at least one dataset has been loaded)
Dataset
Select a dataset from the drop-down list.
opens the Manage Datasets window.
Enter the weight of the selected dataset for the optimization, if the datasets should be weighted unequally. A value of 0 disables the data set. See also Adjusting the weights of the entire data set.
Import Data
Click to add or replace a training or test dataset. See also Loading the measurement file.
The
button opens a drop-down menu with the following entries:
Import New Dataset (Default): Opens the ASCMO Data Import window to import a new dataset.
Import New Dataset with Channel Mapping (Default): Opens the ASCMO Data Import window to import a new dataset and apply channel mapping.
Import Additional Channels: Opens the ASCMO Data Import window to add additional channels from the same file to the current dataset after the initial import. Re-importing the same channel overwrites the existing one.
Import Additional Channels (All Datasets): Opens the ASCMO Data Import window to add additional channels from the same file to all datasets after the initial import. Re-importing the same channel overwrites the existing one.
The file location is retrieved from the Info field of each dataset (Data menu > Manage Datasets > Info). Therefore, the files must be available at this location during the initial import, or the location must be updated accordingly.
Create Constant Channel: Opens the Add Constant Channel window, where you can define a new channel with a fixed value by entering its name, unit, and constant value for the current dataset.
Create Constant Channel (All Datasets): Opens the Add Constant Channel window, where you can define a new channel with a fixed value by entering its name, unit, and constant value for all datasets.
Dataset table
Each imported dataset is shown in a table named <#>: <dataset_name> for training data or <#>: (Test) <dataset_name> for test data. <#> is the numeric identifier of the dataset.
You can sort the table by clicking the head of each column. The sorting is indicated by ↑ and ↓.
Double-click in a cell to edit it.
The table contains the following columns:
- No.: Shows the number of the data point.
- Weight: Shows the optimization weight of the data points, 0 means inactive.
- <data channel>: Shows the values of the measured channels.
- Comments: To add a comment, click the cell and start typing. To edit an existing comment, double-click the cell. To delete an existing comment, click the cell and press ← Backspace.
Data Sampling
- Static (no time): No time dependency due to no time channel.
- Fixed Rate: Usually required for external models, all channels are sampled with the same sampling rate.
-
Multirate (for TSiM Plugin only): Synchronous and various fixed step sample rates.
Note
To change the data sampling mode, delete all datasets and re-import it as static or dynamic with fixed step sample rate.
Rows
Select at least one row or several rows to apply the following buttons.
-
Weight (Selected Rows (default)): Set the weight of selected data points and activate data points to be evaluated in the Function Step. See also Setting the weights of selected data points
-
>
Formula Editor: for Current Dataset/for All Datasets: Opens the
Set Data Range Weight
-
-
Delete: Deletes the selected row. See also Deleting a Data Point. You can also delete a data range. Click
and enter the values. See also Delete Data Range.
Columns
Select at least one column to apply the following.
-
Delete: deletes the selected input channel(s). See also Deleting an Input Column.
Filter
Displays the name of the active global filter.
To open the Filter Data window and configure the global filer, click
.
Datasets (All)
To remove all data points with non-numeric values from all data sets in the project, click the Remove NaN button. See also Removing NaN Values.
Channel Name Mapping
The Channel Name Mapping table links project variables to channels in each dataset.
-
Automatic Mapping
Automatically maps channels to variables with identical names.
-
>Automatic Mapping of Current Dataset (default): Removes existing mappings of the current dataset and remaps by identical names.
-
>Automatic Mapping of All Datasets: Removes existing mappings and remaps all datasets by identical names.
-
-
Delete: Deletes the selected mapping rows.
-
Import: Imports a CSV file with data-channel mappings.
-
Export…: Exports mapping information.
-
>Export Mapping (default) Exports the current data-channel mapping to CSV.
-
>Export Channel List Exports the channel list from the dataset table as a LAB file (*.lab).
-
-
Table behavior
The left column shows the variable Name in Project. Each dataset adds a column Name in <Dataset Name> with a drop-down list containing all channels of that dataset.
- Sorting: Click a column header (e.g., Name in Project or Name in Dataset) to sort ascending or descending. The sort order is indicated by ↑ or ↓.
- Rename: Double-click a cell in Name in Project, type the new name, and press Enter.
- Change mapping: Open the drop-down in a dataset column and select the desired channel.
- Add mapping: Enter a new variable name in the input field below the table and click +. A new row is added with the entered name on the left and a drop-down on the right to select the channel in the dataset.
See also Changing the Variable Name.
-
>>/<<: Shows or hides the search list for quicker selection in drop-down cells. First select a drop-down cell in the table, then browse the list.
For multirate data (for TSiM Plugin only):
-
Use column
Use the checkboxes to select the inputs for mapping. A column for the input is added to the Dataset table above.
You can select all inputs with the Activate "Use" all Inputs option of the Import split button.
You can deselect all inputs with the Desctivate "Use" all Inputs option of the Import split button.
Use the checkboxes to select the inputs for mapping. A column for the input is added to the "Dataset" table above.
You can select all inputs with the Activate "Use" all Inputs option of the Import split button.
You can deselect all inputs with the Desctivate "Use" all Inputs option of the Import split button.
-
Import split button-
Import Mapping: Imports a CSV data channel mapping file.
-
Import Used Inputs: Imports a LAB file for data channel mapping. Used inputs will automatically have the "Use" checkbox selected and will only be used.
-
Activate "Use" all Inputs: Activates the Use checkbox of all inputs.
-
Deactivate "Use" all Inputs: Deactivates the Use checkbox of all inputs.
-
-
Export split button-
Export Mapping: export a CSV file of data channel mapping.
-
Export Used Inputs: export a LAB file for data channel mapping.
-
Conversion Formulas tab
Conversion formulas can be used to transform data channels. They also support conversion parameters. These parameters can be created in the
Parameters Step after selecting the conversion parameterset. Alternatively, they can be added with Edit.
Insert
Use to insert a new conversion formula using the formula editor.
Delete
Deletes the selected conversion formulas. You can use the standard Ctrl/Shift selection functions in the table
Edit
Use to edit the selected conversion formula using the formula editor. You can also double-click the conversion formula to edit it.
Validate All
Use to validate all available conversion formulas.
Dependency Graph
Opens the "Dependency Graph for Conversion Rules" window where you can see the graphical representation of the conversion formula and analyze dependencies.
|
Note |
|---|
|
Syntax Highlighting with different colors for Node, Input or Parameter (see Legend). |
Edit Mode
Activate the checkbox to edit the formulas in the table directly. Names must be enclosed in %. Use this mode to copy formulas.
See also
Step 1: Data Import (tutorial)
Step 2: Data Analysis (tutorial)
Function Evaluation Using RMSE and R2