Settings for Compare: General - Precision
The following table indicates using an example whether the values of a variable are to be regarded as equal or not equal in a comparison. The example refers to the following constellation:
- The variable in the source dataset has the value 1.23 (data type: Word, formula: x100, format: %8.2)
- The variable in destination 1 (dataset or data exchange file) has the value 1.2 (data type Word, formula: x10, format: %8.1)
- The variable in destination 2 (dataset or data exchange file) has the value 1.234 (data type Word, formula: x10, format: %8.3)
The table reads as follows:
- The wording "File" or "Dataset" in the table header indicates whether destination 1 and destination 2 contains a data exchange file or a dataset.
- The column Compare mode indicates which option setting is selected in the CDM under Compare - General.
The column Maximum precision indicates which option setting is selected in the Database Manager under Data exchange.
Since the results of the comparison depend on the option settings, which are defined in the Database Manager, among others, the same comparison can produce different results in different INCA installations.
If the add-on INCA-QM-BASIC was installed with INCA, the quality meta data may be compared as well; for the comparison of these quality meta data, additional symbols will be displayed, for example,
: status "calibrated",
quality meta data not equal).
For more detailed information see the help for the INCA-QM-BASIC add-on (only available if INCA-QM-BASIC has also been installed).- For the Use precision for compare setting, the option For data exchange files only was selected (see CDM Settings for Comparisons: General).
The symbol
and
indicate whether the comparison operation regards the
values in the source and destination as unequal or equal with the corresponding
settings.
File - file | File - dataset | Dataset - dataset | Dataset - file | |||||||
Compare mode | Maximum precision | Source | Destination 1: | Destination 2: | Destination 1: | Destination 2: | Destination 1: | Destination 2: | Destination 1: | Destination 2: |
exact | from ASAM-2MC file | 1.23 |
|
|
|
|
|
|
|
|
by data type | 1.23 |
|
|
|
|
|
|
|
| |
calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
Maximum precision | 1.23 |
|
|
|
|
|
|
|
| |
calculate minimum difference / calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
format (ASAM-2MC) | from ASAM-2MC file | 1.23 |
|
|
|
|
|
|
|
|
by data type | 1.23 |
|
|
|
|
|
|
|
| |
calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
Maximum precision | 1.23 |
|
|
|
|
|
|
|
| |
calculate minimum difference / calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
format (ASAM-2MC) using the maximum of decimals places | from ASAM-2MC file | 1.23 |
|
|
|
|
|
|
|
|
by data type | 1.23 |
|
|
|
|
|
|
|
| |
calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
Maximum precision | 1.23 |
|
|
|
|
|
|
|
| |
calculate minimum difference / calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
tolerant | from ASAM-2MC file | 1.23 |
|
|
|
|
|
|
|
|
by data type | 1.23 |
|
|
|
|
|
|
|
| |
calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
Maximum precision | 1.23 |
|
|
|
|
|
|
|
| |
calculate minimum difference / calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
tolerant bi-directional | from ASAM-2MC file | 1.23 |
|
|
|
|
|
|
|
|
by data type | 1.23 |
|
|
|
|
|
|
|
| |
calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |
Maximum precision | 1.23 |
|
|
|
|
|
|
|
| |
calculate minimum difference / calculate automatically | 1.23 |
|
|
|
|
|
|
|
| |