Settings for Compare: General - Precision

The following table indicates using an example whether the values of a variable are to be regarded as equal or not equal in a comparison. The example refers to the following constellation:

The table reads as follows:

File - file

File - dataset

Dataset - dataset

Dataset - file

Compare mode

Maximum precision

Source

Destination 1:
1.2

Destination 2:
1.234

Destination 1:
1.2

Destination 2:
1.234

Destination 1:
1.2

Destination 2:
1.234

Destination 1:
1.2

Destination 2:
1.234

exact

from ASAM-2MC file

1.23

by data type

1.23

calculate automatically

1.23

Maximum precision

1.23

calculate minimum difference / calculate automatically

1.23

format (ASAM-2MC)

from ASAM-2MC file

1.23

by data type

1.23

calculate automatically

1.23

Maximum precision

1.23

calculate minimum difference / calculate automatically

1.23

format (ASAM-2MC) using the maximum of decimals places

from ASAM-2MC file

1.23

by data type

1.23

calculate automatically

1.23

Maximum precision

1.23

calculate minimum difference / calculate automatically

1.23

tolerant

from ASAM-2MC file

1.23

by data type

1.23

calculate automatically

1.23

Maximum precision

1.23

calculate minimum difference / calculate automatically

1.23

tolerant bi-directional

from ASAM-2MC file

1.23

by data type

1.23

calculate automatically

1.23

Maximum precision

1.23

calculate minimum difference / calculate automatically

1.23