com.aspose.cells
Class CalculationPrecisionStrategy
java.lang.Object
com.aspose.cells.CalculationPrecisionStrategy
public class CalculationPrecisionStrategy
- extends java.lang.Object
Utility class containing constants.
Enumerates strategies for handling calculation precision.
Because of the precision issue of IEEE 754 Floating-Point Arithmetic, some "seemingly simple" formulas may not be calcualted as the expected result.
Such as formula "=-0.45+0.43+0.02", when calcuating operands by '+' operator directly, the result is not zero. For such kind of precision issue,
some special strategies may give the expected result.
Field Summary |
static final int | NONE | |
No strategy applied on calculation.
When calculating just use the original double value as operand and return the result directly.
Most efficient for performance and applicable for most cases.
|
static final int | ROUND | |
Rounds the calculation result according with significant digits.
|
static final int | DECIMAL | |
Uses decimal as operands when possible.
Most inefficient for performance.
|
NONE | |
public static final int NONE |
-
No strategy applied on calculation.
When calculating just use the original double value as operand and return the result directly.
Most efficient for performance and applicable for most cases.
ROUND | |
public static final int ROUND |
-
Rounds the calculation result according with significant digits.
DECIMAL | |
public static final int DECIMAL |
-
Uses decimal as operands when possible.
Most inefficient for performance.
See Also:
Aspose.Cells Documentation - the home page for the Aspose.Cellss Product Documentation.
Aspose.Cells Support Forum - our preferred method of support.