Forum Discussion

MikeHammond's avatar
MikeHammond
Quickbase Alumni
5 years ago

"Floating Point" Problems, Explanations, and Workarounds

We get a lot of questions about surprising behavior when numbers have digits after the decimal point. Sometimes numbers don't look right, sometimes they don't seem to behave right mathematically. Oft...
formula
formulas
Formulas and functions
JosephReynolds's avatar
JosephReynolds
Quickbase Staff
5 days ago

I set up a formula to force rounding without using the "Round" function. If you're running into this issue, this formula might help:


var Number input = [Field to Round];
var Number absInput = Abs($input);
var Number thousandths = Mod(Int(($absInput + 0.00001) * 1000), 10);
var Number adjusted = If($thousandths >= 5, $absInput + 0.01, $absInput + 0.00001);
var Number truncated = Int($adjusted) + Int(Frac($adjusted) * 100) / 100.0;
If($input < 0, -1 * $truncated, $truncated)