Page 1 of 1

Large number of Decimals - unexpected

Posted: Wed Jun 26, 2024 1:14 pm
by chewza
Hi there

I am importing data from a SQL table into a cube, and using CellIncrementN. For some reason I am getting a really small number with a huge number of decimals e.g. 0.000000000000023

I have tested by running the source query in SQL and pasting to Excel. The 16 rows that are returned all display with 2 decimals, and aggregate to 0 (as they should). I have also used RoundP(Value,2) in my Call Increment. The problem still remains.

Any ideas?

Many thx!

Re: Large number of Decimals - unexpected

Posted: Wed Jun 26, 2024 6:51 pm
by gtonkin
Will point you to one of Steve's posts which will point you to others.
Basically down to floating point imprecision.
An IBM post

Re: Large number of Decimals - unexpected

Posted: Thu Jun 27, 2024 2:58 pm
by chewza
Thanks George!

I have a rule which divides by the value. This then becomes a real issue as you get massive calculated numbers.
Worked my way around this in a rule.