Cube Memory Usage

Post Reply
User avatar
mce
Community Contributor
Posts: 352
Joined: Tue Jul 20, 2010 5:01 pm
OLAP Product: Cognos TM1
Version: Planning Analytics Local 2.0.x
Excel Version: 2013 2016
Location: Istanbul, Turkey

Cube Memory Usage

Post by mce »

Hi,

I am new in TM1. Apologies again for the simple questions.
This is the stats for a cube in TM1. Does these values indicate an non-optimal situation with the cube structure or with the rules and feeders?

Code: Select all

Memory Used for Views	 -   
Number of Stored Views	 -   
Number of Stored Calculated Cells	 28,427,972 
Number of Populated String Cells	 -   
Number of Populated Numeric Cells	 252,063 
Number of Fed Cells	 83,990,589 
Memory Used for Calculations	 313,914,112 
Memory Used for Feeders	 274,333,696 
Memory Used for Input Data	 465,501,184 
Total Memory Used	 1,053,748,992 
Why do I have very big memory usage although Number of Populated Numeric Cells and Number of Stored Calculated Cells are relatively very small?

Thanks in advance for all replies.

Regards,
David Usherwood
Site Admin
Posts: 1458
Joined: Wed May 28, 2008 9:09 am

Re: Cube Memory Usage

Post by David Usherwood »

313.9 / 28.4 = 11 bytes per calculated value - makes sense.

Roughly half your ram is calculations and half feeders. Quite normal, indeed for heavily modelled systems it might be much more for feeders.

You could look at optimising/conditionalising your feeders to reduce the memory used by TM1.

1 gig for a production system is quite low these days.
User avatar
mce
Community Contributor
Posts: 352
Joined: Tue Jul 20, 2010 5:01 pm
OLAP Product: Cognos TM1
Version: Planning Analytics Local 2.0.x
Excel Version: 2013 2016
Location: Istanbul, Turkey

Re: Cube Memory Usage

Post by mce »

Thanks David.
This is only for one cube.
What is "Memory used for Input Data" and why it might be that big?
lotsaram
MVP
Posts: 3703
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Cube Memory Usage

Post by lotsaram »

A 1GB cube is also not that huge depending on what sort of cube it is...

Memory for input data is exactly what it says, the memory consumed by leaf level physical data input.

If your system is 64 bit then 3 bytes per feeder and 11 bytes per leaf data entry value do not indicate an inefficient dimension order. You do however have 333 fed cells per data input cell. Possibly this indicates overfeeding but it is impossible to say without knowing your model, in some circumstances where there are a large number of dependent or recursive calculations this might be normal.
User avatar
mce
Community Contributor
Posts: 352
Joined: Tue Jul 20, 2010 5:01 pm
OLAP Product: Cognos TM1
Version: Planning Analytics Local 2.0.x
Excel Version: 2013 2016
Location: Istanbul, Turkey

Re: Cube Memory Usage

Post by mce »

My server is 32bit.
As the number of populated cells is 252K, I thought this is the leaf level phisical input numbers and the memory for these is 465MB which is too high, is not it?
How did you come up with 11 bytes per leaf data entry value?
lotsaram
MVP
Posts: 3703
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Cube Memory Usage

Post by lotsaram »

Sorry I didn't do the calculation I just misread David's earlier post but the 11 bytes was for the calculated values.

You have 252,063 numeric leaf cells but memory for input data is 465 MB. Do you have lots of string data in this cube? (as otherwise the bytes/cell for data input is much too high to be possible, the only other possibilities are you have transcribed the values incorrectly or the perfmon output is incorrect).
User avatar
mce
Community Contributor
Posts: 352
Joined: Tue Jul 20, 2010 5:01 pm
OLAP Product: Cognos TM1
Version: Planning Analytics Local 2.0.x
Excel Version: 2013 2016
Location: Istanbul, Turkey

Re: Cube Memory Usage

Post by mce »

I do not have string values in this cube, it is all numeric.
I checked again and the output is correct.
I checked other cubes and saw that the ratio of memory used for input data to populated numberic cells is quite high in general.
Does TM1 allocate memory for all leaf input cells even if they are not populated with numbers at all?
Luc
Posts: 1
Joined: Mon Aug 02, 2010 1:30 pm
OLAP Product: TM1
Version: 9.5.1
Excel Version: Excel 2007

Re: Cube Memory Usage

Post by Luc »

I have a very strange phenomenon with a Cube....the performance monitor indicates that the entire cube consists of input data, but strangely, the cube only contains rule calculated data (100% sure).
Does anyone have a suggestion on why this is happening and how to descrease memory consumption? I'm running 9.5.1 x64.


LATEST
Memory Used for Views 0
Number of Stored Views 0
Number of Stored Calculated Cells 0
Number of Populated String Cells 0
Number of Populated Numeric Cells 0
Number of Fed Cells 259.472.360
Memory Used for Calculations 0
Memory Used for Feeders 0
Memory Used for Input Data 9.223.664.640
Total Memory Used 9.223.664.640

Thanks!

Luc
carsten
Posts: 17
Joined: Tue Jul 26, 2011 10:16 am
OLAP Product: TM1
Version: 10.2.2.3
Excel Version: 2013

Re: Cube Memory Usage

Post by carsten »

Hi all, I'm new as well. Can anybody help me with these KPIs and why is "Memory Used for Views" and "Number of Stored Views" =0

Server is 64Bit Verison 9.5.2. SP1 FP4

Are these stats normal for all Cubes?

Memory Used for Views 0
Number of Stored Views 0
Number of Stored Calculated Cells 691752
Number of Populated String Cells 1125251
Number of Populated Numeric Cells 59131813
Number of Fed Cells 420874881
Memory Used for Calculations 117393152
Memory Used for Feeders 3477078016
Memory Used for Input Data 4588331008
Total Memory Used 8182802176

Bytes per calculated value 169,704102
Memory in % for Feeder 42,49250979
Memory in % for Calculations 1,434632654
Memory in % for Input data 56,07285755
Post Reply