.cub and feeder file are doubled in size

Post Reply
Tamizharasi
Posts: 2
Joined: Wed Aug 19, 2015 5:52 pm
OLAP Product: TM1
Version: TM1
Excel Version: micros10

.cub and feeder file are doubled in size

Post by Tamizharasi »

Hi

.cub file in our application of a sales cube got doubled, there two backups available(aug 11 and aug12){in PROD}
I tested by loading the source files of Aug 12 th on data backup of Aug 11. but there is no change in size of both .cub and .feeder of sales cube {dev}

Also i restarted and saved data
we tested for overfeeding also, there is nothing like that.

still there is no change.

can any one help me what is reaon of this?
tomok
MVP
Posts: 2836
Joined: Tue Feb 16, 2010 2:39 pm
OLAP Product: TM1, Palo
Version: Beginning of time thru 10.2
Excel Version: 2003-2007-2010-2013
Location: Atlanta, GA
Contact:

Re: .cub and feeder file are doubled in size

Post by tomok »

Tamizharasi wrote:Hi

.cub file in our application of a sales cube got doubled, there two backups available(aug 11 and aug12){in PROD}
I tested by loading the source files of Aug 12 th on data backup of Aug 11. but there is no change in size of both .cub and .feeder of sales cube {dev}

Also i restarted and saved data
we tested for overfeeding also, there is nothing like that.

still there is no change.

can any one help me what is reaon of this?
Only loaded data gets saved in the .cub file so feeders and/or rule calculated values have no bearing on it's size. Sounds like you just have twice as much data in the cube. Without knowing your dimensionality and processes around loading the cube I can't give you any guidance. Perhaps you loaded data into an element that didn't have data before, like a different version or time period, or you normally wipe out versions or time periods during the load and it didn't happen? You can always find out by right-clicking on the cube and choosing Export as Text Data. Make sure you check off Skip Consolidations, Skip Rule Calculated Values and Skip Zero/Blank Values. This will dump out only the actual loaded data in the cube. You should be able to tell by looking at the data what happened.
Tom O'Kelley - Manager Finance Systems
American Tower
http://www.onlinecourtreservations.com/
Duncan P
MVP
Posts: 600
Joined: Wed Aug 17, 2011 1:19 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2
Excel Version: 2003 2007
Location: York, UK

Re: .cub and feeder file are doubled in size

Post by Duncan P »

I doubt if this is your circumstance but just in case ...

If you have nulls on for the cube and you use ViewZeroOut in an import TI then it will write actual zeros to every cell in the view. These zeros will then get saved to the cube.
BrianL
MVP
Posts: 264
Joined: Mon Nov 03, 2014 8:23 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2 PA2
Excel Version: 2016

Re: .cub and feeder file are doubled in size

Post by BrianL »

Duncan P wrote:I doubt if this is your circumstance but just in case ...

If you have nulls on for the cube and you use ViewZeroOut in an import TI then it will write actual zeros to every cell in the view. These zeros will then get saved to the cube.
FYI - As of 10.2 TM1 is capable of removing data from the cube rather than just storing zeroes. Even pre-10.2, zero values are not saved out to disk and would not affect the size of the .cub file.

Tamizharasi, are you seeing the cube memory grow, the .cub file has grown, the .feeder file has grown (if persistent feeders are enabled), or some combination of these. If it's the memory, you may find the }StatsByCube useful
BariAbdul
Regular Participant
Posts: 424
Joined: Sat Mar 10, 2012 1:03 pm
OLAP Product: IBM TM1, Planning Analytics, P
Version: PAW 2.0.8
Excel Version: 2019

Re: .cub and feeder file are doubled in size

Post by BariAbdul »

If you have nulls on for the cube and you use ViewZeroOut in an import TI then it will write actual zeros to every cell in the view. These zeros will then get saved to the cube
Sorry,If I am wrong here,as for as I understand TM1 sparse consolidation mechanism should simply ignore these zero or null values,So how come it gets saved to the cube? Thanks
"You Never Fail Until You Stop Trying......"
failurehappening
Posts: 78
Joined: Tue Nov 30, 2010 1:18 am
OLAP Product: TM1
Version: 10.2.2
Excel Version: 2010

Re: .cub and feeder file are doubled in size

Post by failurehappening »

Sorry,If I am wrong here,as for as I understand TM1 sparse consolidation mechanism should simply ignore these zero or null values,So how come it gets saved to the cube? Thanks
By default you're right, but it is possible to store these values in the cube using UNDEFVALS

http://www-01.ibm.com/support/knowledge ... _undefvals
RHR
Tamizharasi
Posts: 2
Joined: Wed Aug 19, 2015 5:52 pm
OLAP Product: TM1
Version: TM1
Excel Version: micros10

Re: .cub and feeder file are doubled in size

Post by Tamizharasi »

I found the issue, user have entered value in the consolidated level of the cube, which is getting spread over all the cells, this is not visible in the architect and while exporting them in excel we found the values.

that why cube got its size as double.

Thanks for all your suggestions and information.
BrianL
MVP
Posts: 264
Joined: Mon Nov 03, 2014 8:23 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2 PA2
Excel Version: 2016

Re: .cub and feeder file are doubled in size

Post by BrianL »

BariAbdul wrote: Sorry,If I am wrong here,as for as I understand TM1 sparse consolidation mechanism should simply ignore these zero or null values,So how come it gets saved to the cube? Thanks
You are partially correct. For cells that have never had any data, there is nothing stored in memory (or in the .cub) file. Pre-10.2 though, once data is input to a cell, there will always be a value stored in memory for that cell. Including if the cell value is later deleted (set back to zero). TM1 would not save these zero values to the .cub file on disk, so the next time you restarted the server the zero values would be cleared out.
Duncan P
MVP
Posts: 600
Joined: Wed Aug 17, 2011 1:19 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2
Excel Version: 2003 2007
Location: York, UK

Re: .cub and feeder file are doubled in size

Post by Duncan P »

BrianL wrote:FYI - As of 10.2 TM1 is capable of removing data from the cube rather than just storing zeroes. Even pre-10.2, zero values are not saved out to disk and would not affect the size of the .cub file.
As far as I was aware, when UNDEFVALS was specified it was the undefval (4.94066e-324 - see here) that was not stored to disk, but when ViewZeroOut was used it wrote actual zeros regardless of the state of UNDEFVALS. This meant that the values written took space and were saved to disk. Has this changed recently?

I was under the impression that the enhancement you are referring to in 10.2 only removed from memory those values that wouldn't be saved to disk, in this case 4.94066e-324.
BrianL
MVP
Posts: 264
Joined: Mon Nov 03, 2014 8:23 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2 PA2
Excel Version: 2016

Re: .cub and feeder file are doubled in size

Post by BrianL »

Duncan P wrote: As far as I was aware, when UNDEFVALS was specified it was the undefval (4.94066e-324 - see here) that was not stored to disk, but when ViewZeroOut was used it wrote actual zeros regardless of the state of UNDEFVALS. This meant that the values written took space and were saved to disk. Has this changed recently?

I was under the impression that the enhancement you are referring to in 10.2 only removed from memory those values that wouldn't be saved to disk, in this case 4.94066e-324.
Thanks for the correction Duncan. I wasn't thinking of UNDEFVALS when I wrote up my response.
Post Reply