.cub and feeder file are doubled in size
-
- Posts: 2
- Joined: Wed Aug 19, 2015 5:52 pm
- OLAP Product: TM1
- Version: TM1
- Excel Version: micros10
.cub and feeder file are doubled in size
Hi
.cub file in our application of a sales cube got doubled, there two backups available(aug 11 and aug12){in PROD}
I tested by loading the source files of Aug 12 th on data backup of Aug 11. but there is no change in size of both .cub and .feeder of sales cube {dev}
Also i restarted and saved data
we tested for overfeeding also, there is nothing like that.
still there is no change.
can any one help me what is reaon of this?
.cub file in our application of a sales cube got doubled, there two backups available(aug 11 and aug12){in PROD}
I tested by loading the source files of Aug 12 th on data backup of Aug 11. but there is no change in size of both .cub and .feeder of sales cube {dev}
Also i restarted and saved data
we tested for overfeeding also, there is nothing like that.
still there is no change.
can any one help me what is reaon of this?
-
- MVP
- Posts: 2836
- Joined: Tue Feb 16, 2010 2:39 pm
- OLAP Product: TM1, Palo
- Version: Beginning of time thru 10.2
- Excel Version: 2003-2007-2010-2013
- Location: Atlanta, GA
- Contact:
Re: .cub and feeder file are doubled in size
Only loaded data gets saved in the .cub file so feeders and/or rule calculated values have no bearing on it's size. Sounds like you just have twice as much data in the cube. Without knowing your dimensionality and processes around loading the cube I can't give you any guidance. Perhaps you loaded data into an element that didn't have data before, like a different version or time period, or you normally wipe out versions or time periods during the load and it didn't happen? You can always find out by right-clicking on the cube and choosing Export as Text Data. Make sure you check off Skip Consolidations, Skip Rule Calculated Values and Skip Zero/Blank Values. This will dump out only the actual loaded data in the cube. You should be able to tell by looking at the data what happened.Tamizharasi wrote:Hi
.cub file in our application of a sales cube got doubled, there two backups available(aug 11 and aug12){in PROD}
I tested by loading the source files of Aug 12 th on data backup of Aug 11. but there is no change in size of both .cub and .feeder of sales cube {dev}
Also i restarted and saved data
we tested for overfeeding also, there is nothing like that.
still there is no change.
can any one help me what is reaon of this?
-
- MVP
- Posts: 600
- Joined: Wed Aug 17, 2011 1:19 pm
- OLAP Product: TM1
- Version: 9.5.2 10.1 10.2
- Excel Version: 2003 2007
- Location: York, UK
Re: .cub and feeder file are doubled in size
I doubt if this is your circumstance but just in case ...
If you have nulls on for the cube and you use ViewZeroOut in an import TI then it will write actual zeros to every cell in the view. These zeros will then get saved to the cube.
If you have nulls on for the cube and you use ViewZeroOut in an import TI then it will write actual zeros to every cell in the view. These zeros will then get saved to the cube.
-
- MVP
- Posts: 264
- Joined: Mon Nov 03, 2014 8:23 pm
- OLAP Product: TM1
- Version: 9.5.2 10.1 10.2 PA2
- Excel Version: 2016
Re: .cub and feeder file are doubled in size
FYI - As of 10.2 TM1 is capable of removing data from the cube rather than just storing zeroes. Even pre-10.2, zero values are not saved out to disk and would not affect the size of the .cub file.Duncan P wrote:I doubt if this is your circumstance but just in case ...
If you have nulls on for the cube and you use ViewZeroOut in an import TI then it will write actual zeros to every cell in the view. These zeros will then get saved to the cube.
Tamizharasi, are you seeing the cube memory grow, the .cub file has grown, the .feeder file has grown (if persistent feeders are enabled), or some combination of these. If it's the memory, you may find the }StatsByCube useful
-
- Regular Participant
- Posts: 424
- Joined: Sat Mar 10, 2012 1:03 pm
- OLAP Product: IBM TM1, Planning Analytics, P
- Version: PAW 2.0.8
- Excel Version: 2019
Re: .cub and feeder file are doubled in size
Sorry,If I am wrong here,as for as I understand TM1 sparse consolidation mechanism should simply ignore these zero or null values,So how come it gets saved to the cube? ThanksIf you have nulls on for the cube and you use ViewZeroOut in an import TI then it will write actual zeros to every cell in the view. These zeros will then get saved to the cube
"You Never Fail Until You Stop Trying......"
-
- Posts: 78
- Joined: Tue Nov 30, 2010 1:18 am
- OLAP Product: TM1
- Version: 10.2.2
- Excel Version: 2010
Re: .cub and feeder file are doubled in size
By default you're right, but it is possible to store these values in the cube using UNDEFVALSSorry,If I am wrong here,as for as I understand TM1 sparse consolidation mechanism should simply ignore these zero or null values,So how come it gets saved to the cube? Thanks
http://www-01.ibm.com/support/knowledge ... _undefvals
RHR
-
- Posts: 2
- Joined: Wed Aug 19, 2015 5:52 pm
- OLAP Product: TM1
- Version: TM1
- Excel Version: micros10
Re: .cub and feeder file are doubled in size
I found the issue, user have entered value in the consolidated level of the cube, which is getting spread over all the cells, this is not visible in the architect and while exporting them in excel we found the values.
that why cube got its size as double.
Thanks for all your suggestions and information.
that why cube got its size as double.
Thanks for all your suggestions and information.
-
- MVP
- Posts: 264
- Joined: Mon Nov 03, 2014 8:23 pm
- OLAP Product: TM1
- Version: 9.5.2 10.1 10.2 PA2
- Excel Version: 2016
Re: .cub and feeder file are doubled in size
You are partially correct. For cells that have never had any data, there is nothing stored in memory (or in the .cub) file. Pre-10.2 though, once data is input to a cell, there will always be a value stored in memory for that cell. Including if the cell value is later deleted (set back to zero). TM1 would not save these zero values to the .cub file on disk, so the next time you restarted the server the zero values would be cleared out.BariAbdul wrote: Sorry,If I am wrong here,as for as I understand TM1 sparse consolidation mechanism should simply ignore these zero or null values,So how come it gets saved to the cube? Thanks
-
- MVP
- Posts: 600
- Joined: Wed Aug 17, 2011 1:19 pm
- OLAP Product: TM1
- Version: 9.5.2 10.1 10.2
- Excel Version: 2003 2007
- Location: York, UK
Re: .cub and feeder file are doubled in size
As far as I was aware, when UNDEFVALS was specified it was the undefval (4.94066e-324 - see here) that was not stored to disk, but when ViewZeroOut was used it wrote actual zeros regardless of the state of UNDEFVALS. This meant that the values written took space and were saved to disk. Has this changed recently?BrianL wrote:FYI - As of 10.2 TM1 is capable of removing data from the cube rather than just storing zeroes. Even pre-10.2, zero values are not saved out to disk and would not affect the size of the .cub file.
I was under the impression that the enhancement you are referring to in 10.2 only removed from memory those values that wouldn't be saved to disk, in this case 4.94066e-324.
-
- MVP
- Posts: 264
- Joined: Mon Nov 03, 2014 8:23 pm
- OLAP Product: TM1
- Version: 9.5.2 10.1 10.2 PA2
- Excel Version: 2016
Re: .cub and feeder file are doubled in size
Thanks for the correction Duncan. I wasn't thinking of UNDEFVALS when I wrote up my response.Duncan P wrote: As far as I was aware, when UNDEFVALS was specified it was the undefval (4.94066e-324 - see here) that was not stored to disk, but when ViewZeroOut was used it wrote actual zeros regardless of the state of UNDEFVALS. This meant that the values written took space and were saved to disk. Has this changed recently?
I was under the impression that the enhancement you are referring to in 10.2 only removed from memory those values that wouldn't be saved to disk, in this case 4.94066e-324.