Cube taking a long time to move data

Post Reply
winsonlee
Regular Participant
Posts: 180
Joined: Thu Jul 01, 2010 3:06 am
OLAP Product: Cognos Express
Version: 9.5
Excel Version: 2007
Location: Melbourne, Australia

Cube taking a long time to move data

Post by winsonlee »

I have a cube that has rules that reads data from 4 other cubes and comes with feeders. I created a process to move data from one element to another within that cube and the cell that contains the value is not reference by the rules. The data that needs to be moved is not much. But it seems like during the process is executed, what i saw on tm1top is the rules is process over and over again and it has been 1 hour and 30 mins and the process is not finish yet. What may cause this issue ? Is there a code where i can un attach the rules before running the process and attach the rules back in once the process is done ?

Code: Select all

Run:R(p_Job_Title_Rate)-(Rule)	ProcessExecuteEx	(R)1(IX)0(W)0	(R)38(IX)51(W)0	3263
Run:R(p_GWAC_Consumption)-(Rule)	ProcessExecuteEx	(R)1(IX)0(W)0	(R)38(IX)51(W)0	3265
Run:R(p_Actuals)-(Rule)	ProcessExecuteEx	(R)1(IX)0(W)0	(R)38(IX)51(W)0	3267
Run:R(}ElementAttributes_SalesHierarchy_Reporting)-(Cube)	ProcessExecuteEx	(R)1(IX)0(W)0	(R)38(IX)51(W)0	3269
Run:R(CustomerHierarchy)-(Dimension)	ProcessExecuteEx	(R)0(IX)0(W)0	(R)38(IX)51(W)0	3271
Run:R(}ElementAttributes_p_GL_Account)-(Cube)	ProcessExecuteEx	(R)1(IX)0(W)0	(R)38(IX)51(W)0	3273
Run:R(p_Value_Add_Reporting)-(Rule)	ProcessExecuteEx	(R)1(IX)0(W)0	(R)38(IX)51(W)0	3275
Run:R(p_Order)-(Dimension)	ProcessExecuteEx	(R)0(IX)0(W)0	(R)38(IX)51(W)0	3277
Run:R(p_SystemControl)-(Rule)	ProcessExecuteEx	(R)1(IX)0(W)0	(R)38(IX)51(W)0	3279


Code: Select all

IF ( CellisUpdateable(vCube, p_GL_Account, SalesHierarchy_Reporting,  CustomerHierarchy, p_Time, Sector, p_Site,  p_Version, p_Scenario, p_Value_Add_m
) = 1);
    CellPutN (Value, vCube, p_GL_Account,  SalesHierarchy_Reporting, CustomerHierarchy,  p_Time, Sector, p_Site, p_Version, p_Scenario, p_Value_Add_m)
;
ENDIF;
Christopher Kernahan
Community Contributor
Posts: 147
Joined: Mon Nov 29, 2010 6:30 pm
OLAP Product: Cognos TM1
Version: 10.1
Excel Version: Office 2010

Re: Cube taking a long time to move data

Post by Christopher Kernahan »

Hi winsonlee,

Did your process end normally or did you terminate? It may be that it is stuck in an infinite loop, or it may be running normally, but you have a very large datasource and it is running through all of the datasource lines.

Given you are pulling data from four other cubes, I suggest it is likely that you have overfeeding issues which are slowing things up. What are the feeding ratios on your main cube/source cubes?

To answer your other question about saving rules in TI, you can save a blank .txt file into the cube in the prolog and save the rule file in the epilog. This function is RuleLoadFromFile. A good source for these types of questions is the TM1 Help -> Reference guide. You can search through all the documented TI functions in categories - this one lives in the Rules Management TurboIntegrator Functions section.
winsonlee
Regular Participant
Posts: 180
Joined: Thu Jul 01, 2010 3:06 am
OLAP Product: Cognos Express
Version: 9.5
Excel Version: 2007
Location: Melbourne, Australia

Re: Cube taking a long time to move data

Post by winsonlee »

as it is reading and writing on the same cube, I ended up exporting it to csv file and import it back to the cube. the process runs much faster through this way.

how do you calculate feeding ratios ? I have a feeling this cube is having over feeding issues as it is taking 3 minutes to load the view. from your experience, what is the longest load time of a cube you have encounter and from how many other cubes it is reading the data from ?

at the moment i know how to use rules and feeders to make the data display correctly but i still lack of some experience in optimizing the feeders.
nick_leeson
Posts: 98
Joined: Sat Feb 11, 2012 11:13 am
OLAP Product: TM1 9x, BPC, Hyperion, HANA
Version: TM1 10
Excel Version: Excel 2003 - 2010

Re: Cube taking a long time to move data

Post by nick_leeson »

The export to CSV and back in was faster then the original because of locks. More documentation is below.

http://publib.boulder.ibm.com/infocente ... ay_N1.html

Have you checked the design of your cube ? I suspect its not well optimized although I must admit I leave it for you check that.
Also on priority basis check your feeders. Underfeeding should be avoided at all costs.
Christopher Kernahan
Community Contributor
Posts: 147
Joined: Mon Nov 29, 2010 6:30 pm
OLAP Product: Cognos TM1
Version: 10.1
Excel Version: Office 2010

Re: Cube taking a long time to move data

Post by Christopher Kernahan »

Hi winsonlee,

Right-click on the server, Start Performance Monitor, open }StatsBy Cube, select your cube, and calculate Number of Fed Cells / Number of Populated Numeric Cells.

What constitutes overfeeding? I'm sure there are other commentaries on it elsewhere, but I think of it this way. If you have data stored in Local Currency, and you calculate a USD and GBP value as well, those two calculated cells need to be fed. If you also feed 10 others cells per Local Currency cell, you're wasting memory.

Also try these topics;

http://www.tm1forum.com/viewtopic.php?f=3&t=3165
http://www.tm1forum.com/viewtopic.php?p=2972
Post Reply