Pass Data At Consolidation cube to another cube

Post Reply
jviegas@bi4all.pt
Posts: 67
Joined: Fri Oct 14, 2011 3:15 pm
OLAP Product: TM1
Version: 10.2.2
Excel Version: 13
Location: Portugal

Pass Data At Consolidation cube to another cube

Post by jviegas@bi4all.pt »

Hi all,

Maybe someone has an idea regarding this.

I have a source cube where a dimension has this structure:

Parent A
Element A1
Element A2
Element A3
Parent B
Element B1
Element B2
Parent C
...
...

This would be the source cube and I need to pass infortion through TI process to another cube where the a similar dimension has the parent level only as leaf item:

TOTAL
Parent A
Parent B
Parent C
....

When executing the TI process It is trying to match the elements and ignoring the parents (as a result I have error of non-existent elements and no data is passed through the cubes).

Can anyone help me on this?

Thanks in advance,

Jorge
tomok
MVP
Posts: 2836
Joined: Tue Feb 16, 2010 2:39 pm
OLAP Product: TM1, Palo
Version: Beginning of time thru 10.2
Excel Version: 2003-2007-2010-2013
Location: Atlanta, GA
Contact:

Re: Pass Data At Consolidation cube to another cube

Post by tomok »

This question has been asked ad nauseum on this forum. Please use the search function first before posting a question. The simple answer is to use a cube view as the source for the TI process that has a subset on the dimension in question, filtering to only the "Parent" elements you want to load in Cube B. Then make sure the view is configured not to "Skip Consolidations". That's pretty much it.
Tom O'Kelley - Manager Finance Systems
American Tower
http://www.onlinecourtreservations.com/
jviegas@bi4all.pt
Posts: 67
Joined: Fri Oct 14, 2011 3:15 pm
OLAP Product: TM1
Version: 10.2.2
Excel Version: 13
Location: Portugal

Re: Pass Data At Consolidation cube to another cube

Post by jviegas@bi4all.pt »

Hi Tomok,

Actually I check other posts but felt like none of solve the situation I have.

Thank you for the feedback but I have a doubt how do you uncheck or unflag the "Skip Consolidations" because this is exactly what I want it to do regarding my souce view in the cube

Jorge
declanr
MVP
Posts: 1831
Joined: Mon Dec 05, 2011 11:51 am
OLAP Product: Cognos TM1
Version: PA2.0 and most of the old ones
Excel Version: All of em
Location: Manchester, United Kingdom
Contact:

Re: Pass Data At Consolidation cube to another cube

Post by declanr »

jviegas@bi4all.pt wrote:Hi Tomok,

Actually I check other posts but felt like none of solve the situation I have.

Thank you for the feedback but I have a doubt how do you uncheck or unflag the "Skip Consolidations" because this is exactly what I want it to do regarding my souce view in the cube

Jorge
ViewExtractSkipCalcsSet or assuming you are using the GUI just find the box and untick it.
Declan Rodger
BariAbdul
Regular Participant
Posts: 424
Joined: Sat Mar 10, 2012 1:03 pm
OLAP Product: IBM TM1, Planning Analytics, P
Version: PAW 2.0.8
Excel Version: 2019

Re: Pass Data At Consolidation cube to another cube

Post by BariAbdul »

When you build cube view as a data source it prompts you with option skip zero or skip rules derived cells and skip consolidations ,the second option is to use ViewExtractSkipCalcsSet (Cube, ViewName, Flag);
Hope it helps.Thanks
"You Never Fail Until You Stop Trying......"
BariAbdul
Regular Participant
Posts: 424
Joined: Sat Mar 10, 2012 1:03 pm
OLAP Product: IBM TM1, Planning Analytics, P
Version: PAW 2.0.8
Excel Version: 2019

Re: Pass Data At Consolidation cube to another cube

Post by BariAbdul »

Sorry Declan,You beat me by couple of seconds.
"You Never Fail Until You Stop Trying......"
jviegas@bi4all.pt
Posts: 67
Joined: Fri Oct 14, 2011 3:15 pm
OLAP Product: TM1
Version: 10.2.2
Excel Version: 13
Location: Portugal

Re: Pass Data At Consolidation cube to another cube

Post by jviegas@bi4all.pt »

Problem Solved.

Addicionaly I had a problem with an if condition that was giving me a strange behavior on the TI process.

Thanks to all for the help.
lotsaram
MVP
Posts: 3706
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Pass Data At Consolidation cube to another cube

Post by lotsaram »

When processing data TM1 processes leaf cells many times faster than consolidations. With asymmetric cubes where one dimension has leaves which are consolidated nodes in an analog dimension it is almost always faster to process leaf cells from the detailed cube and accumulate into the summary cube. An alternative method to processing consolidated cells is to have a string attribute holding the parent name and use this to direct data to the appropriate node while accumulating.

Nothing wrong with the advice which you have been given but if you have a significant volume of data to process or then accumulating from leaf cells could be quite a bit faster.
Please place all requests for help in a public thread. I will not answer PMs requesting assistance.
User avatar
Michel Zijlema
Site Admin
Posts: 713
Joined: Wed May 14, 2008 5:22 am
OLAP Product: TM1, PALO
Version: both 2.5 and higher
Excel Version: 2003-2007-2010
Location: Netherlands
Contact:

Re: Pass Data At Consolidation cube to another cube

Post by Michel Zijlema »

lotsaram wrote:Nothing wrong with the advice which you have been given but if you have a significant volume of data to process or then accumulating from leaf cells could be quite a bit faster.
I second lotsaram's remark here. I've seen examples where just processing leaf levels was significantly faster than processing the consolidated cells. One example was on a big cube where processing a view on consolidated level took about 20 minutes, while creating on the fly a summary cube, populating that from the big cube (accumulating from leaf cells) and then processing the temporary summary cube (because evaluation on consolidated level was required) took less than a minute...

Michel
Duncan P
MVP
Posts: 600
Joined: Wed Aug 17, 2011 1:19 pm
OLAP Product: TM1
Version: 9.5.2 10.1 10.2
Excel Version: 2003 2007
Location: York, UK

Re: Pass Data At Consolidation cube to another cube

Post by Duncan P »

So this is quite complicated and if this is a TI that is going to be run regularly I would experiment with both approaches.

If there is no rule defined on the source cube I would be very surprised to find that accumulating the leaf values in the TI is faster, very surprised.

If for the leaf values there is an N level rule defined on the descendants of the consolidated source cells then it will depend on how you do it. As you say that you use 10.2 you could take advantage of multi-threading by defining a view corresponding to your source consolidation and using ViewConstruct on that view in the prolog. This will allow the view to be constructed using however many threads you have configured in your tm1s.cfg. The consolidated values will almost certainly be cached in the calculation cache and will take next to no time to read when the main part of the TI runs. Also it is possible that the values will get read straight out of the stargate that gets created. I'm not certain of that though. I know that this technique has been used with success by others on the forum - please correct me if I've got any details wrong.

If there is a rule defined at the C level for the source consolidated values and a rule is also defined for the underlying leaf cells, then things are more complicated. The previous technique will still be useful but you have to be careful because opening a view automatically creates an internal view of the contributing leaf cells and performs the aggregation - even if all the consolidated cells in the view are calculated. This is in addition to all the work that it will do to do the calculations at consolidated level, which will almost certainly involve other consolidation. The aggregation part of this is not the issue, and you can't avoid it anyway, but the unnecessary leaf level calculations are. They add considerably to the overhead and they should be avoided. The only way round this is to make the whole source measure (the element on the measures dimension) consolidated, a parent of a dummy item that has no rule defined for it. This means that the actual contributing leaf cells are the dummy ones so no leaf calculations will be done.

In a cube with many measures calculated from a single main source measure (using drivers and the like from other cubes), the source item can be the child of all the calculated items. This approach was introduced to us by Lotsaram who championed it mostly because you only have to feed the one measure.
User avatar
Michel Zijlema
Site Admin
Posts: 713
Joined: Wed May 14, 2008 5:22 am
OLAP Product: TM1, PALO
Version: both 2.5 and higher
Excel Version: 2003-2007-2010
Location: Netherlands
Contact:

Re: Pass Data At Consolidation cube to another cube

Post by Michel Zijlema »

Duncan P wrote:If there is no rule defined on the source cube I would be very surprised to find that accumulating the leaf values in the TI is faster, very surprised.
Well, Surprise! then :)
The source cube in the example I was talking about didn't have a rules sheet. What I found in this and other examples is that the slowness on consolidated views occurs on source cubes with lots of dimensions. The example cube had 21 dimensions. The comparison of 20 minutes vs less than one minute was on processing/evaluating one month of data (approx. 1.5 mln. populated leaf cells).

Michel
Post Reply