Intercube Feeder causing Server crash

Post Reply
ExApplix
Posts: 103
Joined: Mon Sep 21, 2009 7:09 pm
OLAP Product: Cognos Tm1
Version: 10.2.2
Excel Version: 2016

Intercube Feeder causing Server crash

Post by ExApplix »

I am trying to write a Intercube Feeder and it is causing the Server crash - server RAM goes from 2Gb to 30Gb and then it crashes. I think that I am missing something but not sure what it is. My Source cube and Traget cubes have got some dissimilar dimensions.

Rule in the Target cube looks like:

Code: Select all

['Percent'] = N: DB('Souce_Cube', 'Total Department', 'Total Account', 'Total Position', !Scenario, !Period, !Employee, 'FTE') * 100;
Feeder in the Source cube is:

Code: Select all

['Total Department', 'Total Account', 'Total Position', 'FTE'] => DB('Target_Cube', !Position, 'Total Union', 'Total Grade', 'Total Job', !Period, !Scenario, !Employee, 'Percent');
Can someone please tell me what I am missing here?
User avatar
Martin Ryan
Site Admin
Posts: 1989
Joined: Sat May 10, 2008 9:08 am
OLAP Product: TM1
Version: 10.1
Excel Version: 2010
Location: Wellington, New Zealand
Contact:

Re: Intercube Feeder causing Server crash

Post by Martin Ryan »

Wow that's a big feeder!

As discussed in various posts using a consolidation is a shorthand for writing out potentially hundreds of feeders. When you say "total Department" feeds to "Total Account" and there are 100 departments and 100 accounts you have just created 10,000 feeders.

Using consolidations on either side of the feeder should be limited as much as possible. I suspect you don't actually need it on the left hand side of your feeder at all.

Martin
Please do not send technical questions via private message or email. Post them in the forum where you'll probably get a faster reply, and everyone can benefit from the answers.
Jodi Ryan Family Lawyer
User avatar
Steve Rowe
Site Admin
Posts: 2456
Joined: Wed May 14, 2008 4:25 pm
OLAP Product: TM1
Version: TM1 v6,v7,v8,v9,v10,v11+PAW
Excel Version: Nearly all of them

Re: Intercube Feeder causing Server crash

Post by Steve Rowe »

Just to expand on what Martin was saying, it'sthe consolidations on the right hand side of the feeders that will be causing the memory to spike in the target cube. The product of the N levels below these consolidations 'Total Union', 'Total Grade', 'Total Job' will be fed for every number on the left of the feeder. 2GB to 30GB still seems a lot though, one of those consolidations would have to be very big and you'd need a lot of data too.

Don't forget you don't have to feed with the FTE number, if you have some other number in the Target Cube that is populated whenever you want Percent populated then you can feed with that. Since that measure if is already in the Target cube the dimesionality will bethe same so the feeder will be more natural.

HTH.

Cheersm
Technical Director
www.infocat.co.uk
ExApplix
Posts: 103
Joined: Mon Sep 21, 2009 7:09 pm
OLAP Product: Cognos Tm1
Version: 10.2.2
Excel Version: 2016

Re: Intercube Feeder causing Server crash

Post by ExApplix »

Thanks guys for your time but I am still scratching my head to understand this (sorry). I change the Feeder as follows but still its causing the same memory issue:

Code: Select all

['FTE'] => DB('Target_Cube', !Position, 'Total Union', 'Total Grade', 'Total Job', !Period, !Scenario, !Employee, 'Percent');
Size of Target cube is: 3100 Employees, 1450 Position, 650 Job, 350 Grade, 322 Period, 150 Scenario, 81 Measures (String & Number)
Size of Source cube is: 36500 Account, 3100 Employees, 1450 Position, 322 Period, 150 Scenario, 30 Department, 11 Measures (String and Number)

The source cube does not have the Union, Job and Grade dimensions, that is why I have to use use the Total (Consolidations level) in my feeder. Is there any other way of doing that?

Percent in the Target cube is being used by some other calculations. I have got 50+ rules in the Target cube. If I can grab the missing concept I should be able to write the remaining Feeders.

Please help me in fixing this feeder. Code example will be much appreciated.
David Usherwood
Site Admin
Posts: 1458
Joined: Wed May 28, 2008 9:09 am

Re: Intercube Feeder causing Server crash

Post by David Usherwood »

It would be worth posting the rules which use the FTE value &/or describing the business problem you are trying to solve. Remember, you don't need to feed a value to use it in a rule - and you don't need to feed all references on the right hand side of a rule.
lotsaram
MVP
Posts: 3701
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Intercube Feeder causing Server crash

Post by lotsaram »

As has been explained to you already, you are still feeding total union, total job and total grade. You don't need to do this nor should you.

If you don't already have attributes in your employee dimension for union, job, grade, department, position, etc. etc. then CREATE THEM as these dimensions are basically dependant attributes of employee as there is (or will normally be) a 1:1 relationship at employee level. If these attributes can change over time then simply hold the values in a lookup cube rather than simple attribute.

Then in the feeder simply nest in an AttrS or DB statement into the main DB inorder to only feed the appropriate point on each dependent dimension for each employee.

I don't think it can be put any more simply than that!
ExApplix
Posts: 103
Joined: Mon Sep 21, 2009 7:09 pm
OLAP Product: Cognos Tm1
Version: 10.2.2
Excel Version: 2016

Re: Intercube Feeder causing Server crash

Post by ExApplix »

lotsaram wrote:As has been explained to you already, you are still feeding total union, total job and total grade. You don't need to do this nor should you.

If you don't already have attributes in your employee dimension for union, job, grade, department, position, etc. etc. then CREATE THEM as these dimensions are basically dependant attributes of employee as there is (or will normally be) a 1:1 relationship at employee level. If these attributes can change over time then simply hold the values in a lookup cube rather than simple attribute.
I also thought about using the Attributes but union, job, grade, department, position are based on user inputs and do not have 1:1 relationship e.g one employee could be forcasted/allocated to different departments.

:?: How can I replace the total union, total job and total grade? Shall I hardcode the N level elements name in these dimensions? If yes, then how it will work. For example I have 650 Jobs - do I have to hardcode all of them but that would be same as using the Total jobs. :roll:
David Usherwood wrote:It would be worth posting the rules which use the FTE value &/or describing the business problem you are trying to solve. Remember, you don't need to feed a value to use it in a rule - and you don't need to feed all references on the right hand side of a rule.
I have posted my Rule and the Feeder in the first post. I have also disabled all the other rules but all in vain.

Its midnight at my end and I know I am missing some little concept here, so guys please bear with me. Thanks in advance.
David Usherwood
Site Admin
Posts: 1458
Joined: Wed May 28, 2008 9:09 am

Re: Intercube Feeder causing Server crash

Post by David Usherwood »

Not exactly - you posted the rule _for_ FTE. My challenge is to what you are doing with the FTE in the destination cube - do you need to feed it?
ExApplix
Posts: 103
Joined: Mon Sep 21, 2009 7:09 pm
OLAP Product: Cognos Tm1
Version: 10.2.2
Excel Version: 2016

Re: Intercube Feeder causing Server crash

Post by ExApplix »

David Usherwood wrote:Not exactly - you posted the rule _for_ FTE. My challenge is to what you are doing with the FTE in the destination cube - do you need to feed it?
Hi David, As mentioned before I have disabled all the other Rules so the only Rule in the Target cube is:

Code: Select all

['Percent'] = N: DB('Souce_Cube', 'Total Department', 'Total Account', 'Total Position', !Scenario, !Period, !Employee, 'FTE') * 100;
and Feeder in the source cube is:

Code: Select all

['FTE'] => DB('Target_Cube', !Position, 'Total Union', 'Total Grade', 'Total Job', !Period, !Scenario, !Employee, 'Percent');
When I hardcode the Union, Grade and Job as follows it works:

Code: Select all

['FTE'] => DB('Target_Cube', !Position, '01', '05', '123', !Period, !Scenario, !Employee, 'Percent');
but I want this Feeder to work for all the elements in Union, Grade and Job dimensions.

Any help will be highly appreciated.
David Usherwood
Site Admin
Posts: 1458
Joined: Wed May 28, 2008 9:09 am

Re: Intercube Feeder causing Server crash

Post by David Usherwood »

You_haven't_set_out_the_business_reason_for_feeding_the_value.
Can someone else help me out here?
lotsaram
MVP
Posts: 3701
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Intercube Feeder causing Server crash

Post by lotsaram »

David Usherwood wrote:You_haven't_set_out_the_business_reason_for_feeding_the_value.
Can someone else help me out here?
You can only lead a horse to water ...
Alan Kirk
Site Admin
Posts: 6647
Joined: Sun May 11, 2008 2:30 am
OLAP Product: TM1
Version: PA2.0.9.18 Classic NO PAW!
Excel Version: 2013 and Office 365
Location: Sydney, Australia
Contact:

Re: Intercube Feeder causing Server crash

Post by Alan Kirk »

David Usherwood wrote:You_haven't_set_out_the_business_reason_for_feeding_the_value.
Can someone else help me out here?
If they feed it they can claim a tax deduction for the benevolent relief of starving calculations.

Kinda like donating the leftover food from the staff cafeteria to the local soup kitchen.

Hmmm, possibly not the answer you were after.

I'll get my coat... :?
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
Goatship
Posts: 33
Joined: Tue May 25, 2010 4:15 am
OLAP Product: TM1
Version: 9.5
Excel Version: 2007

Re: Intercube Feeder causing Server crash

Post by Goatship »

Dear Steve Rowe,

You mean the essence of feeders is to tell if this number exist in the feeding cell, go check the rule of the fed cell.

For example;

A =>B

means
if A = 0, then skip rule checking of B. If A <>0, go perform rules of B

Therefore we can ignore how the rules are written in writing feeders. Is this correct?
If true this would be a lot of help in case the rules are very complex.

Thanks a lot.
I'm new to TM1.
lotsaram
MVP
Posts: 3701
Joined: Fri Mar 13, 2009 11:14 am
OLAP Product: TableManager1
Version: PA 2.0.x
Excel Version: Office 365
Location: Switzerland

Re: Intercube Feeder causing Server crash

Post by lotsaram »

Goatship wrote:Dear Steve Rowe,

You mean the essence of feeders is to tell if this number exist in the feeding cell, go check the rule of the fed cell.

For example;

A =>B

means
if A = 0, then skip rule checking of B. If A <>0, go perform rules of B

Therefore we can ignore how the rules are written in writing feeders. Is this correct?
If true this would be a lot of help in case the rules are very complex.

Thanks a lot.
NO.
But you are on the right track sort of. The purpose of the feeder is to tell the consolidation engine which values to aggregate. If you happen to query a specific cell (or a number of cells in a view array) then the calculation engine will still evaluate the indivdual value in each rule defined cell correctly. It is just that without feeders these values will not aggregate whihc leads to incorrect results at higher levels of the hierarchy.

It is true that the feeder does not have to reflect the rule (it is just that most of the time it does.)
Post Reply