TI Process Performance Tuning
-
- Posts: 51
- Joined: Sun Sep 11, 2016 1:55 pm
- OLAP Product: Cognos Tm1
- Version: 10.2,11
- Excel Version: 2007
TI Process Performance Tuning
Hi Team,
I have a simple Turbointegrator Process with 2 dimensions in it, the datasource is CSV file. It has around 600 records but it taking around 23 minutes to execute. Here in one dimension two of its elements are populated by "Subset Picklist". Please suggest me to optimize the execution time.
Thanks,
Aravind.
I have a simple Turbointegrator Process with 2 dimensions in it, the datasource is CSV file. It has around 600 records but it taking around 23 minutes to execute. Here in one dimension two of its elements are populated by "Subset Picklist". Please suggest me to optimize the execution time.
Thanks,
Aravind.
-
- MVP
- Posts: 3652
- Joined: Fri Mar 13, 2009 11:14 am
- OLAP Product: TableManager1
- Version: PA 2.0.x
- Excel Version: Office 365
- Location: Switzerland
Re: TI Process Performance Tuning
Start by providing some shred of relevant information about the dimensions and what the process is doing.aravind.cgns wrote:Please suggest me to optimize the execution time.
Please place all requests for help in a public thread. I will not answer PMs requesting assistance.
-
- Posts: 51
- Joined: Sun Sep 11, 2016 1:55 pm
- OLAP Product: Cognos Tm1
- Version: 10.2,11
- Excel Version: 2007
Re: TI Process Performance Tuning
Hi lotsa,
It is an actuals load TI Process which copies data from CSV file to cube. It has two dimensions "Item" and "Item Attributes" the "Item Attributes" dimension has 7 elements out of which two of the element's has attributes which uses "Subset Picklist", It is an simple TIP which loads data from "CSV" file to cube. It takes around 24 minutes to execute.
Thanks,
Aravind
It is an actuals load TI Process which copies data from CSV file to cube. It has two dimensions "Item" and "Item Attributes" the "Item Attributes" dimension has 7 elements out of which two of the element's has attributes which uses "Subset Picklist", It is an simple TIP which loads data from "CSV" file to cube. It takes around 24 minutes to execute.
Thanks,
Aravind
-
- MVP
- Posts: 2832
- Joined: Tue Feb 16, 2010 2:39 pm
- OLAP Product: TM1, Palo
- Version: Beginning of time thru 10.2
- Excel Version: 2003-2007-2010-2013
- Location: Atlanta, GA
- Contact:
Re: TI Process Performance Tuning
The picklist is probably red herring since I think it can only stop people from entering incorrect values through one of the user interfaces, not a TI. The more likely culprit is feeders re-firing as each value is written to the cube. I've seen this happen before in poorly designed feeders. I take it this cube has rules and is feeding something based on "Actuals"?
-
- Community Contributor
- Posts: 217
- Joined: Thu Aug 15, 2013 9:05 am
- OLAP Product: TM1
- Version: 10.2.1.1
- Excel Version: 14.0.6129.5000
Re: TI Process Performance Tuning
You could stop people from entering incorrect values into a Picklist from a TI by using the SCAN function on the Attribute value. The logic would be, if substring is not in the string type return value of the Attrs function, then it is incorrect.tomok wrote:The picklist is probably red herring since I think it can only stop people from entering incorrect values through one of the user interfaces, not a TI.
Trev
- Steve Rowe
- Site Admin
- Posts: 2416
- Joined: Wed May 14, 2008 4:25 pm
- OLAP Product: TM1
- Version: TM1 v6,v7,v8,v9,v10,v11+PAW
- Excel Version: Nearly all of them
Re: TI Process Performance Tuning
Suggest you post your code as requested.
My bet would be that you have MDX subsets that are being recalculated.
My bet would be that you have MDX subsets that are being recalculated.
Technical Director
www.infocat.co.uk
www.infocat.co.uk
-
- Posts: 51
- Joined: Sun Sep 11, 2016 1:55 pm
- OLAP Product: Cognos Tm1
- Version: 10.2,11
- Excel Version: 2007
Re: TI Process Performance Tuning
Steve there is no MDX subsets. As Tom said i guess the problem would be due to feeders the reason being there auto-generated feeders by performance modeler. The model is link driven, The cube has 5 target links.
Thanks,
Aravind
Thanks,
Aravind
-
- MVP
- Posts: 2832
- Joined: Tue Feb 16, 2010 2:39 pm
- OLAP Product: TM1, Palo
- Version: Beginning of time thru 10.2
- Excel Version: 2003-2007-2010-2013
- Location: Atlanta, GA
- Contact:
Re: TI Process Performance Tuning
True, you could add your own custom code, utilizing the data in a picklist cuibe, to stop invalid data in a ti but the fact of just having a picklist on a dimension won't do it, like it will for entering data in the cell manually which was my point. I would be willing to bet everything I own that the OP does not have such custom code in his TI which is why I said the picklist issue was a red herring for his problem.TrevorGoss wrote:You could stop people from entering incorrect values into a Picklist from a TI by using the SCAN function on the Attribute value. The logic would be, if substring is not in the string type return value of the Attrs function, then it is incorrect.tomok wrote:The picklist is probably red herring since I think it can only stop people from entering incorrect values through one of the user interfaces, not a TI.
Trev
- PavoGa
- MVP
- Posts: 617
- Joined: Thu Apr 18, 2013 6:59 pm
- OLAP Product: TM1
- Version: 10.2.2 FP7, PA2.0.9.1
- Excel Version: 2013 PAW
- Location: Charleston, Tennessee
Re: TI Process Performance Tuning
The keywords here may be performance modeler . I think tomok's suggestion to check the feeders is the best place. An additional question: are you writing string or numeric data or both to the cube? If you happen to be overwriting string data used for a feeder, that can cause the feeders to re-fire.Steve there is no MDX subsets. As Tom said i guess the problem would be due to feeders the reason being there auto-generated feeders by performance modeler. The model is link driven, The cube has 5 target links.
One suggestion would be to deactivate the rules in the prolog and in the epilog reload them.
Ty
Cleveland, TN
Cleveland, TN
-
- MVP
- Posts: 3113
- Joined: Mon Dec 29, 2008 6:26 pm
- OLAP Product: TM1, Jedox
- Version: PAL 2.0.9.18
- Excel Version: Microsoft 365
- Location: Brussels, Belgium
- Contact:
Re: TI Process Performance Tuning
Maybe Performance Modeler annoyingly added a Feedstrings statement at the top of the rules statements ?
Best regards,
Wim Gielis
IBM Champion 2024
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
Wim Gielis
IBM Champion 2024
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
-
- MVP
- Posts: 264
- Joined: Mon Nov 03, 2014 8:23 pm
- OLAP Product: TM1
- Version: 9.5.2 10.1 10.2 PA2
- Excel Version: 2016
Re: TI Process Performance Tuning
It's been a while since I've had anything to do with Performance Modeller, but I seem to recall it required setting ForceReevaluationOfFeedersForFedCellsOnDataChange=T for it's generated rules. That can have a big impact on performance too.
-
- Posts: 51
- Joined: Sun Sep 11, 2016 1:55 pm
- OLAP Product: Cognos Tm1
- Version: 10.2,11
- Excel Version: 2007
Re: TI Process Performance Tuning
Hi PavoGa,
we are loading both numeric and string data in to the cube, you want me comment the code in prolog tab and copy the same in the epilog??
Wim ,
there is Feedstrings statement added at the top of the rules statements, You want me comment that???
Brain,
ForceReevaluationOfFeedersForFedCellsOnDataChange=T is already set to true in config file.
we are loading both numeric and string data in to the cube, you want me comment the code in prolog tab and copy the same in the epilog??
Wim ,
there is Feedstrings statement added at the top of the rules statements, You want me comment that???
Brain,
ForceReevaluationOfFeedersForFedCellsOnDataChange=T is already set to true in config file.
-
- MVP
- Posts: 3113
- Joined: Mon Dec 29, 2008 6:26 pm
- OLAP Product: TM1, Jedox
- Version: PAL 2.0.9.18
- Excel Version: Microsoft 365
- Location: Brussels, Belgium
- Contact:
Re: TI Process Performance Tuning
Yes see if it makes a difference in terms of performance.
Best regards,
Wim Gielis
IBM Champion 2024
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
Wim Gielis
IBM Champion 2024
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
-
- Posts: 51
- Joined: Sun Sep 11, 2016 1:55 pm
- OLAP Product: Cognos Tm1
- Version: 10.2,11
- Excel Version: 2007
Re: TI Process Performance Tuning
Wim,
I have commented the Feedstrings statement in the rule editor and executed the TIP but there is no performance Improvement!!
I have commented the Feedstrings statement in the rule editor and executed the TIP but there is no performance Improvement!!
- Steve Rowe
- Site Admin
- Posts: 2416
- Joined: Wed May 14, 2008 4:25 pm
- OLAP Product: TM1
- Version: TM1 v6,v7,v8,v9,v10,v11+PAW
- Excel Version: Nearly all of them
Re: TI Process Performance Tuning
ForceReevaluationOfFeedersForFedCellsOnDataChange=T is already set to true in config file.
This should be F for performance.
Any well designed systems should not require this parameter in the first place (IMO!)
This should be F for performance.
Any well designed systems should not require this parameter in the first place (IMO!)
Technical Director
www.infocat.co.uk
www.infocat.co.uk
- PavoGa
- MVP
- Posts: 617
- Joined: Thu Apr 18, 2013 6:59 pm
- OLAP Product: TM1
- Version: 10.2.2 FP7, PA2.0.9.1
- Excel Version: 2013 PAW
- Location: Charleston, Tennessee
Re: TI Process Performance Tuning
Sorry, I was not clear. What I am suggesting you try is to remove the rules from the cube then running your process to load the cube. I would expect this to confirm your rules are the problem, not the TI (having said that without looking at the code).we are loading both numeric and string data in to the cube, you want me comment the code in prolog tab and copy the same in the epilog??
If confirming the rules/feeders are the problem then rework them. (are the feeders conditional?) If you cannot rework them to improve the performance, then you may try this:
In the prolog of your TI, include some code kind of like this:
Code: Select all
strCmd = 'cmd /c copy \path\cubename.rux \path\cubename.bak';
ExecuteCommand(strCmd, 1);
CubeRuleDestroy(cubename);
Simple:
Code: Select all
RuleLoadFromFile(cubename, '\path\cubename.bak');
Code: Select all
strCmd = 'cmd /c TM1RunTI -process ProcessToLoadRules pCubename=cubename...';
ExecuteCommand(strCmd, 0);
Things to try. Good luck.
Ty
Ty
Cleveland, TN
Cleveland, TN