We believe this is working differently to how it used to and we think this has appeared in either .15 or .16.
We have many cubes with inter cube feeders, conditional feeders etc.
On server startup the feeder process time for a particular cube is approximately 30 minutes. This has not changed with the latest versions.
If we perform a simple rule change for this cube it used to take 30 minutes to fully save (including processing feeders)
Now if we perform a simple rule change it is performing the save in about 2 minutes (in the log it says it has processed feeders). On a server restart it then takes 30 minutes.
Could it be performing a delta computation on the feeders or perhaps it's not properly calculating feeders?
Any thoughts?
2.0.9.16 Rule save time dramatically less - Feeder calcs?
- Steve Rowe
- Site Admin
- Posts: 2455
- Joined: Wed May 14, 2008 4:25 pm
- OLAP Product: TM1
- Version: TM1 v6,v7,v8,v9,v10,v11+PAW
- Excel Version: Nearly all of them
Re: 2.0.9.16 Rule save time dramatically less - Feeder calcs?
At some point the rule compiler became intelligent enough to know that you had not changed the feeders and so does not recompile them. This means you can change rules quickly and is generally regarded as a good thing...
You do need to take care though as it's probably possible to dream up a use case where a change to the rules would require the feeders to recompile.
You do need to take care though as it's probably possible to dream up a use case where a change to the rules would require the feeders to recompile.
Technical Director
www.infocat.co.uk
www.infocat.co.uk
-
- Posts: 117
- Joined: Mon Jul 29, 2019 5:02 am
- OLAP Product: Planning Analytics
- Version: 2.0.9.x
- Excel Version: Office 365 16
Re: 2.0.9.16 Rule save time dramatically less - Feeder calcs?
Thanks SteveSteve Rowe wrote: ↑Wed May 03, 2023 9:54 am At some point the rule compiler became intelligent enough to know that you had not changed the feeders and so does not recompile them. This means you can change rules quickly and is generally regarded as a good thing...
The last test case I performed was the removal of a feeder. Perhaps adding a feeder might take longer. Might need to test further.
John
- gtonkin
- MVP
- Posts: 1254
- Joined: Thu May 06, 2010 3:03 pm
- OLAP Product: TM1
- Version: Latest and greatest
- Excel Version: Office 365 64-bit
- Location: JHB, South Africa
- Contact:
Re: 2.0.9.16 Rule save time dramatically less - Feeder calcs?
Noticed this parameter in the TM1S.CFG - may be worthwhile checking/reviewing. Default is True though.
SaveFeedersOnRuleAttach
When set to False, postpones writing to feeder files until SaveDataAll and CubeDataSave are called, instead of updating the files right after rules are changed and feeders are generated at the Planning Analytics database start time.
SaveFeedersOnRuleAttach
When set to False, postpones writing to feeder files until SaveDataAll and CubeDataSave are called, instead of updating the files right after rules are changed and feeders are generated at the Planning Analytics database start time.
-
- Posts: 117
- Joined: Mon Jul 29, 2019 5:02 am
- OLAP Product: Planning Analytics
- Version: 2.0.9.x
- Excel Version: Office 365 16
Re: 2.0.9.16 Rule save time dramatically less - Feeder calcs?
Thanks George, good idea. But it's not in use and we are not using persistent feeders.gtonkin wrote: ↑Fri May 05, 2023 4:29 pm Noticed this parameter in the TM1S.CFG - may be worthwhile checking/reviewing. Default is True though.
SaveFeedersOnRuleAttach
-
- MVP
- Posts: 3698
- Joined: Fri Mar 13, 2009 11:14 am
- OLAP Product: TableManager1
- Version: PA 2.0.x
- Excel Version: Office 365
- Location: Switzerland
Re: 2.0.9.16 Rule save time dramatically less - Feeder calcs?
I hadn't ever heard of that one. But I would assume from the documentation that feeders will still always be processed and this parameter only influences the actual saving to disk of the .feeders file. (Note: when saving a rule, the server is already smart enough to only compile feeders if there has been a change to the feeders section, so if just working on the calculations themselves then rule compilation woudl normally be very fast anyway if only calculations have changed and not feeders).gtonkin wrote: ↑Fri May 05, 2023 4:29 pm Noticed this parameter in the TM1S.CFG - may be worthwhile checking/reviewing. Default is True though.
SaveFeedersOnRuleAttach
When set to False, postpones writing to feeder files until SaveDataAll and CubeDataSave are called, instead of updating the files right after rules are changed and feeders are generated at the Planning Analytics database start time.
Please place all requests for help in a public thread. I will not answer PMs requesting assistance.
-
- MVP
- Posts: 3698
- Joined: Fri Mar 13, 2009 11:14 am
- OLAP Product: TableManager1
- Version: PA 2.0.x
- Excel Version: Office 365
- Location: Switzerland
Re: 2.0.9.16 Rule save time dramatically less - Feeder calcs?
Steve has already pointed out that rule compilation doesn't include processing feeders unless feeder statements have changed. But assuming you are changing feeders or are using the CubeProcessFeeders function then this difference could be due to MTQ. Do you have MTFeeders or MTFeeders.AtStartup in the tm1s.cfg file? The documentation says MTFeeders is false by default, but it wouldn't be too surprising if the default value had been switched to true. IBM do tend to do this (conservative approach, initial default value preserves old behaviour, default value changes to new behaviour once feature is established and proven) and the documentation rarely keeps up.JohnO wrote: ↑Wed May 03, 2023 12:23 am We believe this is working differently to how it used to and we think this has appeared in either .15 or .16.
We have many cubes with inter cube feeders, conditional feeders etc.
On server startup the feeder process time for a particular cube is approximately 30 minutes. This has not changed with the latest versions.
If we perform a simple rule change for this cube it used to take 30 minutes to fully save (including processing feeders)
Now if we perform a simple rule change it is performing the save in about 2 minutes (in the log it says it has processed feeders). On a server restart it then takes 30 minutes.
Could it be performing a delta computation on the feeders or perhaps it's not properly calculating feeders?
Any thoughts?
Please place all requests for help in a public thread. I will not answer PMs requesting assistance.
-
- Posts: 117
- Joined: Mon Jul 29, 2019 5:02 am
- OLAP Product: Planning Analytics
- Version: 2.0.9.x
- Excel Version: Office 365 16
Re: 2.0.9.16 Rule save time dramatically less - Feeder calcs?
[/quote]
Do you have MTFeeders or MTFeeders.AtStartup in the tm1s.cfg file?
[/quote]
No and we are not using persistent feeders. We have a lot of conditional feeders.
Do you have MTFeeders or MTFeeders.AtStartup in the tm1s.cfg file?
[/quote]
No and we are not using persistent feeders. We have a lot of conditional feeders.