Data change in tm1
-
- Posts: 138
- Joined: Mon Apr 26, 2010 12:39 pm
- OLAP Product: cognos
- Version: tm1 9.5
- Excel Version: 2007
Data change in tm1
Hi All,
Need some advise,
Actual data (P&L reported data, only for Mar 13 month) for previous month has changed in tm1 cube,
We are trying find the root cause for the same by comparing the data with source (DB) and other sources. still no luck.
Can you please advsie what other area or checks can be done.
Regards,
Ravi
Need some advise,
Actual data (P&L reported data, only for Mar 13 month) for previous month has changed in tm1 cube,
We are trying find the root cause for the same by comparing the data with source (DB) and other sources. still no luck.
Can you please advsie what other area or checks can be done.
Regards,
Ravi
-
- Site Admin
- Posts: 6647
- Joined: Sun May 11, 2008 2:30 am
- OLAP Product: TM1
- Version: PA2.0.9.18 Classic NO PAW!
- Excel Version: 2013 and Office 365
- Location: Sydney, Australia
- Contact:
Re: Data change in tm1
I would hope that you had checked the transaction log files as a first step.ravi wrote: Actual data (P&L reported data, only for Mar 13 month) for previous month has changed in tm1 cube,
We are trying find the root cause for the same by comparing the data with source (DB) and other sources. still no luck.
Can you please advsie what other area or checks can be done.
Of course it's possible that the transactions weren't logged, so that's not a guarantee. However it also depends on how certain you are that the numbers in TM1 have changed, and that you aren't looking at a change in your source system due to, for example, a prior period posting in your ledger. (You haven't said how you know that the numbers have changed; whether you're comparing to a snapshot of the prior data, or the source system.)
It would also be worth checking your TIs to see whether any of them are capable of making such an adjustment, intentionally or not.
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
-
- Posts: 138
- Joined: Mon Apr 26, 2010 12:39 pm
- OLAP Product: cognos
- Version: tm1 9.5
- Excel Version: 2007
Re: Data change in tm1
Thanks Alan.
I have retrieved tm1 data at consolidated one on 04/05 and other on 06/11 for actuals. what I noticed is only expenses catogory values have changed and this effecting QTD and YTD. Revenue and other accounts are good for March month.
Regards,
I have retrieved tm1 data at consolidated one on 04/05 and other on 06/11 for actuals. what I noticed is only expenses catogory values have changed and this effecting QTD and YTD. Revenue and other accounts are good for March month.
Regards,
- Martin Ryan
- Site Admin
- Posts: 1989
- Joined: Sat May 10, 2008 9:08 am
- OLAP Product: TM1
- Version: 10.1
- Excel Version: 2010
- Location: Wellington, New Zealand
- Contact:
Re: Data change in tm1
You didn't mention whether you'd consulted the transaction logs?
Another reason numbers can move is because consolidations have changed. From time to time I've found numbers change quite drastically and found I've accidentally created a consolidation that double counts numbers.
Unfortunately, tracing moving numbers can be very difficult in TM1. It's one of the reasons I take daily backups of TM1 because even if you know that the numbers have moved at a high level, it's very hard to find out why if all you've got is a few summary reports that have changed.
Could you try re-phrasing that? I for one am still confused as to how you know the numbers have moved.ravi wrote:I have retrieved tm1 data at consolidated one on 04/05 and other on 06/11 for actuals. what I noticed is only expenses catogory values have changed and this effecting QTD and YTD. Revenue and other accounts are good for March month.
Another reason numbers can move is because consolidations have changed. From time to time I've found numbers change quite drastically and found I've accidentally created a consolidation that double counts numbers.
Unfortunately, tracing moving numbers can be very difficult in TM1. It's one of the reasons I take daily backups of TM1 because even if you know that the numbers have moved at a high level, it's very hard to find out why if all you've got is a few summary reports that have changed.
Please do not send technical questions via private message or email. Post them in the forum where you'll probably get a faster reply, and everyone can benefit from the answers.
Jodi Ryan Family Lawyer
Jodi Ryan Family Lawyer
-
- Posts: 138
- Joined: Mon Apr 26, 2010 12:39 pm
- OLAP Product: cognos
- Version: tm1 9.5
- Excel Version: 2007
Re: Data change in tm1
Hi Martin,
Unfortunately, transaction log file are not saved for previous months.
also backup tm1 data files.
I did not try re-phrasing.will check on this.
on consolidations - I have checked number look good- will revalidate it.
Thanks
Unfortunately, transaction log file are not saved for previous months.
also backup tm1 data files.
I did not try re-phrasing.will check on this.
on consolidations - I have checked number look good- will revalidate it.
Thanks
-
- MVP
- Posts: 1828
- Joined: Mon Dec 05, 2011 11:51 am
- OLAP Product: Cognos TM1
- Version: PA2.0 and most of the old ones
- Excel Version: All of em
- Location: Manchester, United Kingdom
- Contact:
Re: Data change in tm1
Without a transaction log or noticing a blatant error in the development (such as a TI changing cell values where it shouldn't or an incorrect consolidation) it is very difficult to pinpoint the cause of this sort of issue.
However since it is actuals that you are dealing with, it shouldn't be hard to repopulate them anyway and then check them to your source system as you would any other time.
Then go through and make sure that absolutely NO ONE (with the exception of Admins of course) have access to adjust historic values. After this go through each of your TIs line by line and make sure that none of them can overwrites these values when they shouldn't.
This doesn't get to the the bottom of why you had the issue in the first place but as long as you check all bases and make sure that only Admins could make a change to the values in the future, you then mitigate against the risk for the future and if it does happen again you know exactly which bunch of users to blame!
However since it is actuals that you are dealing with, it shouldn't be hard to repopulate them anyway and then check them to your source system as you would any other time.
Then go through and make sure that absolutely NO ONE (with the exception of Admins of course) have access to adjust historic values. After this go through each of your TIs line by line and make sure that none of them can overwrites these values when they shouldn't.
This doesn't get to the the bottom of why you had the issue in the first place but as long as you check all bases and make sure that only Admins could make a change to the values in the future, you then mitigate against the risk for the future and if it does happen again you know exactly which bunch of users to blame!
Declan Rodger
-
- Posts: 138
- Joined: Mon Apr 26, 2010 12:39 pm
- OLAP Product: cognos
- Version: tm1 9.5
- Excel Version: 2007
Re: Data change in tm1
thanks declanr.
Actually we do period lock for DB after the every monthend close.
And repopulating actual data for previous may cause concern for tm1 model stability and data accuracy in tm1 model(users).
I am currently reading TIs line by line.....
Regards,
Ravi
Actually we do period lock for DB after the every monthend close.
And repopulating actual data for previous may cause concern for tm1 model stability and data accuracy in tm1 model(users).
I am currently reading TIs line by line.....
Regards,
Ravi
-
- MVP
- Posts: 2836
- Joined: Tue Feb 16, 2010 2:39 pm
- OLAP Product: TM1, Palo
- Version: Beginning of time thru 10.2
- Excel Version: 2003-2007-2010-2013
- Location: Atlanta, GA
- Contact:
Re: Data change in tm1
You don't save transaction logs OR have backups of your TM1 objects AND you know there would be problems restoring some of the older data??????? I hate to say this but you've just been bitten by your own laziness. There is a reason best practice for ANY system calls for regular backups. Perhaps you'll learn your lesson though I hate that it's going to be such a painful one.
-
- Posts: 138
- Joined: Mon Apr 26, 2010 12:39 pm
- OLAP Product: cognos
- Version: tm1 9.5
- Excel Version: 2007
Re: Data change in tm1
Hi tomok,
I take your words.
The best practice of taking tm1 data folder backups are not followed.
We also did not check the previous backups availabilty in tm1 environment. We had takenup this responsiblity only from this monthend to support tm1 issues.
any other root/direction out of your experience, as to how to handle this issue further..........
Thanks
I take your words.
The best practice of taking tm1 data folder backups are not followed.
We also did not check the previous backups availabilty in tm1 environment. We had takenup this responsiblity only from this monthend to support tm1 issues.
any other root/direction out of your experience, as to how to handle this issue further..........
Thanks
- vinnusea
- Posts: 116
- Joined: Thu Sep 23, 2010 6:12 pm
- OLAP Product: TM1
- Version: 10.2
- Excel Version: 2010
- Location: San Diego ,CA
Re: Data change in tm1
One more point to check is METADATA.
Moving of Metadata could cause this issue too... Means you have your numbers in place and nothing got changed at transaction level but what if your consolidation elements gets moved?
Example :
If your numbers at product hierarchy got changed at higher level when compared to march report... Metadata of Product dimension got changed..If Product consolidation of ABC product Family in march have 20 SKU's but now this month the product hierarchy changed and removed 10 SKU's from ABC hierarchy and placed in DFF hierarchy ...then your numbers associated to those 10 SKU's will also move..right... In this case also it seems your numbers got changed when compared to march report...
Let me know what you think....
Moving of Metadata could cause this issue too... Means you have your numbers in place and nothing got changed at transaction level but what if your consolidation elements gets moved?
Example :
If your numbers at product hierarchy got changed at higher level when compared to march report... Metadata of Product dimension got changed..If Product consolidation of ABC product Family in march have 20 SKU's but now this month the product hierarchy changed and removed 10 SKU's from ABC hierarchy and placed in DFF hierarchy ...then your numbers associated to those 10 SKU's will also move..right... In this case also it seems your numbers got changed when compared to march report...
Let me know what you think....
Thanks
Vinnusea
Vinnusea
-
- Regular Participant
- Posts: 424
- Joined: Sat Mar 10, 2012 1:03 pm
- OLAP Product: IBM TM1, Planning Analytics, P
- Version: PAW 2.0.8
- Excel Version: 2019
Re: Data change in tm1
If this is the case as Declan rightly pointed out the first place to go through is your TI code.ThanksOne more point to check is METADATA.
Moving of Metadata could cause this issue too... Means you have your numbers in place and nothing got changed at transaction level but what if your consolidation elements gets moved?
Example :
If your numbers at product hierarchy got changed at higher level when compared to march report... Metadata of Product dimension got changed..If Product consolidation of ABC product Family in march have 20 SKU's but now this month the product hierarchy changed and removed 10 SKU's from ABC hierarchy and placed in DFF hierarchy ...then your numbers associated to those 10 SKU's will also move..right... In this case also it seems your numbers got changed when compared to march report...
Let me know what you think..
"You Never Fail Until You Stop Trying......"
-
- MVP
- Posts: 3230
- Joined: Mon Dec 29, 2008 6:26 pm
- OLAP Product: TM1, Jedox
- Version: PAL 2.1.5
- Excel Version: Microsoft 365
- Location: Brussels, Belgium
- Contact:
Re: Data change in tm1
Or... maybe... the figures you are looking at, are (perhaps in part) the result of rules on 1 or more cubes. And someone changed a rule...
Or the feeder(s) were not appropriate.
Hence, you will need to check quite some things in the absence of a good backup procedure. Good luck !
Or the feeder(s) were not appropriate.
Hence, you will need to check quite some things in the absence of a good backup procedure. Good luck !
Best regards,
Wim Gielis
IBM Champion 2024-2025
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly
Wim Gielis
IBM Champion 2024-2025
Excel Most Valuable Professional, 2011-2014
https://www.wimgielis.com ==> 121 TM1 articles and a lot of custom code
Newest blog article: Deleting elements quickly