TM1 Chore restarts multiple times over when if finishes / part finishes

Post Reply
7Zark7
Posts: 81
Joined: Tue May 31, 2011 6:29 am
OLAP Product: TM1 and EV
Version: 9.1 SP3
Excel Version: Excel 2010

TM1 Chore restarts multiple times over when if finishes / part finishes

Post by 7Zark7 »

Hi All,

We have encountered an issue where our a Single TM1 chore runs then finishes / part finishes and then restarts automatically.

Before I raise a PMR with IBM, Has anyone seen this behavior before? And does anyone know how to resolve the issue? Chore has been running fine for last year or so and for what ever reason the chore just keeps looping over and over.

Cheers

Zark
User avatar
Alan Kirk
Site Admin
Posts: 6606
Joined: Sun May 11, 2008 2:30 am
OLAP Product: TM1
Version: PA2.0.9.18 Classic NO PAW!
Excel Version: 2013 and Office 365
Location: Sydney, Australia
Contact:

Re: TM1 Chore restarts multiple times over when if finishes / part finishes

Post by Alan Kirk »

7Zark7 wrote: We have encountered an issue where our a Single TM1 chore runs then finishes / part finishes and then restarts automatically.

Before I raise a PMR with IBM, Has anyone seen this behavior before? And does anyone know how to resolve the issue? Chore has been running fine for last year or so and for what ever reason the chore just keeps looping over and over.
You're showing version 9.1 SP3 in your profile; is that still correct or have you just forgotten to update it?

The reason I mention it is twofold:
(a) First, a PMR won't get you anywhere if you are because support for anything before 10.1 is now extinct; and
(b) The locking model in ye olde versions was more primitive, and if you are still on that version you could be having a rollback situation. (Search the Operations Guide for the term "rollback" for more details.)
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
ByronB
Posts: 17
Joined: Tue Mar 01, 2016 5:55 am
OLAP Product: TM1 + BI
Version: TM1 10.2
Excel Version: Excel 2010

Re: TM1 Chore restarts multiple times over when if finishes / part finishes

Post by ByronB »

Hi,

Could you check if your TI are calling the "Securityrefresh;" function ?

The SecurityRefresh can block the operation and that can cause rollback if it can't acquire the block.

I've seen this behavior twice, a TI was looping several times because there was a SecurityRefresh in the epilogue

Removing the SecurityRefresh; from the TI and putting the SecurityREfresh in a separate TI fixed this issue

Cheers,
7Zark7
Posts: 81
Joined: Tue May 31, 2011 6:29 am
OLAP Product: TM1 and EV
Version: 9.1 SP3
Excel Version: Excel 2010

Re: TM1 Chore restarts multiple times over when if finishes / part finishes

Post by 7Zark7 »

Hi Guys,

On the latest version well not the latest but on 10.2.2. This could be it:

"a TI was looping several times because there was a SecurityRefresh in the epilogue
Removing the SecurityRefresh; from the TI and putting the SecurityREfresh in a separate TI fixed this issue"

We recently added a new process, that has this very function. I will test this out and report back my results! I am hoping this is it. I have never every come across this. Why on earth would something like that create a loop effect?

ByronB, did IBM offer an explanation as to why this would happen??

Cheers

Zark
User avatar
qml
MVP
Posts: 1094
Joined: Mon Feb 01, 2010 1:01 pm
OLAP Product: TM1 / Planning Analytics
Version: 2.0.9 and all previous
Excel Version: 2007 - 2016
Location: London, UK, Europe

Re: TM1 Chore restarts multiple times over when if finishes / part finishes

Post by qml »

7Zark7 wrote:I have never every come across this. Why on earth would something like that create a loop effect?
SecurityRefresh is one of those functions that need to obtain exclusive locks on quite a large number of objects. If other threads (user queries other TIs) are holding these locks then we have lock contention. The TM1 server in most cases attempts to resolve such contentions by doing a rollback and a restart of one or more of the clashing threads in order to release all the locks already held so that other threads requesting them have a chance to grab them and finish. This is not a perfect mechanism (in fact it has quite a low IQ) and sometimes multiple rollbacks of the same TI process can happen, even ad infinitum. SecurityRefresh is definitely one of the things that have the biggest potential to cause such process thrashing, but there others too.

Many people claim that feeders are the most difficult aspect of TM1 development. I would say the server's locking model is much, much harder to master and at least as important as feeders. The more complex your application is, the more users and jobs it has, the more important it becomes to understand locking and design the model around it.
Kamil Arendt
7Zark7
Posts: 81
Joined: Tue May 31, 2011 6:29 am
OLAP Product: TM1 and EV
Version: 9.1 SP3
Excel Version: Excel 2010

Re: TM1 Chore restarts multiple times over when if finishes / part finishes

Post by 7Zark7 »

Hi All,

I can confirm from my testing that "SecurityRefresh in the epilogue" in one of my processes batched up within a chore is per what qlm has kindly put together
is performing a rollback and restart of chore over and over again. Instead of writing it into the epilogue directly I have used EXECUTEPROCESS and call the process instead which has fixed the issue.

Thanks to ByronB for providing the initial solution.

Cheers

Zark
7Zark7
Posts: 81
Joined: Tue May 31, 2011 6:29 am
OLAP Product: TM1 and EV
Version: 9.1 SP3
Excel Version: Excel 2010

Re: TM1 Chore restarts multiple times over when if finishes / part finishes

Post by 7Zark7 »

Morning All,

It appears that using EXECUTEPROCESS to call the process instead is not working and the rollback occurs. Therefore securityRefresh should be setup in a separate TI process following after the initial one per ByronB initial suggestion. I will have to test run this further. Hopefully this provides the fix.

Cheers

Zark
EvgenyT
Community Contributor
Posts: 324
Joined: Mon Jul 02, 2012 9:39 pm
OLAP Product: TM1
Version: PAL 2.0.8
Excel Version: 2016
Location: Sydney, Australia

Re: TM1 Chore restarts multiple times over when if finishes / part finishes

Post by EvgenyT »

Hi All,

We have encountered an issue where our a Single TM1 chore runs then finishes / part finishes and then restarts automatically.

Before I raise a PMR with IBM, Has anyone seen this behavior before? And does anyone know how to resolve the issue? Chore has been running fine for last year or so and for what ever reason the chore just keeps looping over and over.
Hi Zak,

From many experiences, functions like SaveDataAll / SecurityRefresh should always be in a separate process when executed, as part of the chore.
Lock will not be fully released until TI commits its changes in Epilog, hence why using ExecuteProcess is causing you a headache as well.

Have a look at Lock Contention Management document (IBM), which explains a lot about TM1 lock model and how to deal with this sort of issues.

Many Thanks

ET
Post Reply