Speed boost on exporting cube into file and importing back to cube

Post Reply
User avatar
macsir
MVP
Posts: 785
Joined: Wed May 30, 2012 6:50 am
OLAP Product: TM1
Version: PAL 2.0.9
Excel Version: Office 365
Contact:

Speed boost on exporting cube into file and importing back to cube

Post by macsir »

Hi all
Just want to share that I have managed to reduce exporting time from 90 minutes down to 20 minutes from a massive rule-based cube. I guess you might know how I did it. Yes, it is runTi, which can max the CPU cores in parallel.

But here is the problem, if you use runTi and executecommand, you lost the control of the process since you don't know when the runTi finishes the export and when to start to import afterwards. The solution is power shell script. You basically wrap everything into the powershell. It has function to monitor all sub-processes it kicks off and then trigger the import process after export. The last piece is to send out e-mail to report that snapshot is done. Nice and Easy! :lol:
In TM1,the answer is always yes though sometimes with a but....
http://tm1sir.blogspot.com.au/
Alan Kirk
Site Admin
Posts: 6667
Joined: Sun May 11, 2008 2:30 am
OLAP Product: TM1
Version: PA2.0.9.18 Classic NO PAW!
Excel Version: 2013 and Office 365
Location: Sydney, Australia
Contact:

Re: Speed boost on exporting cube into file and importing back to cube

Post by Alan Kirk »

Very good and well done... but I think Cubewise kinda aced this problem a while ago with Hustle. Different approach, similar outcome but it requires less scripting.
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
User avatar
macsir
MVP
Posts: 785
Joined: Wed May 30, 2012 6:50 am
OLAP Product: TM1
Version: PAL 2.0.9
Excel Version: Office 365
Contact:

Re: Speed boost on exporting cube into file and importing back to cube

Post by macsir »

Thanks, Alan. I will look into it to see if I can borrow something from there. :D
In TM1,the answer is always yes though sometimes with a but....
http://tm1sir.blogspot.com.au/
Post Reply