Dealing with big views

Post Reply
yuval
Posts: 23
Joined: Mon Feb 27, 2012 8:48 am
OLAP Product: TM1
Version: 9.5.1
Excel Version: 2007 sp2

Dealing with big views

Post by yuval »

Hi,

I have a big cube in my model and it takes 3 min to calculate a view for the first time, therfore I'm trying to store stargates views on memory,
I tried to use "viewconstruct" function in the ti but it failed on memory (I get WARN mesaage - OUT OF MEMORY in the message log),
I tried to increase the "MaximumViewSize" in the cfg file, also tried to increase the VMM value but both of them didnt help.
Does anyone knows an efficient way to deal with big views?
I'm using perspectives 9.5.2
Thanks,

Yuval
tomok
MVP
Posts: 2832
Joined: Tue Feb 16, 2010 2:39 pm
OLAP Product: TM1, Palo
Version: Beginning of time thru 10.2
Excel Version: 2003-2007-2010-2013
Location: Atlanta, GA
Contact:

Re: Dealing with big views

Post by tomok »

An "out of memory" message has nothing to do with any of the server settings. It means you don't have enough memory to open that view at the moment in time you are trying to open it. How much RAM do you have in the box? How much is available just before you run the TI to construct the view? You need to either: 1) add more RAM, or 2) reduce the size of the view.
Tom O'Kelley - Manager Finance Systems
American Tower
http://www.onlinecourtreservations.com/
yuval
Posts: 23
Joined: Mon Feb 27, 2012 8:48 am
OLAP Product: TM1
Version: 9.5.1
Excel Version: 2007 sp2

Re: Dealing with big views

Post by yuval »

Hi,

I have 38 giga of ram in my server and the available ram before launching the process is something like 20-25 giga,
when the process is running there is still enough ram available but the cpu reaches 100%, maybe there is a way to split the cpu consumption to several processors (there is 8).
when Im trying to open view manually, it takes time but im able to open it, it weared that buildind a view with process becoming a hard issue.

thanks,
David Usherwood
Site Admin
Posts: 1454
Joined: Wed May 28, 2008 9:09 am

Re: Dealing with big views

Post by David Usherwood »

Calculation is still single threaded I'm afraid - feel free to push IBM to address this.
If you can browse the view (eventually) you should be able to ViewConstruct it. Check all the selections are the same, in particular that you don't have excessive elements in your page dimensions.
I did some tests on a much bigger system some months ago and established that freezing data over to an unruled cube took pretty much the same time, and delivered the same result, as ViewConstruct. Might be worth trying.
Gregor Koch
MVP
Posts: 263
Joined: Fri Jun 27, 2008 12:15 am
OLAP Product: Cognos TM1, CX
Version: 9.0 and up
Excel Version: 2007 and up

Re: Dealing with big views

Post by Gregor Koch »

Maybe try and upgrade to 9.5.2 FP2. As PM49801 apparently (I have not tested this) is fixed there. Could be your issue.
yuval
Posts: 23
Joined: Mon Feb 27, 2012 8:48 am
OLAP Product: TM1
Version: 9.5.1
Excel Version: 2007 sp2

Re: Dealing with big views

Post by yuval »

Hi,

just to inform you the action I choose,
"viewconstruct" in ti consuming lots of memory and therefore cant run on big cube in 9.5.2 version, one of the IBM solution is to update version,
I developed a VB code which connecting to tm1 and openning all users heavy excel files one by one, this action guarantees that all heavy views
saved as stargate views and when the users is trying to open afterwards the excel files it takes a second, it is not optimal solution but it was short and efficient to my customer,
I scheduling this process every night.

Yuval A.

------------------------------------------------------------------------
attached the code:

Private Sub workbook_open()

'canceling the links to other files -remove the messages
ActiveWorkbook.UpdateRemoteReferences = False
Application.AskToUpdateLinks = False
Application.DisplayAlerts = False

'transfer to manual mode
With Application
.Calculation = xlManual
.CalculateBeforeSave = False
End With

'load TM1 add-in if the TM1 menu do not exist
Workbooks.Open ("\\server ip\bin_Client\tm1p.xla")

msg = Run("n_connect", "servername", "user", "password")
If msg <> "" Then
'MsgBox msg
End If



'add timer in order to log in first to tm1 then open the excel files
Dim PauseTime, Start, Finish, TotalTime
PauseTime = 10 ' Set duration.
Start = Timer ' Set start time.
Do While Timer < Start + PauseTime
'DoEvents ' Yield to other processes.
Loop
Finish = Timer ' Set end time.
TotalTime = Finish - Start ' Calculate total time.

'open the excel files
Call OpenFiles

End Sub


in modules:
Sub OpenFiles()
Dim Wb As Workbook, sFile As String

sPath = Range("A2") & "\"
sFile = Dir(sPath & "*.*")
'sFile = Dir(sPath & "*.xlsx")
MasterSheet = "connection_to_tm1.xlsm"
'Loop through all .xlsx-Files in that path
Do While sFile <> ""
Set Wb = Workbooks.Open(sPath & sFile, UpdateLinks:=0)
Windows(MasterSheet).ActivatePrevious

sFile = Dir
Loop

Application.Run "TM1RECALC"

End Sub
Post Reply