Page 1 of 1

Dealing with big views

Posted: Sun Jul 22, 2012 1:02 pm
by yuval
Hi,

I have a big cube in my model and it takes 3 min to calculate a view for the first time, therfore I'm trying to store stargates views on memory,
I tried to use "viewconstruct" function in the ti but it failed on memory (I get WARN mesaage - OUT OF MEMORY in the message log),
I tried to increase the "MaximumViewSize" in the cfg file, also tried to increase the VMM value but both of them didnt help.
Does anyone knows an efficient way to deal with big views?
I'm using perspectives 9.5.2
Thanks,

Yuval

Re: Dealing with big views

Posted: Sun Jul 22, 2012 3:48 pm
by tomok
An "out of memory" message has nothing to do with any of the server settings. It means you don't have enough memory to open that view at the moment in time you are trying to open it. How much RAM do you have in the box? How much is available just before you run the TI to construct the view? You need to either: 1) add more RAM, or 2) reduce the size of the view.

Re: Dealing with big views

Posted: Sun Jul 22, 2012 8:38 pm
by yuval
Hi,

I have 38 giga of ram in my server and the available ram before launching the process is something like 20-25 giga,
when the process is running there is still enough ram available but the cpu reaches 100%, maybe there is a way to split the cpu consumption to several processors (there is 8).
when Im trying to open view manually, it takes time but im able to open it, it weared that buildind a view with process becoming a hard issue.

thanks,

Re: Dealing with big views

Posted: Sun Jul 22, 2012 9:21 pm
by David Usherwood
Calculation is still single threaded I'm afraid - feel free to push IBM to address this.
If you can browse the view (eventually) you should be able to ViewConstruct it. Check all the selections are the same, in particular that you don't have excessive elements in your page dimensions.
I did some tests on a much bigger system some months ago and established that freezing data over to an unruled cube took pretty much the same time, and delivered the same result, as ViewConstruct. Might be worth trying.

Re: Dealing with big views

Posted: Mon Jul 23, 2012 12:24 am
by Gregor Koch
Maybe try and upgrade to 9.5.2 FP2. As PM49801 apparently (I have not tested this) is fixed there. Could be your issue.

Re: Dealing with big views

Posted: Tue Jul 31, 2012 9:13 am
by yuval
Hi,

just to inform you the action I choose,
"viewconstruct" in ti consuming lots of memory and therefore cant run on big cube in 9.5.2 version, one of the IBM solution is to update version,
I developed a VB code which connecting to tm1 and openning all users heavy excel files one by one, this action guarantees that all heavy views
saved as stargate views and when the users is trying to open afterwards the excel files it takes a second, it is not optimal solution but it was short and efficient to my customer,
I scheduling this process every night.

Yuval A.

------------------------------------------------------------------------
attached the code:

Private Sub workbook_open()

'canceling the links to other files -remove the messages
ActiveWorkbook.UpdateRemoteReferences = False
Application.AskToUpdateLinks = False
Application.DisplayAlerts = False

'transfer to manual mode
With Application
.Calculation = xlManual
.CalculateBeforeSave = False
End With

'load TM1 add-in if the TM1 menu do not exist
Workbooks.Open ("\\server ip\bin_Client\tm1p.xla")

msg = Run("n_connect", "servername", "user", "password")
If msg <> "" Then
'MsgBox msg
End If



'add timer in order to log in first to tm1 then open the excel files
Dim PauseTime, Start, Finish, TotalTime
PauseTime = 10 ' Set duration.
Start = Timer ' Set start time.
Do While Timer < Start + PauseTime
'DoEvents ' Yield to other processes.
Loop
Finish = Timer ' Set end time.
TotalTime = Finish - Start ' Calculate total time.

'open the excel files
Call OpenFiles

End Sub


in modules:
Sub OpenFiles()
Dim Wb As Workbook, sFile As String

sPath = Range("A2") & "\"
sFile = Dir(sPath & "*.*")
'sFile = Dir(sPath & "*.xlsx")
MasterSheet = "connection_to_tm1.xlsm"
'Loop through all .xlsx-Files in that path
Do While sFile <> ""
Set Wb = Workbooks.Open(sPath & sFile, UpdateLinks:=0)
Windows(MasterSheet).ActivatePrevious

sFile = Dir
Loop

Application.Run "TM1RECALC"

End Sub