Incremental Data Load into a Reporting Cube

Post Reply
tm1expert
Posts: 27
Joined: Sun Aug 02, 2009 2:57 am
OLAP Product: Cognos TM1/Cognos BI
Version: from 9.4 to PA 2.0.9
Excel Version: 2010
Location: Toronto

Incremental Data Load into a Reporting Cube

Post by tm1expert »

Hi,

I'm trying to come up with an idea of refreshin a Reporting Cube from Input Cubes, and I need to figure out if there is any way to load anly updated cells from Input Cubes. We are planning to upgrade to TM1 9.5.2, and hopefulli this Parallel Interaction will help resolve the locking issue while the TI Process runs.

Currently we have Rep & Sync, but our experience with Rep & Sync is horrible, experiencing crashes and numbers going out of sync every day.

Does anybody have any idea how to incrementally refresh the Reporting Cubes?

Thank you
Ardian Alikaj
User avatar
qml
MVP
Posts: 1098
Joined: Mon Feb 01, 2010 1:01 pm
OLAP Product: TM1 / Planning Analytics
Version: 2.0.9 and all previous
Excel Version: 2007 - 2016
Location: London, UK, Europe

Re: Incremental Data Load into a Reporting Cube

Post by qml »

How about implementing your own version of synchronisation? One idea is to use TI to scan the transaction log files and make updates based on that. This would only work under the assumption that logging is permanently switched on for all your source cubes. After every SaveDataAll a new log file is created and the old one is renamed with a timestamp and can be accessed and processed like a normal text file that it is.
Kamil Arendt
tm1expert
Posts: 27
Joined: Sun Aug 02, 2009 2:57 am
OLAP Product: Cognos TM1/Cognos BI
Version: from 9.4 to PA 2.0.9
Excel Version: 2010
Location: Toronto

Re: Incremental Data Load into a Reporting Cube

Post by tm1expert »

Thanks for the quick reply.

I've tried doing that, but our model is big, and because the Current Transaction log file is locked, I have to Run the SaveDataAll at the beggining of TI Process in order to release the Log File. The SaveDataAll takes too long, and it puts a lock in the system.

Thanks
Ardian
Ardian Alikaj
Post Reply