Page 1 of 1

Incremental Data Load into a Reporting Cube

Posted: Wed Jul 27, 2011 7:12 pm
by tm1expert
Hi,

I'm trying to come up with an idea of refreshin a Reporting Cube from Input Cubes, and I need to figure out if there is any way to load anly updated cells from Input Cubes. We are planning to upgrade to TM1 9.5.2, and hopefulli this Parallel Interaction will help resolve the locking issue while the TI Process runs.

Currently we have Rep & Sync, but our experience with Rep & Sync is horrible, experiencing crashes and numbers going out of sync every day.

Does anybody have any idea how to incrementally refresh the Reporting Cubes?

Thank you

Re: Incremental Data Load into a Reporting Cube

Posted: Wed Jul 27, 2011 7:36 pm
by qml
How about implementing your own version of synchronisation? One idea is to use TI to scan the transaction log files and make updates based on that. This would only work under the assumption that logging is permanently switched on for all your source cubes. After every SaveDataAll a new log file is created and the old one is renamed with a timestamp and can be accessed and processed like a normal text file that it is.

Re: Incremental Data Load into a Reporting Cube

Posted: Wed Jul 27, 2011 7:59 pm
by tm1expert
Thanks for the quick reply.

I've tried doing that, but our model is big, and because the Current Transaction log file is locked, I have to Run the SaveDataAll at the beggining of TI Process in order to release the Log File. The SaveDataAll takes too long, and it puts a lock in the system.

Thanks
Ardian