Cube logging: what's not a good idea?

Post Reply
image2x
Posts: 125
Joined: Tue Jun 02, 2009 7:05 pm
OLAP Product: TM1, PAX, PAW, SPSS
Version: 2.0.916.10 on RHEL
Excel Version: 2016
Location: Minneapolis, MN

Cube logging: what's not a good idea?

Post by image2x »

Recommendations on what control cubes should not be set for logging?

Thanks,
-- John
Alan Kirk
Site Admin
Posts: 6667
Joined: Sun May 11, 2008 2:30 am
OLAP Product: TM1
Version: PA2.0.9.18 Classic NO PAW!
Excel Version: 2013 and Office 365
Location: Sydney, Australia
Contact:

Re: Cube logging: what's not a good idea?

Post by Alan Kirk »

image2x wrote:Recommendations on what control cubes should not be set for logging?
Depends on your needs.

The only hard and fast rule IMHO is never, EVER log the four }Stats cubes which are used by Performance Monitor. They will bloat the log file by literally gigabytes if you let them. If you need to keep the data from those cubes, periodically snapshot it to a text file with a TI and ASCIIOutput.

Other than that I'd tend to use the same rule of thumb as I use for data cubes. If I'm repeatedly blowing away data and refreshing it from scratch, I'd have logging turned off. Suppose for example that you have a seriously long Customers dimension and, for whatever reason, you were deleting all of the attributes every night and refreshing them from your CRM system. That could well be a candidate for having logging turned off though even then I'd probably only turn it off for the life of the TI that does the updating. At least that way you can still see if someone is stuffing around with the attributes manually during the day.

I haven't looked at the newer control cubes in 9.4+ in any great detail yet so there may be some others that I've yet to discover, but in general I don't see any reason to turn logging off for most control cubes; in most models they probably don't change often enough to cause log file bloat, and the logging helps identify any security gaps that you may have with regard to access to the cubes.
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
image2x
Posts: 125
Joined: Tue Jun 02, 2009 7:05 pm
OLAP Product: TM1, PAX, PAW, SPSS
Version: 2.0.916.10 on RHEL
Excel Version: 2016
Location: Minneapolis, MN

Re: Cube logging: what's not a good idea?

Post by image2x »

Thanks Alan. That seems like reasonable advice.
User avatar
jim wood
Site Admin
Posts: 3961
Joined: Wed May 14, 2008 1:51 pm
OLAP Product: TM1
Version: PA 2.0.7
Excel Version: Office 365
Location: 37 East 18th Street New York
Contact:

Re: Cube logging: what's not a good idea?

Post by jim wood »

An add on to Alan's point. Putting logging on the stats cube also increases the chances of a crash. As you may have seen from my post a write failure to the log files causes the software to go down. You may also want to consider this for your busiest cubes,

Jim.
Struggling through the quagmire of life to reach the other side of who knows where.
Go Build a PC
Jimbo PC Builds on YouTube
OS: Mac OS 11 PA Version: 2.0.7
Martin Erlmoser
Community Contributor
Posts: 125
Joined: Wed May 28, 2008 1:22 pm
OLAP Product: TM1, Cognos Express,..
Version: 9.1.4 FP1
Excel Version: 2010
Location: Vienna
Contact:

Re: Cube logging: what's not a good idea?

Post by Martin Erlmoser »

everything but stats cubes and cubes which contain temp data
Kyro
Community Contributor
Posts: 126
Joined: Tue Nov 03, 2009 7:46 pm
OLAP Product: MODLR - The CPM Cloud
Version: Always the latest.
Excel Version: 365
Location: Sydney, Australia
Contact:

Re: Cube logging: what's not a good idea?

Post by Kyro »

I reccomend a simple rule.
"Try use cube logging only to capture user input, because thats all you'd ever want to restore."

Anything else data wise is typically TI (which can be reloaded) or rules (Which dont 'dissapear' anyway).
belair22
Posts: 68
Joined: Wed Feb 25, 2009 2:26 am
OLAP Product: TM1, Cognos Express
Version: 9.5 9.4 9.1 9.0 8.4
Excel Version: 2007 2003

Re: Cube logging: what's not a good idea?

Post by belair22 »

Kyro wrote:I reccomend a simple rule.
"Try use cube logging only to capture user input, because thats all you'd ever want to restore."

Anything else data wise is typically TI (which can be reloaded) or rules (Which dont 'dissapear' anyway).

Assume you mean LOGGING ON as default and then you logging switch LOGGING OFF during TI data loads?

Personally I'm not a fan of toggling LOGGING OFF during TI's - there's always a small chance a TI might bomb out part way through or a user may tip over the server - potential for that LOGGING to remain OFF and you may be none the wiser.
Kyro
Community Contributor
Posts: 126
Joined: Tue Nov 03, 2009 7:46 pm
OLAP Product: MODLR - The CPM Cloud
Version: Always the latest.
Excel Version: 365
Location: Sydney, Australia
Contact:

Re: Cube logging: what's not a good idea?

Post by Kyro »

As always it depends on the implementation. I've had allocation processes that take three days to run go to 3 hours just by disabling logging.
Alan Kirk
Site Admin
Posts: 6667
Joined: Sun May 11, 2008 2:30 am
OLAP Product: TM1
Version: PA2.0.9.18 Classic NO PAW!
Excel Version: 2013 and Office 365
Location: Sydney, Australia
Contact:

Re: Cube logging: what's not a good idea?

Post by Alan Kirk »

belair22 wrote:
Kyro wrote:I reccomend a simple rule.
"Try use cube logging only to capture user input, because thats all you'd ever want to restore."

Anything else data wise is typically TI (which can be reloaded) or rules (Which dont 'dissapear' anyway).
Assume you mean LOGGING ON as default and then you logging switch LOGGING OFF during TI data loads?

Personally I'm not a fan of toggling LOGGING OFF during TI's - there's always a small chance a TI might bomb out part way through or a user may tip over the server - potential for that LOGGING to remain OFF and you may be none the wiser.
If you're refreshing a GL cube from the GL system every 15 minutes you could end up with some pretty grotesque log file sizes, especially when all it takes to fix the crashed out chore is to run it again.

But I do take your point; the way we get around that is by always having a process at the end of our chores which (as the first thing it does in the Prolog tab) switches logging back on for all data cubes that were affected by any earlier processes of the chore. Though I grant you that it's still wise (and necessary, in the absence of "On Event" TIs) to check the logging status of the cubes manually after a crash. (Or write a chore/process to set the logging and run it manually after each crash.)
"To them, equipment failure is terrifying. To me, it’s 'Tuesday.' "
-----------
Before posting, please check the documentation, the FAQ, the Search function and FOR THE LOVE OF GLUB the Request Guidelines.
User avatar
mattgoff
MVP
Posts: 518
Joined: Fri May 16, 2008 1:37 pm
OLAP Product: TM1
Version: 10.2.2.6
Excel Version: O365
Location: Florida, USA

Re: Cube logging: what's not a good idea?

Post by mattgoff »

In you replicate :evil: you also need to have logging on for all replicated cubes. We refresh from the GL every hour, so unfortunately for us that means a lot of logging....

Matt
Please read and follow the Request for Assistance Guidelines. It helps us answer your question and saves everyone a lot of time.
Post Reply