Page 1 of 1

Feeder file size

Posted: Wed Jun 18, 2014 9:53 am
by deepakjain2020
Hi All,

We are having a feeder file of size 1.11GB.
I know there are few changes to be done in feeders of a cube.

But prior to that I will like to know whether feeders file can even be larger than 1GB?

Regards,
Deepak Jain

Re: Feeder file size

Posted: Wed Jun 18, 2014 9:59 am
by Alan Kirk
deepakjain2020 wrote: We are having a feeder file of size 1.11GB.
I know there are few changes to be done in feeders of a cube.

But prior to that I will like to know whether feeders file can even be larger than 1GB?
Yup, they certainly can. I inherited one that was just shy of 9 gig. I just looked to check that my memory was correct on that, and yes, I see an old copy of it right in front of me.

Needless to say that one quickly became the target of a combination of axe wielding and conditional feeders. Yes, the latter meant that I had to stop multi-threaded loads but the load performance differential was trivial and the system was a lot cleaner and leaner after the feeder file was restored to a vastly more reasonable size.

Re: Feeder file size

Posted: Wed Jun 18, 2014 12:14 pm
by jim wood
Cube size has a big impact on that as well. Even simple feeders can mean a large feeder file in a large cube.