Home > Archive > PERL Modules > July 2004 > How to solve memory problems while running a script parsing huge data
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
How to solve memory problems while running a script parsing huge data
|
|
|
| Hi,
I am working on writing a PERL script that reads millions of records into
buffers, parse them and write into Excel Spreadsheets.
I am facing memory problems due to this. Though I issue write statements and
"flush" statements in the middle of the program, my script doesn't actually
do the same till it reaches the end. Till then all the memory used by the
buffers is still in use.
Could anyone suggest how to deal with this issue? It will be great if I can
actually write into the spreadsheet as soon as I issue the write command
instead of saving it till the end; and also if I can flush the memory right
when I issue the command to flush.
Thanks,
David
| |
|
| Xref: kermit comp.lang.perl.modules:45449
I forgot to mention that I am using Write::Excel on a Windows PC.
Thanks
"david" <removethisdavid.petruescu@windspring.com> wrote in message
news:6c661$40f4354d$4503b86a$1546@msgid.meganewsservers.com...
> Hi,
> I am working on writing a PERL script that reads millions of records into
> buffers, parse them and write into Excel Spreadsheets.
>
> I am facing memory problems due to this. Though I issue write statements
and
> "flush" statements in the middle of the program, my script doesn't
actually
> do the same till it reaches the end. Till then all the memory used by the
> buffers is still in use.
>
> Could anyone suggest how to deal with this issue? It will be great if I
can
> actually write into the spreadsheet as soon as I issue the write command
> instead of saving it till the end; and also if I can flush the memory
right
> when I issue the command to flush.
>
> Thanks,
> David
>
>
|
|
|
|
|