Home > Archive > PERL Miscellaneous > August 2004 > Re: Performance Improvement of complex data structure (hash of hashes
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
Re: Performance Improvement of complex data structure (hash of hashes
|
|
| Austin P. So (Hae Jin) 2004-08-26, 4:01 pm |
| Scott Gilpin wrote:[color=darkred]
> ctcgag@hotmail.com wrote:
>
[color=darkred]
> I'm
> system
Hmmm...you have 100 million lines of text that you are reading into a
big honking hash, and you say that you *aren't* memory bound? If I'm not
mistaken, UNIX is not technically "memory bound" because it is able to
utilize the hard drive as virtual RAM, but when that spillover happens.
it is more demanding on the CPU and more importantly the speed of your
hard drive. Plus the fact that you are creating a big honking hash that
I think would crash most systems anyway...
Just out of curiosity, do you know the hardware specs of the machine
that you are running this on? Do you also know the "niceness" of your
account that you are using to run this script?
Austin
P.S.
| |
| Anno Siegel 2004-08-26, 4:01 pm |
| Austin P. So (Hae Jin) <who@what.where> wrote in comp.lang.perl.misc:
> Scott Gilpin wrote:
>
>
> Hmmm...you have 100 million lines of text that you are reading into a
> big honking hash, and you say that you *aren't* memory bound? If I'm not
Look closer. The hash summarizes the info, it doesn't grow all that
big.
Anno
|
|
|
|
|