[svlug] Best mailer for handling large mail folders

David E. Fox dfox at m206-157.dsl.tsoft.com
Fri Apr 8 19:33:06 PDT 2005


On Fri, 18 Feb 2005 04:48:12 -0800
"Karsten M. Self" <kmself at ix.netcom.com> wrote:


> Right.  I can do that.  'find | xargs' gets exercised a lot, but the
> number of files makes even _that_ pretty slow.

It seems that (even with Reiserfs) large numbers of files don't scale
too well. I wonder if this may change with Reiserfs 4, but it's probably
the much added overhead of stat() calls (for instance) on 85K worth of
files instead of 5K.

Minor data point:

dfox at 20[inbox]$ time ls -l | wc -l
85091

real   0m6.880s
user   0m2.385s
sys 0m0.533s

(that's on my more or less aging Athlon 1000 box.)

Of course, grep uses more overhead. I'm amazed it's as fast as it is,
but having some sort of index system -- a tie to glimpse would be
useful, and even more useful if it were integrated into mail readers
such as sylpheed.)

I was pleased (at least at first) with sylpheed's speed in handling
messages, but then my mail directory has just grown in leaps and bounds
since I first started using it. It is not all due to "archiving" -- mail
gets "archived" here mostly because I haven't got around to reading it,
the side effect of subscribing to a number of high-volume mailing lists,
unfortunately.




-- 
------------------------------------------------------------------------
David E. Fox                              Thanks for letting me
dfox at tsoft.com                            change magnetic patterns
dfox at m206-157.dsl.tsoft.com               on your hard disk.
-----------------------------------------------------------------------




More information about the svlug mailing list