[svlug] rsync efficiency on trees with large numbers of files

Jeremy Hunt jh-svlug at frostypenguin.net
Fri Oct 29 11:06:44 PDT 2004


This actually on incredibly large boxes getting their storage over a 
SAN. On a smaller box it's probably not the way to go.

Will Lowe wrote:

>>About 2 years ago I was doing something similar and found that just 
>>increasing the number of rsync processes doing the job it made drastic 
>>improvements. 2 simultaneous processes produced a 2x performance 
>>    
>>
>
>Interesting.  On most small machines I find that a single process is
>entirely IO-bound, and that the way to speed it up is to increase the
>IO bandwidth somehow (more spindles, controllers, faster disks, etc.)
>
>  
>




More information about the svlug mailing list