[svlug] can a linux webbrowser make sites avail offline?

[J C Lawrence]

On Tue, 8 Jan 2002 14:12:49 -0800 
Mark S Bilk <Mark> wrote:

> IIRC, webcopy only downloads each page once (probably refraining
> if it's already in the destination tree), whereas wget pulls each
> page again every time it scans a link to it on another page --
> very annoying, and could make owners (and payers) of websites hate
> you, especially if you're doing your websucking via a high-speed
> connection.  Rape and pillage responsibly!

<sigh>

>From the wget manpage:

       -nc
       --no-clobber
           If a file is downloaded more than once in the same
           directory, Wget's behavior depends on a few options,
           including -nc.  In certain cases, the local file will
           be clobbered, or overwritten, upon repeated download.
           In other cases it will be preserved.

           When running Wget without -N, -nc, or -r, downloading
           the same file in the same directory will result in the
           original copy of file being preserved and the second
           copy being named file.1.  If that file is downloaded
           yet again, the third copy will be named file.2, and so
           on.  When -nc is specified, this behavior is sup­
           pressed, and Wget will refuse to download newer copies
           of file.  Therefore, ``"no-clobber"'' is actually a
           misnomer in this mode---it's not clobbering that's
           prevented (as the numeric suffixes were already pre­
           venting clobbering), but rather the multiple version
           saving that's prevented.

           When running Wget with -r, but without -N or -nc, re-
           downloading a file will result in the new copy simply
           overwriting the old.  Adding -nc will prevent this
           behavior, instead causing the original version to be
           preserved and any newer copies on the server to be
           ignored.

           When running Wget with -N, with or without -r, the
           decision as to whether or not to download a newer copy
           of a file depends on the local and remote timestamp
           and size of the file.  -nc may not be specified at the
           same time as -N.

           Note that when -nc is specified, files with the suf­
           fixes .html or (yuck) .htm will be loaded from the
           local disk and parsed as if they had been retrieved
           from the Web.

-- 
J C Lawrence                
---------(*)                Satan, oscillate my metallic sonatas. 
claw at kanga.nu               He lived as a devil, eh?		  
http://www.kanga.nu/~claw/  Evil is a name of a foeman, as I live.