[svlug] can a linux webbrowser make sites avail offline?
J C Lawrence
claw at kanga.nu
Tue Jan 8 14:55:02 PST 2002
On Tue, 8 Jan 2002 14:12:49 -0800
Mark S Bilk <Mark> wrote:
> IIRC, webcopy only downloads each page once (probably refraining
> if it's already in the destination tree), whereas wget pulls each
> page again every time it scans a link to it on another page --
> very annoying, and could make owners (and payers) of websites hate
> you, especially if you're doing your websucking via a high-speed
> connection. Rape and pillage responsibly!
>From the wget manpage:
If a file is downloaded more than once in the same
directory, Wget's behavior depends on a few options,
including -nc. In certain cases, the local file will
be clobbered, or overwritten, upon repeated download.
In other cases it will be preserved.
When running Wget without -N, -nc, or -r, downloading
the same file in the same directory will result in the
original copy of file being preserved and the second
copy being named file.1. If that file is downloaded
yet again, the third copy will be named file.2, and so
on. When -nc is specified, this behavior is sup
pressed, and Wget will refuse to download newer copies
of file. Therefore, ``"no-clobber"'' is actually a
misnomer in this mode---it's not clobbering that's
prevented (as the numeric suffixes were already pre
venting clobbering), but rather the multiple version
saving that's prevented.
When running Wget with -r, but without -N or -nc, re-
downloading a file will result in the new copy simply
overwriting the old. Adding -nc will prevent this
behavior, instead causing the original version to be
preserved and any newer copies on the server to be
When running Wget with -N, with or without -r, the
decision as to whether or not to download a newer copy
of a file depends on the local and remote timestamp
and size of the file. -nc may not be specified at the
same time as -N.
Note that when -nc is specified, files with the suf
fixes .html or (yuck) .htm will be loaded from the
local disk and parsed as if they had been retrieved
from the Web.
J C Lawrence
---------(*) Satan, oscillate my metallic sonatas.
claw at kanga.nu He lived as a devil, eh?
http://www.kanga.nu/~claw/ Evil is a name of a foeman, as I live.
More information about the svlug