wget and recursion
The wget
program can also be used to download the contents of an entire website by using the recursive (-r
) option.
For an example look at the following screenshot:
The no verbose (-nv
) option was used to limit the output. After the wget
command completed the more command was used to view the contents of the log. Depending on the number of files the output might be very long.
When using wget
you may run into unexpected issues. It may not get any files, or it may get some but not all of them. It might even fail without any reasonable error message. If this happens check the man
page (man wget
) very carefully. There may be an option that can help get you through the problem. In particular look at the following.
Run wget --version
on your system. It will display a detailed listing of the options and features and also how wget
was compiled.
Here is an example taken from my system running CentOS 6.8 64-bit: