Download a whole site (mirroring) with wget

Pretty neat trick:

Downloading an Entire Web Site with wget
Sep 05, 2008 By Dashamir Hoxha


If you ever need to download an entire Web site, perhaps for off-line viewing, wget can do the
job—for example:

$ wget \
     --recursive \
     --no-clobber \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --domains \
     --no-parent \

This command downloads the Web site

The options are:

–recursive: download the entire Web site.

–domains don't follow links outside

–no-parent: don't follow links outside the directory tutorials/html/.

–page-requisites: get all the elements that compose the page (images, CSS and so on).

–html-extension: save files with the .html extension.

–convert-links: convert links so that they work locally, off-line.

–restrict-file-names=windows: modify filenames so that they will work in Windows as well.

–no-clobber: don't overwrite any existing files (used in case the download is interrupted and

Some times we will have to add

-e robots=off