2014-08-27

wget – cheat sheet

-b Go to background immediately after startup. If no output file is specified via the
--background -o, output is redirected to wget-log.
-o logfile / --output-file=logfile Log all messages to logfile. The messages are normally reported to standard error.
-a logfile Append to logfile. This is the same as -o, only it appends to logfile instead of
--append-output=logfile overwriting the old log file. If logfile does not exist, a new file is created.
-q / --quiet Turn off Wget's output.
-nv Turn off verbose without being completely quiet (use -q for that), which means
--no-verbose that error messages and basic information still get printed.
--bind-address=ADDRESS When making client TCP/IP connections, bind to ADDRESS on the local machine.
ADDRESS may be specified as a hostname or IP address. This option can be
useful if your machine is bound to multiple IPs.
-t number Set number of retries to number. Specify 0 or inf for infinite retrying. The default
--tries=number is 20 times, with the exception of fatal errors like "connection refused" or "404".
-O file The documents will not be written to the appropriate files, but all will be
--output-document=file concatenated together and written to file. If - is used as file, documents will be
printed to standard output, disabling link conversion.
-c Continue getting a partially-downloaded file. This is useful when you want to
--continue finish up a download started by a previous instance of Wget, or by another
program. Note that -c only works with servers that support the "Range" header.
--progress=type Select the type of the progress indicator you wish to use. (type = "dot" or "bar")
-S / --server-response Print the headers sent by HTTP servers and responses sent by FTP servers.
--spider When invoked with this option, Wget will behave as a Web spider, which means
that it will not download the pages. Wget sends a HEAD requests instead of GET.
-T seconds Set the network timeout to seconds seconds. This is equivalent to specifying
--timeout=seconds --dns-timeout, --connect-timeout, and --read-timeout, all at the same time.
--limit-rate=amount Limit the download speed to amount bytes per second. Amount may be expressed
in bytes, kilobytes with the k suffix, or megabytes with the m suffix.
-w seconds Wait the specified number of seconds between the retrievals. Use of this option is
--wait=seconds recommended, as it lightens the server load by making the requests less frequent.
--no-proxy Don't use proxies, even if the appropriate *_proxy environment variable is defined.
--user=user Specify the username user and password password for both FTP and HTTP file
--password=password retrieval.(see also: --ftp-user , --ftp-password, –http-user, --http-password.)
--no-http-keep-alive Turn off the "keep-alive" feature for HTTP downloads.
--no-cache Disable server-side cache. In this case, Wget will send the remote server an
appropriate directive (Pragma: no-cache) to get the file from the remote service,
rather than returning the cached version. Caching is allowed by default.
--header=header-line Send header-line along with the rest of the headers in each HTTP request. The
supplied header is sent as-is, which means it must contain name and value
separated by colon, and must not contain newlines. You may define more than one
additional header by specifying --header more than once.
--max-redirect=number Specifies the maximum number of redirections to follow. The default is 20.
--referer=url Include `Referer: url' header in HTTP request.
-U agent-string Identify as agent-string to the HTTP server. Wget normally identifies as
--user-agent=agent-string Wget/version, version being the current version number of Wget.
--post-data=string Use POST as the method for all HTTP requests and send the specified data in the
--post-file=file request body. --post-data sends string as data, whereas --post-file sends the
contents of file.
--no-check-certificate Don't check the server certificate against the available certificate authorities.