wget.rst
author Oleksandr Gavenko <gavenkoa@gmail.com>
Thu, 09 Feb 2012 13:36:09 +0200
changeset 1238 53da16ba1897
parent 503 5248a845f4ac
permissions -rw-r--r--
-Xrunjdwp:transport
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
394
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     1
-*- mode: outline; coding: utf-8 -*-
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     2
503
5248a845f4ac Recursive site download.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 394
diff changeset
     3
* Recursive site download.
5248a845f4ac Recursive site download.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 394
diff changeset
     4
5248a845f4ac Recursive site download.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 394
diff changeset
     5
  $ wget -r -np -nc -e robots=off -p -k TOP-LEVEL-URL
5248a845f4ac Recursive site download.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents: 394
diff changeset
     6
394
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     7
* Get server response header.
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     8
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
     9
  $ wget --server-response http://example.com
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    10
  $ wget -S http://example.com    # short variant
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    11
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    12
* View cookies from site.
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    13
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    14
  $ wget --save-cookies FILE -O -  http://google.com  >/dev/null
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    15
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    16
* Send cookies to site.
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    17
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    18
  $ wget --load-cookies FILE  http://google.com
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    19
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    20
* Send specific header line.
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    21
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    22
  $ wget --header='Accept-Charset: iso-8859-2' --header='Accept-Language: hr' http://fly.srk.fer.hr/
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    23
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    24
* Send POST request.
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    25
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    26
Log in to the server. This can be done only once.
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    27
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    28
  $ wget --save-cookies cookies.txt --post-data 'user=foo&password=bar' http://server.com/auth.php
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    29
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    30
Now grab the page or pages we care about.
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    31
4846d481eb98 About wget.
Oleksandr Gavenko <gavenkoa@gmail.com>
parents:
diff changeset
    32
  $ wget --load-cookies cookies.txt -p http://server.com/interesting/article.php