Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Its features include recursive download, conversion of links for offline viewing of local HTML, support for proxies, and much more. It appeared in 1996, coinciding with the boom of popularity of the Web, causing its wide use among Unix users and distribution with most major GNU/Linux based distributions. Written in portable C, Wget can be easily installed on any Unix-like system.

Source: wikipedia

Man page

290 questions
8
votes
2 answers

Transfer a 30GB tar file from one remote server to another - restrained by disk space

I have a 38GB "Moodle" tar file that I need to transfer from the old server (Shared hosting), which we can call "Server A" to the new server (Dedicated virtual), or "Server B". I'm with Mediatemple if that helps. I've already tarballed the directory…
alexbass
  • 83
  • 3
8
votes
1 answer

How do I fix certificate errors when running wget on an HTTPS URL in Cygwin Windows?

I have Cygwin installed in my windows system. I am trying to execute wget command for a website but I am getting the following error message: ERROR: The certificate of `example.com' is not trusted. ERROR: The certificate of `example.com' hasn't got…
Tripz
  • 81
  • 1
  • 1
  • 2
8
votes
3 answers

How to serve a wget --mirror'ed directory of files with questionmarks in them

I'm trying to create a static mirror of a php application (an old php Gallery installation, specifically). The app produces URLs such as: view_album.php?set_albumName=MyAlbum wget downloads these directly to files named the same, complete with…
user67641
  • 1,292
  • 2
  • 14
  • 18
8
votes
3 answers

Alternatives to CURL, WGET

Is anyone aware of any alternatives to curl and wget? The key functional requirement I'm looking for is to be able to execute an HTTPS GET request against a known URL. The reason I'm looking for an alternative is simply that I'm trying to execute a…
Paul Russell
  • 257
  • 1
  • 3
  • 7
8
votes
6 answers

How to download with wget without following links with parameters

I'm trying to download two sites for inclusion on a CD: http://boinc.berkeley.edu/trac/wiki http://www.boinc-wiki.info The problem I'm having is that these are both wikis. So when downloading with e.g.: wget -r -k -np -nv -R jpg,jpeg,gif,png,tif…
Tie-fighter
  • 751
  • 2
  • 9
  • 17
7
votes
5 answers

"Issued certificate not yet valid." with wget?

I am getting the following error when using wget to fetch a file: Issued certificate not yet valid. To connect to www.atlassian.com insecurely, use ‘--no-check-certificate’. Testing with openssl returns a similar message: Verify return code: 9…
AXE Labs
  • 1,549
  • 5
  • 19
  • 24
7
votes
1 answer

Can wget convert links within a local html document?

I know that wget can fetch a remote page and its dependencies and rewrite the html so that image src attributes reference the newly downloaded images. I am trying to convert local html files that reference images on the Internet. I'm using wget…
Kevin L.
  • 203
  • 2
  • 4
6
votes
0 answers

Wrong filename encoding/decoding when downloading recursively with wget

I'm downloading files from a remote directory recursively using wget and whoever created the folders and files, used special characters such as è or Ó, when I download a single specificating the full path+filename, the file is downloaded with it's…
Nagarz
  • 61
  • 1
  • 3
6
votes
1 answer

wget receives the file and hangs

I am trying to beat weird problem - wget gets the file, saves it to disk and hangs. Here is the details: wget --server-response --ca-directory=/etc/ssl/certs --no-dns-cache -T 1 --read-timeout=1 --header="Connection: close"…
user1065145
  • 295
  • 4
  • 9
6
votes
4 answers

wget and pretty urls

In order to automatize stuff, I need to recursively download a web page. I'm using wget as it's probably the most programmer-friendly tool available, using -r flag to trigger link following. wget, hovewer, doesn't handle pretty urls, i.e.…
Mike Hordecki
  • 161
  • 1
  • 4
6
votes
1 answer

wget - specify directory and rename the file

I'm trying to download multiple files and need to rename as I download, how can I do that and specify the directory I want them to download to? I know i need to be using -P and -O to do this but it does not seem to be working for me. I'm writing…
user50221
6
votes
4 answers

Escape a ! in the password parameter of wget

I'm trying to execute something like this: wget --user=foo --password=bar! url The ! in the password is causing problems. I've tried escaping it with \, as in --password=bar\! I've tried encapsulating in single and double quotes. I put the…
Dave
  • 133
  • 1
  • 1
  • 5
5
votes
2 answers

Why does curl work with a specific https site, but wget has problems with certificates?

Centos 6. After updating recently ca-certificates I run into some troubles. I have the most recent versions of curl for centos 6: -bash-4.1$ curl -V -v curl 7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.27.1 zlib/1.2.3 libidn/1.18…
keypress
  • 241
  • 2
  • 8
5
votes
1 answer

How to download a file and preserver original permissions using wget

How can I download a file that has already executable permissions 755 in another server. I want to: wget https://example.com/pub/register.sh --no-check-certificate and preserver permission register.sh 755 right now, if after I execute the above…
user125971
  • 61
  • 1
  • 4
5
votes
2 answers

Using wget to fetch password protected website (trac wiki page)

I want to write a bash script that will notify me about changes on a trac wiki timeline. Unfortunately I can't "login" (it needs cookie for next logins). wget http://someserver.com/trac/xxx/login \ --save-cookies=cookies --keep-session-cookies wget…
Maciek Sawicki
  • 790
  • 1
  • 8
  • 21
1 2
3
…
19 20