Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Its features include recursive download, conversion of links for offline viewing of local HTML, support for proxies, and much more. It appeared in 1996, coinciding with the boom of popularity of the Web, causing its wide use among Unix users and distribution with most major GNU/Linux based distributions. Written in portable C, Wget can be easily installed on any Unix-like system.

Source: wikipedia

Man page

290 questions
0
votes
2 answers

What does the -c in wget -c Linux command mean?

I am installing Artifactory on an Ubuntu server, and trying to add JFrog repository key. The command is: wget -c -O- "https://bintray.com/user/downloadSubjectPublicKey?username=jfrog" | sudo apt-key add I am getting an error saying that wget -c:…
Chris Duren
  • 1
  • 1
  • 1
0
votes
1 answer

wget download only certain folders from site

I want to download this site with wget, and to do this I'm using this command: wget.exe --no-clobber --no-parent -r --convert-links --page-requisites -U Mozilla "http://www.s-manuals.com/smd/" That's ok for me, but the linked PDF files are located…
efirvida
  • 121
  • 1
  • 7
0
votes
1 answer

Why can't I get wget to pipe standard output to /dev/null?

When I run this command it works as expected: wget -p https://www.google.com/ After running this command I check the error code with echo $? This returns 0, indicating that last command ran without experiencing any errors. Now I run: wget -p…
Harold Fischer
  • 269
  • 3
  • 8
0
votes
1 answer

Using wget to download GlobColour data from hermes ftp server

I want to download the netCDF products from ftp://ftp.hermes.acri.fr. I used wget in cygwin package for Windows systems. My link address for accessing to the data is ftp://ftp.hermes.acri.fr/691969751 and my username and password are…
mohammad gerami
  • 103
  • 1
0
votes
1 answer

FTP access error in EC2

I have 2 servers with windows and ubuntu running in Amazon EC2. I created the FTP server using plesk in windows and used vsftpd in the ubuntu. I have enabled all TCP ports in both the servers. The vsftpd is running in the passive mode in ubuntu.…
IT researcher
  • 190
  • 2
  • 15
0
votes
0 answers

(mac) Need to automatically backup entire FTP server and create an archive

Is there a way to grab all files from an FTP server using wget (or similar), then create a zip or tar of the downloaded files? I would like to do this with one command or using Automator, and to happen regularly on a schedule. I already have wget -r…
Chace Whitaker
  • 1
0
votes
0 answers

Download WordPress site via wget

We have a unique situation whereby we are going to be hosting a website within a company's private network. They have given me RDC access. However, the remote machine has no internet access, so I am connecting to a server that does using Putty. From…
C Ivemy
  • 101
  • 3
0
votes
1 answer

URL encoding issue with cron and wget

I have a simple bash script: #!/bin/bash wget -q 'http://requestb.in/1fq0r3s1?foo=a%2Bb' -O /dev/null If I run this from the commandline and then inspect at http://requestb.in/1fq0r3s1?inspect I see Query String foo: a+b Which is what I would…
artfulrobot
  • 2,949
  • 13
  • 36
  • 60
0
votes
0 answers

Download file from server using a command line

I have 2 different servers, I put my mp3 files in server1, and I am testing to download them from server2 using the wget tool: wget "http://www.example.com/Path-to-mp3-file" I have 2 results: 1) If I download from server1 (where files are), it…
Emmy
  • 11
  • 1
0
votes
1 answer

wget: how to download a file, whose url params changes dynamically, once only

I got a problem with wget, I need to download an entire site with images and other files linked in main pages, I'm using these options: wget --load-cookies /tmp/cookie.txt -r -l 1 -k -p -nc 'https://www.example.com/mainpage.do' (-l 1 is used for…
Lex
  • 127
  • 1
  • 6
0
votes
3 answers

IPTables: apt-get and wget not working

When resetting IPTables, the apt-get and wget command functions correctly and also downloads what I want. But once I activate this firewall, it isn't functional. Pings still work. I want to allow all outgoing connections. That's why I added…
user333044
0
votes
1 answer

wget blocking subdirectiories

I would like to recursively download a page, but block link like this containing "strony": http://domain.com/rozrywka/strony/2/ my command is wget -r -nd --delete-after -e robots=off -X strony http://domain.com but it's still downloading them.
Marek Zakrzewski
  • 163
  • 1
  • 2
  • 11
0
votes
1 answer

Server to Server file transfer through wget

I have a dedicated server in Germany with 120GB data, since I have bought a new dedicated server in U.S, I would like to transfer all the files to new server through FTP connection, to achieve this I'm able using the following wget command in my new…
iSun
  • 101
0
votes
1 answer

how to force wget to ignore certain redirects

I am trying to wget a list of urls (images) some of them no longer exist and the host redirect to a generic "this image doesn't exist" page, of which I know the url of. I would like to wget the file unless it 302's to this domain, is it possible. I…
Aly
  • 133
  • 8
0
votes
1 answer

Ubuntu SSL connection with TLS connection error

I am using Ubuntu 12.04, installed at VirtualBox (Mac) using vagrant. I am not using any proxy server. In my company network, when I try curl -1vsS https://github.com/FGRibreau/doxx/archive/master.zip I get the following results: * About to…
forestclown
  • 945
  • 4
  • 15
  • 25
1 2 3
…
19 20