Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Its features include recursive download, conversion of links for offline viewing of local HTML, support for proxies, and much more. It appeared in 1996, coinciding with the boom of popularity of the Web, causing its wide use among Unix users and distribution with most major GNU/Linux based distributions. Written in portable C, Wget can be easily installed on any Unix-like system.

Source: wikipedia

Man page

290 questions
5
votes
2 answers

How can I get a static download link for a Microsoft MSDN Subscriber Download?

I need to be able to download MSDN ISO files directly from PowerShell. How can I do this? I can view the downloads site at: https://msdn.microsoft.com/subscriptions/securedownloads/ however, these downloads require authentication... I do not know…
Tim
  • 223
  • 1
  • 2
  • 8
5
votes
1 answer

wget - Only save if return code is 200, delete otherwise

I have a script that checks my public ip address every few minutes. The problem is the ISP sometimes gives me cached pages (I know, I've used all the related args in wget, the isp is formed by a bunch of incompetent so-and-sos that apparently made…
Behrooz
  • 163
  • 1
  • 1
  • 9
5
votes
2 answers

Wget, self signed cert and --no-check-certificate not working

I recently installed a self signed SSL cert on one of our nginx webservers. If I attempt to wget a file with --no-check-certificate I receive the errors below. You can reach the site with a browser, the browser will recognize that it is self signed,…
Minelr G
  • 95
  • 1
  • 1
  • 7
5
votes
1 answer

curl and wget attempting an ipv6 connection

On my dedicated server (hosted by OVH), that is running a fresh install of Ubuntu 14.04, curl and wget take approximately 10 seconds to complete a simple request. $ curl -v google.com * Rebuilt URL to: google.com/ * Hostname was NOT found in DNS…
Daniel S
  • 415
  • 2
  • 5
  • 9
5
votes
2 answers

Ubuntu 11.10, using wget/curl fails with ssl

On a completely new install of Ubuntu I'm getting the following errors when using wget: wget https://test.sagepay.com --2012-03-27 12:55:12-- https://test.sagepay.com/ Resolving test.sagepay.com... 195.170.169.8 Connecting to…
Greg Spiers
  • 111
  • 1
  • 1
  • 7
5
votes
5 answers

Multithreaded downloading with shell script

Let's say I have a file with lots of URLs and I want to download them in parallel using arbitrary number of processes. How can I do it with bash?
synapse
  • 499
  • 2
  • 6
  • 14
5
votes
4 answers

using wget through .pac config based proxy server

I want to use wget through a proxy which uses .pac config. When I googled a bit, I found that .pac is a javascript file and wget cannot parse it based on the following…
gsk
  • 153
  • 1
  • 1
  • 4
4
votes
0 answers

How to Enable JavaScript for wget in linux for grabbing a website?

I use wget like this for save site : wget --page-requisites --no-parent --mirror http://example.com/index.html -P /home/ in Some cases It does NOT work, Error is : This site requires Javascript to work, please enable Javascript in your browser or…
AriaData
  • 53
  • 1
  • 1
  • 5
4
votes
5 answers

Fixing wget certificates

Basically, I was testing different versions of OpenSSL, and somewhere in the process broke wget's path to certificates. wget https://www.google.com Results now in: ERROR: cannot verify www.google.com's certificate, issued by 'CN=Google Internet…
Ilya
  • 143
  • 1
  • 1
  • 7
4
votes
1 answer

Cannot get cURL or wget to validate some SSL certificates

I've noticed that our link checker, which uses cURL, fails more and more often to validate SSL certificates. I'm trying to get to the bottom of this. https://www.bgetem.de/, for instance, opens just fine on every browser (IE 11, Firefox, Opera,…
user2323470
  • 183
  • 4
  • 9
4
votes
1 answer

"wget --mirror" Alternative

I'm looking for an alternative to using this, it doesn't have to use FTP, but it should provide the same functionality as the "--mirror" option of wget where it only downloads new and changed files. wget --mirror --preserve-permissions…
joebert
  • 195
  • 7
4
votes
3 answers

How to use "wget" to save a file as a different name

wget "http://flakejfl2ke3jrlwkefj38j2ofiwejfoifjalsdkfje3fklwje.exe" is long. How do I save it as my own name?
Alex
  • 8,471
  • 26
  • 75
  • 99
4
votes
4 answers

How do I reconcile Network Speed from Network Throughput?

I have been arguing with my ISP about the service they are providing; primarily with regard to throughput speeds. I have set up an edge router (see hardware details listed below) and on it I have set up the following test to get speeds periodically…
Lorin S.
  • 95
  • 1
  • 2
  • 10
4
votes
2 answers

FTP file download using Wget

I am using the wget command for download FTP files, when i download the FTP file its showing error "Event not fount". Here i use the password like some below charater ! so its showing this error bash: !@myipaddress: event not found Using wget…
userad
  • 147
  • 1
  • 1
  • 6
4
votes
1 answer

Downloading from wget - folder issue

I have a website - http://myradio1.localhost and the directory is currently empty. The virtual host works fine, no issues there. This is my command I'm using to download the site via wget: wget --user-agent="Googlebot/2.1…
avenas8808
  • 155
  • 8
1 2 3
…
19 20