Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Its features include recursive download, conversion of links for offline viewing of local HTML, support for proxies, and much more. It appeared in 1996, coinciding with the boom of popularity of the Web, causing its wide use among Unix users and distribution with most major GNU/Linux based distributions. Written in portable C, Wget can be easily installed on any Unix-like system.

Source: wikipedia

Man page

290 questions
0
votes
3 answers

WGET Localhost 0 bytes

Hi I am trying to execute wget locally using cron, I have been told by my hosting that due to a local loopback that this won't work? I am attempting the following command: wget -q -O /pathtofile/blah.xml "http://myurl/myfeed.php?id=26" What I am…
simon
0
votes
1 answer

Downloading a file over HTTP while it is being downloaded on the server

I have a download going on on a internal network over HTTP (only available protocol) using wget. The content of interest is NOT reachable from the WWW. The file is being downloaded to a public http accessible directory on a server that IS reachable…
Tom
  • 123
  • 6
0
votes
1 answer

“wget ca-directory=/etc/ssl/certs” failing on Ubuntu 14.04

Ubuntu 14.04's default wget cannot handle SSL. How can I fix this? I do not want to use --no-certificate-check. The certificate I want to authenticate is authenticated against the Root CA from Thawte.
user54883
0
votes
1 answer

Why does my cron job sometimes fail on wget: unable to resolve host address

My cron job runinng properly .But sometimes it get fail with following error message" failed: No address associated with hostname. wget: unable to resolve host address "
GkDreamz
  • 13
  • 3
0
votes
1 answer

User WinWget to keep web site alive in a Windows Server 2003

I have a site that must stay alive due to a service that runs and check a directory for changes. The site is running in IIS at a Windows Server 2003 and the solution I came up it that I will Schedule a task that requests the home page every 5…
0
votes
1 answer

Protect public directories from download via wget and curl

My users upload their profile images and I save them in a public folder. The file names are not predictable (they are based on md5 hash of user id with salt). When someone views the user's profile, I embed a link to the user's image. I'm worried…
DatsunBing
  • 459
  • 4
  • 8
  • 17
0
votes
1 answer

Unable to get cron to append output from wget

I have a cronjob setup and running, but the logfile keeps getting overwritten every time it runs. I would like for the wget output to be appended each time the cron runs. Why is this and how do I fix it? 0 0 * * * wget url/script.php -O - >>…
doremi
  • 231
  • 3
  • 11
0
votes
2 answers

Can't download from a https address using wget

I'm trying to download some videos from DefCon archive using wget but i'm getting this: Unable to establish SSL connection. I tried to use wget with --no-check-certificate but got the same result. What is the problem? How can I force wget to…
Ariyan
  • 147
  • 1
  • 3
  • 15
0
votes
1 answer

Perform HTTP request through non-default gateway (CURL? WGET?)

I have two ISPs /two routers on my LAN with Windows boxes. Switching default gateway (per PC) works fine, so I can choose my outgoing traffic from particular PC to be initiated from whichever ISP I want. Is there any way to perform some specific…
rcigx
  • 11
  • 1
  • 1
0
votes
1 answer

Passing password from scheduled task to WGET --proxy-password argument?

I am trying to set up a daily scheduled download of files from an external web-server, using WGET, Windows' task-scheduler and command-scripts. Since WGET will be run on a server from within the company's internal network, it has to first connect…
0
votes
1 answer

How to download images from one server to another

I have a VPS running Centos. I also have a site (say, example.com) hosted on separate, shared hosting. I would like to backup all images in the "images" folder, which consist of the following…
Honey Badger
  • 829
  • 3
  • 11
  • 15
0
votes
4 answers

wget ftp an entire site is very slow

I'm trying to wget an entire site to transfer from Server A to Server B. It works, but incredibly slowly. I tested this by uploading a 100mb psd file to my server, and grabbing it with wget ftp. Transfer speeds were 26.76mb/sec. But when I try and…
David
  • 103
  • 5
0
votes
1 answer

cannot wget wordpress.org

I am not able to wget wordpress.org from server 63.143.51.2. I am able to wget other sites like google.com Error I am getting is as follows : [~]# wget wordpress.org --2013-04-12 01:42:17-- http://wordpress.org/ Resolving wordpress.org...…
Uday Gade
  • 1
  • 1
0
votes
1 answer

ldirectord NAT load balancing does not work with negotiate checks

I am using ldirectord for loadbalancing two HTTP servers. On the load balancer box i have the following network configuration: eth0 is used for internal purposes and does not take part in load balancing at all. On eth1 I have configured the public…
0
votes
4 answers

Why can't I wget specific cacti graph images?

I'm trying to wget a specific cacti graph image in order to make a daily report. We have htpasswd for the cacti website, and I've added a user for that. I'm usign wget's --http-user/password to pass it. That's working because without it, I get 403…
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253