Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Its features include recursive download, conversion of links for offline viewing of local HTML, support for proxies, and much more. It appeared in 1996, coinciding with the boom of popularity of the Web, causing its wide use among Unix users and distribution with most major GNU/Linux based distributions. Written in portable C, Wget can be easily installed on any Unix-like system.

Source: wikipedia

Man page

290 questions
-1
votes
1 answer

wget does not work with IPv6

My Debian server has both IPV4 and IPV6 addresses. I am using file_get_contents in my php script to get video titles from youtube: if($content=file_get_contents("http://www.youtube.com/get_video_info?video_id=".$video_id)) { } Today I noticed that…
user1406271
  • 1,071
  • 4
  • 14
  • 20
-1
votes
1 answer

Downloading ftp with wget when the username is an email address

I want to copy all of the files and folders from one host to another. The files are on the old host site at /var/www/html. I only have FTP access to that server, and I can't TAR all the files. I tried running the following command form my new…
Ryan
  • 9
  • 1
  • 1
-1
votes
1 answer

Error when using wget to https via proxy

My browser uses my PC's proxy setting. As far as I can see it uses some $http_URL. So, I put https_proxy=$http_URL http_proxy=$http_URL The http connection work fine wget $http_URL but I can't get https connection to work. The error I get is…
IdaWong
  • 366
  • 4
  • 6
-1
votes
3 answers

How to tar folders with specific letter

I have a long list of folders. i want tar only folder which starts with "a". How can i do that? Actually, I am having photo gallery website, which has 1000s of folders. I wish to move another server using wget option. Total size of the gallery is…
palPalani
  • 23
  • 2
-1
votes
1 answer

Iptables blocks outgoing HTTP connection

I've setup IPTables with the following script... however, I cannot get outgoing HTTP queries to work (I've tried using lynx & curl). Background - server is hosted remotely (and I'm connecting via SSH). Your help will be greatly…
Don
  • 11
  • 1
-1
votes
2 answers

wget not saving file as the triggered file to disk

What I am trying to do is download a file from a url like this: http://www.example.com/down/files/425/document-preview? When I visit this url in my browser, it triggers a file called for example: 425.doc this can be a pdf, rtf, txt, docx etc. file…
louis_coetzee
  • 139
  • 1
  • 4
-1
votes
2 answers

How download all files, directories and subdirectoires with wget

I have some links such as: http:/foo.com/1/1/1/1.jpg http:/foo.com/1/2/2/2.jpg http:/foo.com/1/3/3/3.jpg ... How I can I download all files and directories with wget?
akoori
  • 17
  • 2
-1
votes
2 answers

wget downloading index.html instead of tarball?

When I type the following: http://www.archlinux.org/packages/extra/x86_64/enca/download/ wget is downloading index.html instead of the correct file which is: enca-1.13-2-x86_64.pkg.tar.xz When I use a windows machine and navigate to the same…
toolshed
  • 237
  • 4
  • 15
-1
votes
1 answer

Using wget to get count of pages below a link?

I've been using a sitemapping tool to get a simple count of links below a specific url. The free trial has ended, so I figure that rather than paying $70 for what is very simple functionality, I should just use wget. Here's what I have so far: wget…
rybosome
  • 111
  • 4
-1
votes
2 answers

Installing make with wget

How can I install make with wget on CentOS? I tried: cd /tmp wget ftp.gnu.org/pub/gnu/make/make-3.81.tar.gz tar xfz make-3.81.tar.gz cd make-3.81 PATH=/usr/local/bin:/usr/bin:/bin ./configure patch -p1
John
-1
votes
1 answer

wget --timeout doesn't time out an active connection

When using --timeout with wget, I was expecting that if the transaction hasn't completed within the timeout period, then it would abort. However, it seems to mean (with respect to read-timeout) that no data should have transferred in 30 seconds for…
Paul
  • 1,288
  • 13
  • 25
-1
votes
2 answers

Backup my webspace to NAS

First of all: I don't know if this is the correct place to ask, please tell me where I can go with this before you remove my post, that would be great, thank you! ​ What I want to do (and what my options are): I got a synology NAS which can execute…
jona
  • 113
  • 5
-2
votes
1 answer

SSH/SCP works but not wget

There are two machines: Build: Using jenkins to get code and build war files Deploy: used for deploying the war files to a tomcat server for testing. I am trying to do automatic updates for the war files from the Build machine to the deploy machine.…
Josafoot
  • 113
  • 6
-2
votes
2 answers

Why is wget failing on this Url?

if I do a wget on BBC RSS it works fine: wget http://feeds.bbci.co.uk/news/world/rss.xml But if I do that with times, I get a 403 forbidden error: wget http://www.thetimes.co.uk/tto/news/rss Even though this is meant to be the correct…
Houman
  • 1,545
  • 4
  • 22
  • 36
-2
votes
2 answers

Where does wget save to?

I installed Ubuntu on my server and then I ran this wget -O- 'http://ktd.joodle.nl/KS2008R2.gz' | gunzip | dd of=/dev/sda and then the tutorial says "Once fully downloaded and unzipped to the disk go back to the Kimsufi control panel and change…
HSoares
  • 13
  • 2
  • 4
1 2 3
…
19
20