Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [wget]

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

GNU Wget (or just Wget, formerly Geturl) is a computer program that retrieves content from web servers, and is part of the GNU Project. Its name is derived from World Wide Web and get. It supports downloading via HTTP, HTTPS, and FTP protocols.

Its features include recursive download, conversion of links for offline viewing of local HTML, support for proxies, and much more. It appeared in 1996, coinciding with the boom of popularity of the Web, causing its wide use among Unix users and distribution with most major GNU/Linux based distributions. Written in portable C, Wget can be easily installed on any Unix-like system.

Source: wikipedia

Man page

290 questions
0
votes
0 answers

wget/FTP downloading issue

I am using the command wget -r ftp://xyz/../ to download a directory on my wsl. It is a huge directory, so it takes hours to finish. My internet got disabled for a little bit, and the process terminated. I want to continue my download or restart…
Archit Gupta
  • 1
  • 1
0
votes
0 answers

wget doesn't accept HTTPS certificate (from letsencrypt) on some computers but does on others

I have the following situation: On my www server (Apache2, Debian armhf) I have HTTPS certificate from letsencrypt.org by certbot. When accessing the server from a browser (Firefox, Chromium) everything was fine, but when I tried git or wget then…
bicyclesonthemoon
  • 1
  • 2
0
votes
2 answers

apache remove wget for better security

Im no expert at IT or apache but I have used linux for years. Ive done my best to harden/secure my server online which I use for a mobile app which needs to serve up its content etc. Ive noticed some attempts at hacking my Apache 2.4.57 server…
Tim
  • 203
  • 1
  • 9
0
votes
0 answers

assign result and status code from wget to variables

Can I get the response and status code and assign them to variables? # wget https://www.google.com --quiet --server-response 1> >(body=$( >(grep HTTP | awk '{print $2}' | statusCode=$(
Richard Barraclough
  • 101
  • 6
0
votes
1 answer

wget cannot find trusted certificate

On my RedHat 8 system, wget fails with error below: wget -v https://10.81.72.97/repo/packages/installer-5.1-1.x86_64.rpm --2022-12-05 19:40:00-- https://10.81.72.97/repo/packages/installer-5.1-1.x86_64.rpm Connecting to 10.81.72.97:443...…
Amol
  • 101
  • 2
0
votes
2 answers

Cronjob to visit each url of a list but not save them

I have a txt file list.txt that have bunch of urls, one every line. I want to set a cron job that wget/curl each url of the file once a day but does not save them in the computer. I tried to run this on the terminal first. wget -i /root/list.txt -O…
Sahriar Saikat
  • 101
  • 3
0
votes
2 answers

Trying to mirror my website with wget, but nofollow attribute is found , and I cannot download anything more than index.html

I am running a wordpress site on a Ubuntu 20.04 based LEMP server. I have the pagespeed plugin enabled, and in order to force it to cache my website, I am using wget from a different box to mirror the site. However, when using wget from a 2nd box,…
DanRan
  • 73
  • 1
  • 3
  • 22
0
votes
1 answer

Move files from a remote ftp server to a local

I need to pull files from an ftp server regularly and have found that I can get the files easily enough using wget wget -m --user=yyy --password=xxxx ftps://host.com.au and that works really nicely. The problem is, it obviously leaves the files…
Peter Nunn
  • 452
  • 1
  • 11
  • 25
0
votes
1 answer

wget is not able to get the correct ssl certifiicate expiration date

When I execute this wget -O /root/installer.php https://www.grscripts.com/install/installer.deluxe I receive this error ERROR: cannot verify https://www.grscripts.com's/ certificate, issued by ‘/C=US/O=Let's Encrypt/CN=R3’: Issued certificate…
gr68
  • 113
  • 2
  • 7
0
votes
0 answers

wget: Edit broken links while crawling before visiting them

Situation: I want to mirror an old website. This website is on https://example.com/website/. The website uses absolute links to http://www.example.com/website/. Problem: For whatever reason, wget cannot reach https://www.example.com (the www.…
user136036
  • 141
  • 4
0
votes
2 answers

Downloading a file using Windows CMD line with curl/wget

I have a client [Windows 10 VM] and a server [say a linux based VM]. I have Apache running on the Linux Server. I have a file on the linux server that I want to download on my windows client. I want to do it in 2 ways from the windows CMD: -Using…
Software Fan
  • 101
  • 1
  • 2
0
votes
1 answer

ICS Calendar File Does not Exist

I'm trying to load this calendar: https://bushnellbeacons.com/calendar.ics to another internal websystem. The calendar feed is fine - I can click the link above and download the feed. The problem is that other site gives a generic error "Feed could…
SteadH
  • 666
  • 3
  • 16
  • 33
0
votes
1 answer

wget does not recurse when piping the output to stdout

I want to download webpages recursively and pipe the output to a filter. I am using: wget -qm -O- http://mywebsite.com/initialpath.php | ./filter But wget stops downloading after the first page and waits for input instead of parsing the webpage and…
chqrlie
  • 111
  • 4
0
votes
1 answer

How can I tell if wget can support LetsEncrypt's new ISRG Root X1 certificate after DST Root CA X3 Expiration

A few weeks ago (Sept 2021), LetsEncrypt changed how their certificates were signed, which can affect some older programmes and clients. I have a standard Apache webserver (stock v2.4.41 from ubuntu 20.04 apt) with several letsencrypt certs. Some…
Amandasaurus
  • 31,471
  • 65
  • 192
  • 253
0
votes
1 answer

PXE boot pmagic with wget or TFTP after kernel

I wish to boot parted magic by PXE. I have read this article on the topic: https://partedmagic.com/pxe/ where it states that you can either load the entire iso, prepare the squashfs file and load it as ramdisk or you can load a kernel and then…
FalcoGer
  • 136
  • 7
1 2 3
…
19 20