-1

I am trying to download https://untools.co/ with wget or httrack, but I repeatedly get the error "301 Moved Permanently". I get the main page downloaded, but once I open the index.html with a browser and try to click on some of the links I get redirected to a non-existing file.

I have tried commands like

wget --mirror --domains=untools.co untools.co
wget -np -r -k --convert-links "https://www.untools.co/"
httrack "https://untools.co/" -O "./untools" "+*.untools.co/*" --ext-depth 3

and tried to read a lot of documentation, but must admit I am somewhat lost, being completely new to those tools.

(I am on Linux Kubuntu - not sure if that is relevant.)

Make42
  • 12,236
  • 24
  • 79
  • 155

1 Answers1

1

I run following command

wget --mirror --convert-links https://www.untools.co/

then opened index.html using Firefox and was able to access tools (I checked 3: Eisenhower Matrix, Ishikawa Diagram, Minto Pyramid) without issues. Be warned that wget convert links after all download are done therefore you must not open any file before wget finish running.

Daweo
  • 31,313
  • 3
  • 12
  • 25
  • When I open `index.html` firefox "writes" `file:///` into the address bar and then I get a view of all my files on my computer. I am on Linux Kubuntu - not sure if that is relevant. – Make42 Jun 30 '22 at 07:30
  • @Make42 `file` denotes that you are viewing local file – Daweo Jun 30 '22 at 07:48
  • I mean, when I open the file `index.html` with firefox, the address in the address bar of Firefox is substituted, so that literally `file:///` is left. In other words, Firefox opens up the root folder of my Linux directory tree, instead of the `index.html` file. For half a second the html is displayed, but then the redirection takes place. See https://i.stack.imgur.com/Nrn4K.png – Make42 Jun 30 '22 at 10:48
  • @Make42 what happens if you will use other browser? – Daweo Jun 30 '22 at 10:54
  • exactly the same – Make42 Jun 30 '22 at 10:59
  • @Make42 I do not know how to solve that, as I have not experience with *Kubuntu*, one action I might suggest is opening index.html using text editor and to check if links (href attributes values) were converted, when compared to these seen by inspecting page online. If yes `wget` worked correctly and now you need to find some kubuntu ninja to solve problem with *firefox* rather than `wget`. – Daweo Jun 30 '22 at 11:41
  • It seems you are right: I opened the `index.html` in a virtual machine Windows with Firefox and the file was properly displayed. Since the issue is with all browsers in Linux, it must be something with the OS, not with a particular browser. I have no idea what the issue could be - not even how to phrase a question though. – Make42 Jun 30 '22 at 11:56
  • https://unix.stackexchange.com/a/708325/122989 explains that "the main index.html contains some embedded Javascript that forces a redirect to /." A solution is "to run a local webserver." The post explains the details. – Make42 Jul 13 '22 at 12:10