Xidel print the original url

Question

I am trying to extract url from a webpage and follow them and I am skipping the 4XX and 5XX.My question is Is it possible to print the URL of the request that is returning 200 using xidel

xidel -s --error-handling=4xx=skip,5xx=skip "URL" -e "PRINT URL"

score 1 · Accepted Answer · answered Dec 02 '22 at 10:36

1

'https://videlibri.sourceforge.net/xidel_readme.txt':

Xidel also defines the following global default variables:

   $raw         Unparsed input text
   $url         Url the input was retrieved from (past redirect)
   $host, $path Respective part of the url
   $json        Parsed JSON input, if it was JSON
   $headers     All HTTP headers, including status code

So, you're looking for -e "$url".

answered Dec 02 '22 at 10:36

Reino

3,203
1
13
21

I tried that, but I am getting this error `Error No value for option extract given (when reading argument: extract)` – Sanchu Varkey Dec 03 '22 at 01:16
Did that work for you? – Sanchu Varkey Dec 03 '22 at 01:25
What's your exact command? – Reino Dec 03 '22 at 22:24
`xidel -s --error-handling=4xx=skip,5xx=skip "https://google.com" -e "$url"` – Sanchu Varkey Dec 04 '22 at 22:39
You're on Linux, aren't you? In that case use single quotes (`-e '$url'`). Double quotes (`-e "$url"`) are for Windows users. Or if you insist, `-e "\$url"` should work as well, but I wouldn't recommend it. – Reino Dec 05 '22 at 00:58
That was it. Double quotes is the problem – Sanchu Varkey Dec 05 '22 at 10:57

Xidel print the original url

1 Answers1