Stack Overflow
Stack Overflow

Questions tagged [seleniumwire]

Selenium Wire is a python package that extends the original Python bindings provided by Selenium in order to provide the tests with additional access to the underlying requests that were made by the browser. Use this tag for questions related to the Selenium Wire package.

Selenium Wire package: https://github.com/wkeeling/selenium-wire

89 questions
0
votes
0 answers

Seleniumwire copy or create new request from an existing one

I am intercepting a request and i want to send it many times with different parameters, I know how modify a request but I havent found a way to send the same request more times modifying the value of a parameter. Is it possible using Seleniumwire or…
danielu227
  • 11
  • 1
0
votes
0 answers

Selenium Wire in Firefox, Cache problem? (python)

I just started using selenium for my own scraping, I'm setting up my proxy using Oxylabs but there is some cache that is avoiding the browser to get a new IP for every tab or connection it opens. My proxy url is using rotating-per-connection so it…
ayyman
  • 1
  • 1
0
votes
0 answers

Why deploy selenium wire on ubuntu server the script does not run like on local?

I have deployed a selenium wire script on Ubuntu 20.04.3 server. However when I run the script locally it runs fine and returns the fingerprint value however when deployed in the server it does not return anything but only that driver has been…
jamie
  • 1
  • 2
0
votes
0 answers

Changing IP with Windscribe's Chrome extension makes selenium-wire with undetected_chromedriver to stop tracking requests

First of all I need to track requests, because some sites which I need to process are hiding their real domain by immediately redirecting to fake domain. To accomplish that I've chosen selenium-wire (if there are better options to do that please let…
KacMaz
  • 1
0
votes
1 answer

How to make Selenium-Wire perform an indirect GraphQL AJAX request I expect and need?

Background story: I need to obtain the handles of the tagged Twitter users from an attached Twitter media. There's no current API method to do that unfortunately (see https://twittercommunity.com/t/how-to-get-tags-of-a-media-in-a-tweet/185614 and…
Csaba Toth
  • 10,021
  • 5
  • 75
  • 121
0
votes
1 answer

Catching continuous requests with seleniumwire

I have a website that continuously makes AJAX requests (about 1 per second). I would like seleniumwire to simply keep the browser open and catch all these requests, without having to refresh the page, but I couldn't find a way to do it, i.e. for…
Enrico Detoma
  • 3,159
  • 3
  • 37
  • 53
0
votes
1 answer

selenium.common.exceptions.WebDriverException: Message: unknown error: net::ERR_TUNNEL_CONNECTION_FAILED

I am trying to open a website with a rotating authication proxy and I get this error. I dont understand why this is happening, im very new to coding and been watching alot of videos lmfao, but please help <3 File "B:\test\testchrome.py", line 21,…
kaliz
  • 1
0
votes
0 answers

How to create forwarding proxy-to-proxy with authentication in python

There are plenty of ways to use proxy with selenium and other apps, but most of them don't have proper authenticating method Chrome\Firefox always asks for login\password and doesn't have built-in ways to provide it as argument, Seleniumwire is a…
Old Wizard
  • 11
  • 3
0
votes
2 answers

Building an environment for Lambda development

I've built a web scraper in python using seleniumwire that runs fine on my local machine. I've adjusted it for AWS Lambda, but when I went to deploy I received lots of various errors with components that seleniumwire needs to run. After a lot of…
Val Lapidus
  • 143
  • 1
  • 5
0
votes
1 answer

Using a Layer within Lambdas failed to import module named 'x' - (This module is in my Layer)

I've built a Layer for Lambdas using instructions here. The package I'm trying to add is: selenium-wire When I test my Lambda I get this: [ERROR] Runtime.ImportModuleError: Unable to import module 'lambda_function': No module named…
Val Lapidus
  • 143
  • 1
  • 5
0
votes
0 answers

python cannot make seleniumwire undetected_chromedriver working together

I have python 3.9 installed in a virtual environment. My virtual environment contains the following libraries: seleniumwire undetected_chromedriver I have also installed the certificate ca.ctr in my virtual environment root using the…
Dino
  • 1,307
  • 2
  • 16
  • 47
0
votes
0 answers

how to get the scraped values on a website that has fingerprintjs?

I am trying to scrape this site using google…
Hal
  • 193
  • 1
  • 9
0
votes
2 answers

Seleniumwire get Response text

I'm using Selenium-wire to try and read the request response text of some network traffic. The code I have isn't fully reproducable as the account is behind a paywall. The bit of selenium-wire I'm currently using using is: for request in…
JayRSP
  • 51
  • 11
0
votes
1 answer

Where to find host name or IP for Seleniumwire

I'm trying to run seleniumwire driver in the remote mode. The issue is that I don't quite understand some instructions from the official docs: https://pypi.org/project/selenium-wire/#all-options options = { 'addr': 'hostname_or_ip' # Address of…
user11419808
0
votes
0 answers

Selenium Wire Body decoding

I use Selenium Wire to parse Body and it parses it but in some kind of bytes ? for request in driver.requests: if request.url == 'https://www.google.com': print( request.url, request.response.body, …
L Z
  • 59
  • 5
1 2 3
4
5 6