Questions tagged [seleniumwire]

Selenium Wire is a python package that extends the original Python bindings provided by Selenium in order to provide the tests with additional access to the underlying requests that were made by the browser. Use this tag for questions related to the Selenium Wire package.

Selenium Wire package: https://github.com/wkeeling/selenium-wire

89 questions
1
vote
0 answers

Python Selenium Wire Webdriver not utilizing Page Load Strategy

Edit: There are other questions addressing the ability to interact with pages that aren't fully loaded. THIS IS NOT THAT. This is specific to the SeleniumWire driver, not just Selenium Webdriver. I'm currently working with a project using Selenium…
SamC1404
  • 11
  • 2
1
vote
1 answer

Can't access website with Selenium-wire after using Pyinstaller

I need to access a website. For that I need to use proxies with authentication and a specific user-agent. Here's the code: def start_driver(proxy_data, user_agent): proxy = ( proxy_data.get('login') + ':' + proxy_data.get('password')…
Morello
  • 135
  • 1
  • 1
  • 11
1
vote
1 answer

seleniumwire_options=None: SyntaxError: invalid syntax

I am using selenium-wire to click a button using Chrome browser. Up until today, my code worked fine. However, now I get the following error and I am not sure why: Traceback (most recent call last): File "Scraping_fx.py", line 1, in from…
AntsaR
  • 380
  • 1
  • 9
  • 28
1
vote
0 answers

Selenium-wire is not finding a header (Python)

Selenium wire is not finding my header with the command request.response.headers['Content-Type']. I tried several Headers that can be found using the chrome dev tool. Code: from seleniumwire import webdriver chromedriver = 'C:\Program Files…
Tudor Popescu
  • 509
  • 1
  • 5
  • 16
0
votes
0 answers

Selenium-Wire proxy option with authentication error's

I tried to write a script to open chrome with authentication proxys, using selenium-wire. If I start the script, it stops immediately. No error code shows up but also no chrome (window) starts. What is the error/mistake I made. How can I fix it? My…
0
votes
0 answers

Selenium getting increasingly slower during a while True loop?

I have a while True loop in my python code that carries out some tasks on a website I own. I'm doing a mixture things in this loop, including intercepting some network traffic using selenium wire. Looking at the time stamp printed at the top of each…
0
votes
1 answer

ValueError: There is no such driver by url https://chromedriver.storage.googleapis.com/LATEST_RELEASE_108.0.5359.71

I am working on a Python script that needs to run in Databricks using Selenium and the webdriver_manager package. The script runs once a week using an Airflow DAG. Recently, I started encountering issues with the ChromeDriver version detection. The…
0
votes
1 answer

How do I set up a proxy when I get the message: "... [WinError 10061]" using Selenium Wire and Tor browser and set header capture – in python?

To be able to capture headers (the Selenium library does not support this) I decided to use the Selenium Wire library. I found the following website: https://gitlab.torproject.org/woswos/CAPTCHA-Monitor/-/snippets/60 that explains how to use the…
Olgierd Wiśniewski
  • 433
  • 2
  • 8
  • 14
0
votes
0 answers

Why does my code give me denied access when trying to fetch metadata from homepage

I have tried to fetch data from a website. Here's the code I have, but I think my header is wrong or something. I just keep end up with the same issue. That I'm denied. How can I fix this to avoid that? from seleniumwire import webdriver from…
Valnurat
  • 71
  • 1
  • 7
0
votes
0 answers

How to Run multiple selenium session form one session id in python

How to run multiple Selenium sessions from one session ID in Python I am getting an issue while running multiple set of scraping task using same session id/user then the first task closes and new gets started. We are using a static proxy while…
0
votes
0 answers

seleniumwire change host header

How to change 'host' header using seleniumwire? driver.headers_override just append second 'host' header. With request.header['host']='newhost' the same situation. Is it possible?
ValB
  • 19
  • 2
0
votes
0 answers

Selenium-Wire isn't working with proxy (python)

lately my python script just stopped working and I have no clue why. Maybe anyone of you have an idea. There is the code: from seleniumwire import webdriver options = {     'proxy': {         'http': 'http://username:password@ip:port',        …
0
votes
0 answers

How to wait until certain request url loads a certain request headers before proceeding in selenium wire?

Currently when this page loads https://alfagift.id/, a certain java script is run on the client side and an element fingerprint is created on the client side. When I checked in inspect element, the element that I need called fingerprint is loaded…
jamie
  • 1
  • 2
0
votes
0 answers

ERR_TUNNEL_CONNECTION_FAILED error when using proxies

I am currently using seleniumwire and IPRoyal to access the page. My page works fine for cetain website but when accessing certain webpage, I am getting the error below: selenium.common.exceptions.WebDriverException: Message: unknown error:…
0
votes
0 answers

Why not getting headers in selenium wire?

I tried deploying this code to ubuntu, it's running however it's not returning the fingerprint as it should be. When run locally on visual studio code, the fingerprints are there. What am I missing here? It's returning an error fp is not defined…