PYppeteer times out even though the page has already loaded (no spinner, no network activity)

Question

I have the following code that automates the login to a particular site, in order to grab some value that is behind a login screen.

#!/usr/bin/python3

import asyncio
from pyppeteer import launch

browser = await launch( {'headless': True} );
page = await browser.newPage()
await page.goto(page_url1, {'waitUntil': 'networkidle2', 'timeout': '30000'})
# injecting username and password redacted    
await asyncio.gather(
    page.waitForNavigation({'waitUntil': 'networkidle2', 'timeout': '30000'}),
    page.click('#submitButton')
)
# the line above got stuck or timed out
await browser.close()

pyppeteer.errors.TimeoutError: Navigation Timeout Exceeded: 30000 ms exceeded

score 1 · Answer 1 · answered Feb 18 '21 at 21:01

1

I spent hours trying to debug this, but what finally solved it is downgrading websockets to 6.0, as some people suggested here: Pyppeteer crushes after 20 seconds with pyppeteer.errors.NetworkError

pip3 install websockets==6.0 --force-reinstall

answered Feb 18 '21 at 21:01

Alexei Masterov

382
2
10

1

And what is the pyppeteer version do you use? Because current version 0.2.5 has wevsockets>=8.1 as a dependency – Anton Kaminski Mar 23 '21 at 20:09

PYppeteer times out even though the page has already loaded (no spinner, no network activity)

1 Answers1