Stack Overflow
Stack Overflow

Questions tagged [robobrowser]

RoboBrowser is a Pythonic library for automated web browsing and form handling. It is built on top of the requests and BeautifulSoup libraries.

RoboBrowser is a Pythonic library for automated web browsing. It can fetch pages, follow links handle forms. It is built on top of and , and aims to be a more modern replacement for .

122 questions
1
vote
1 answer

How to login using robobrowser with CSRF token?

I am currently trying to login into https://customersso1.fortinet.com/saml-idp/login/?next= and after login head to https://support.fortinet.com/Information/ProductLifeCycle.aspx and scrape all the tables in it. I tried various ways and settled on…
Tango_charlie
  • 41
  • 5
1
vote
2 answers

Python : extract files from zipfile from web without downloading and saving it first

import re import requests import zipfile import werkzeug werkzeug.cached_property = werkzeug.utils.cached_property from robobrowser import RoboBrowser br = RoboBrowser(history=True) br.open("loginurl") forms =…
mato200
  • 75
  • 6
1
vote
0 answers

Python web-scraping yields different html than browser after log-in page

Currently doing web-scraping for the first time trying to grab and compile a list of completed Katas from my CodeWars profile. You can view the completed problems without being logged in but it does not display your solutions unless you have logged…
Ash Ozen
  • 11
  • 2
1
vote
1 answer

ImportError: cannot import name 'RoboBrowser' from 'robobrowser'

I am very new to Python and have used BeautifulSoup to parse and scrape information from some webpages. Now I need to fill out a form. submit it, and scrape some data after filling in the form, and it seems the easiest way is to use…
SergeNYC
  • 77
  • 11
1
vote
0 answers

Badrequestkeyerror robobrowser

I am trying to submit a text value into a form to get to another page, but all I am getting is Badrequestkeyerror. Can anyone help me understand what it is and how I can solve for my code? I tried implementing things already available on the enter…
SM_207
  • 11
  • 1
1
vote
2 answers

Getting FB Token Python

I'm trying to get FB token to Tinder, but i'm stuck in some errors after submit the CONFIRM form. I`ve tried to pass the exception, but still fails. import re import robobrowser import sys import random import time MOBILE_USER_AGENT = 'Mozilla/5.0…
F. Costa
  • 59
  • 6
1
vote
1 answer

Python: RoboBrowser TypeError: 'NoneType'

I am attempting to scrape pricing info for certain items on Tessco.com I found RoboBrowser, and a few tutorials. Following the tutorial, I have an error, where the poster does not. I am not sure what needs to be modified to correct the issue. Code…
James Hayek
  • 643
  • 3
  • 10
  • 35
1
vote
0 answers

Combining Requests-HTML with RoboBrowser or Mechanize

I like to fill out a form in a website either using Robobrowser or mechanize libraries in python. But, the website I'm attempting needs javascript rendering. I am able to render webpage javascript using requests-html. Now how do I pass my session…
BANUPRAKASH MUNNANGI
  • 63
  • 1
  • 10
1
vote
0 answers

Handle radiobuttons with requests

I want to trigger radio button with python-requests. Currently I am looking what is happening when radio button is manually selected: XHR to: http://exmp-url/admin-ajax.php HEADERS: 'Accept': '*/*', 'Accept-Encoding': 'gzip,…
ap3x
  • 33
  • 7
1
vote
1 answer

Using Python 3 & RoboBrowser to submit a form to facebook & getting UnicodeDecodeError

So i am trying to make a script that will auto upload images to facebook for me using RoboBrowser to navigate the mbasic.facebook.com website and i am getting a strange error when submitting the image form: Traceback (most recent call last): File…
Edwould
  • 11
  • 2
1
vote
1 answer

Cannot manipulate inputs in form using robobrowser

I've been at this for literally a day; none of the Youtube videos go beyond a very basic example. Please help. I'm sure Im missing something really basic here. Would it change things if the input boxes are embedded in a table? Here is my code: from…
noskillz
  • 21
  • 4
1
vote
0 answers

robobrowser 'NoneType' object does not support item assignment

import re from robobrowser import RoboBrowser email = 'example@gmail.com' senha = '12342343' br = RoboBrowser() br.open("https://www.ifood.com.br/entrar/") form = br.get_form() form['email_login'] = email form['password_login'] =…
Burns
  • 27
  • 2
1
vote
1 answer

Is there a way to activate javascript in robobrowser?

I've write a python script to submit a form, and when i try it, it doesn't work.. So I wanted to look at the current page in robobrowser, and i found this:
ecavard
  • 151
  • 2
  • 10
1
vote
0 answers

Robobrowser Login-Form Submission Unsuccessful or Incorrect

import re import robobrowser browser = robobrowser.RoboBrowser(parser = "html.parser",…
bumchux
  • 13
  • 3
1
vote
2 answers

Extracting text with no tags/formatting in HTML file with Robobrowser, Beautifulsoup in Python

Name: USERNAME [585743]
Money: $MONEY
Location: CITY
Level: 43
Gold: 4706 / 5315
 I have this HTML inside a messy page. I want to extract…
Alexis Drakopoulos
  • 1,115
  • 7
  • 22
1 2
3
…
8 9