Stack Overflow
Stack Overflow

Questions tagged [robobrowser]

RoboBrowser is a Pythonic library for automated web browsing and form handling. It is built on top of the requests and BeautifulSoup libraries.

RoboBrowser is a Pythonic library for automated web browsing. It can fetch pages, follow links handle forms. It is built on top of and , and aims to be a more modern replacement for .

122 questions
1
vote
0 answers

Robobrowser keep an active session

I wrote a code that has as mission to log in a system, to stay logged in and to download a series of pages. For this, I used a library called Robobrowser. I wrote this: import robobrowser import re url = 'https://link.com/scp/login.php' browser =…
SlowHusky
  • 97
  • 1
  • 1
  • 10
1
vote
0 answers

Script returns desired output locally but not on Heroku

I have this script to extract image URLs from Bing. When I run the script on my computer, the script always return the URL of the first image of the page. However, my API runs on Heroku and whenever I make a request, for some reason the API returns…
Bartek Spitza
  • 305
  • 2
  • 15
1
vote
2 answers

robobrowser how to locate a form by name

I am working with robobrowser to login to a website. The problem I have is that the login page has 2 forms both with the same action, but with different names.
...
The second form is:
dnraikes
  • 275
  • 1
  • 4
  • 14
1
vote
2 answers

Python can't find already installed module robobrowser

I am trying to create a very simple Python 3.6 script. Using MacOS. For this script I had to install robobrowser, which I installed with easy_install robobrowser. After that I try to import it with the following statements: import re from…
Thijmen
  • 374
  • 2
  • 14
1
vote
2 answers

Retrieving a form results with requests

I want to submit a multipart/form-data that sets the input for a simulation on TRILEGAL, and download the file available from a redirected page. I studied documentation of requests, urllib, Grab, mechanize, etc. , and it seems that in mechanize…
scichris
  • 2,617
  • 2
  • 13
  • 7
1
vote
1 answer

login to ASPX with Robobrowser python library

Trying to login automatically with Robobrowser to asp site. No errors from robobrowser, but it only returns the login site, not the successful site.
jakethedog
  • 340
  • 2
  • 3
  • 14
1
vote
1 answer

Returning multiple matches with RoboBrowser/BeautifulSoup

I'm trying to get multiple regex-matches with the find/find_all-method, but can't get it to work. A piece of the HTML-code can be something like: Week 22: 3871983 Then in code I'm trying the following: import re from robobrowser import…
irrbloss
  • 207
  • 2
  • 9
1
vote
0 answers

Memory use growing forever with RoboBrowser?

[EDITED to simplify the example/isolate the problem better] Using RoboBrowser with multiple subsequent visits to the same URL causes memory to grow with each visit, even when you re-initialise and overwrite the original RoboBrowser instance each…
guzman
  • 177
  • 2
  • 11
1
vote
1 answer

Python: how to get hidden html contents from a HTML page

i'm trying to make a program that can reissue the books i've taken from the library using robobrowser so,for that i was supposed to 1) login to my ID 2) tick on the checkboxes of the respective books 3) click on submit after i did the login and…
P.hunter
  • 1,345
  • 2
  • 21
  • 45
1
vote
1 answer

how to remove AttributeError in Robobrowser

i'm trying to login to my college id and fetch some info using robobrowser. bu i'm getting this traceback when i try to print contents of my dashboard. Traceback (most recent call last): File…
P.hunter
  • 1,345
  • 2
  • 21
  • 45
1
vote
0 answers

How to remove TypeError in Robobrowser

I'm trying to make a program which reissues the books i have taken from my college library, for that i'm supposed to put my USER-ID in the form and submit it, and do the the rest of the code. but i'm not even able to fetch the page where all my…
P.hunter
  • 1,345
  • 2
  • 21
  • 45
1
vote
1 answer

Import cookie - Robobrowser - Python

I'm looking to import a cookie using robobrowser. So I define: from robobrowser import RoboBrowser cookie={'name':'sc_device_auth', 'value':'abcdef', 'domain':'www.url.com/'} browser = RoboBrowser(history=True,\ …
Celi28
  • 101
  • 13
1
vote
1 answer

Parsing webpage with robobrowser and beautifulsoup

I'm new to webscraping trying to parse a website after doing a form submission with robobrowser. I get the correct data back (I can view it when I do: print(browser.parsed)) but am having trouble parsing it. The relevant part of the source code of…
MikeD
  • 37
  • 1
  • 7
1
vote
0 answers

Python3 RecursionError while decoding Unicode (for BeautifulSoup/RoboBrowser)

I'm working on a web scraping component using BeautifulSoup and RoboBrowser, and have run into a curious problem with one case in particular. The page in question contains all the same chrome and structure as all the other cases that work fine, but…
RobF
  • 221
  • 2
  • 8
1
vote
0 answers

robobrowser scrape page with login

I am trying to scrape a page but I have to go pass the login page, which I am not being able to do for some reason. Any help is appreciated since I am running out of ideas... from robobrowser import RoboBrowser browser =…
Ferca
  • 11
  • 2
1 2 3
…
8 9