Stack Overflow
Stack Overflow

Questions tagged [robobrowser]

RoboBrowser is a Pythonic library for automated web browsing and form handling. It is built on top of the requests and BeautifulSoup libraries.

RoboBrowser is a Pythonic library for automated web browsing. It can fetch pages, follow links handle forms. It is built on top of and , and aims to be a more modern replacement for .

122 questions
2
votes
2 answers

python get website landing page html correctly

I've been trying to get the html content of this page 'https://webcache.gmc-uk.org/gmclrmp_enu/start.swe' with Robobrowser. here is the code: from robobrowser import RoboBrowser landing_page_url =…
Eiri
  • 685
  • 1
  • 9
  • 12
2
votes
1 answer

Filling up a dynamic online form in Python

I am working with RoboBrowser on Python and I am trying to fill up a form on a website (here). Now the thing is that the form is dynamic. If you open up the link, you'll see a row for 'Country', 'State/District', 'City' and 'Location'. The…
Vizag
  • 743
  • 1
  • 7
  • 30
2
votes
0 answers

Cannot set a value to non-existent attribute within a field HTML

I have this issue. I am trying to fill forms of this website using robobrowser. My code in python is below: new_CRTS_DR3_beta_url = 'http://crts.iucaa.in/CRTS/' browser = RoboBrowser() browser.open(new_CRTS_DR3_beta_url) form =…
Catalina Gomez Caballero
  • 21
  • 1
2
votes
0 answers

Python, robobrowser, answer authentication-challenge after login

I'm really new to python programming. I'm working on automation of a web-browser. I started with selenium, but found it to be really slow for what I need. I'm working on a code that can Login to a webpage and fill out few text-boxes and click on…
shiny
  • 171
  • 4
  • 13
2
votes
1 answer

find some value in javascript, in the response form

I have an url www.example.com/test so by using robobrowsker to visit this url, I find some js in response and it contains something like this var token = _.unescape("<input name="__RequestVerificationToken" type="hidden"…
ikel
  • 1,790
  • 6
  • 31
  • 61
2
votes
1 answer

Python RoboBrowser SSL Error : bad handshake: SysCallError(104, 'ECONNRESET')

I am trying to fill out a form on a web page and get some of the results back using the RoboBrowser library. I have a file with ~200k references that may not give the adaquate anwser (the street name stored in data[1] may be different from the one…
Clement
  • 61
  • 1
  • 1
  • 4
2
votes
1 answer

RoboBrowser form submission

I'm trying to automate form submission on a website using robobrowser but after I submit the form I don't get the correct response instead it shows me the same page I was on. Here is my code from robobrowser import RoboBrowser browser =…
mrsux0r
  • 23
  • 1
  • 7
2
votes
1 answer

Urllib3 socks5 proxy error: 'socks' has no attribute 'create_connection'

I need Robobrowser to use Tor, easiest way i thought would be like this: Robobrowser with Sessions. But i encountered a strange problem with requests, or more specific urllib3: AttributeError: module 'socks' has no attribute 'create_connection' As…
Gugi
  • 23
  • 7
2
votes
2 answers

python RoboBrowser clicking on radio buttons

I been trying to fix the code below for a while now, for some reason every part of the code works except the part where it has to click on a radio button, it says "ValueError: Option 1 not found in field " but there is an options that's for 1, it's…
user5117999
  • 49
  • 5
2
votes
0 answers

get facebook user access token via python

i actually want to grab the facebook user access token via python programmatically. i use the following code: import re from robobrowser import RoboBrowser browser = RoboBrowser(history=True) browser.open('http://www.facebook.com/') form =…
dimos
  • 147
  • 2
  • 9
2
votes
1 answer

Click website button using Python

I want to automate a process that searches for a key word in a search bar using Python on my server. However, searching first returns a disclaimer and once accepted, the result is actually shown. The disclaimer site is the…
calpyte
  • 855
  • 1
  • 9
  • 17
2
votes
1 answer

Scrape a form on incorrect web page

I'm trying to scrape a html form using robobrowser with python 3.4. I use the default html parser: self._browser = RoboBrowser(history=True, parser="html.parser") It works fine for correct web pages but now I have to parse incorrectly written page.…
Dado
  • 23
  • 5
2
votes
0 answers

RoboBrowser submit form response status 500

I'm trying to login in Quora using robobrowser and i wrote this script from robobrowser import RoboBrowser browser = RoboBrowser( history=True, user_agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu…
Wendy
  • 1,523
  • 3
  • 12
  • 16
2
votes
1 answer

RoboBrowser Search Form

I want to search a form but get the error 'NoneType' object has no attribute
overView
  • 77
  • 2
  • 10
2
votes
0 answers

Python script using robobrowser to submit a form on bitbucket to import repo

I have some repos in my bitbucket user account and I want them to import to a team I created. I looked in Bitbucket API references and couldn't find any API which can import a repo from my account to a Team. So I am trying to write a script which…
avi
  • 9,292
  • 11
  • 47
  • 84
1
2
3
…
8 9