Questions tagged [rselenium]

The goal of RSelenium is to make it easy to connect to a Selenium Server/ Remote Selenium Server from within R. RSelenium provides R bindings for the Selenium Webdriver API. Selenium is a project focused on automating web browsers. RSelenium allows you to carry out unit testing and regression testing on your webapps and webpages across a range of browser/OS combinations.

The goal of RSelenium is to make it easy to connect to a Selenium Server/ Remote Selenium Server from within R. RSelenium provides R bindings for the Selenium Webdriver API.

Selenium is a project focused on automating web browsers. See http://docs.seleniumhq.org/

RSelenium allows you to carry out unit testing and regression testing on your webapps and webpages across a range of browser/OS combinations. This allows us to integrate from within R testing and manipulation of popular projects such as shiny, sauceLabs.

Selenium Server is a standalone java program which allows you to run HTML test suites in a range of different browsers, plus extra options like reporting.

See vignette for more details- http://cran.r-project.org/web/packages/RSelenium/vignettes/RSelenium-basics.html

944 questions
11
votes
3 answers

Specify download folder in RSelenium

I am using RSelenium to navigate towards a webpage which contains a button to download a file. I use RSelenium to click this button which downloads the file. However, the files are by default downloaded in my folder 'downloads', whereas I want to…
user3387899
  • 601
  • 5
  • 18
10
votes
0 answers

Faster alternative to Rselenium

I am creating a scraper for this page: https://www.oddsportal.com. Since the page use javascript rendering I decided for Rselenium. My aim is to scrape odds for each match played in this year. I use login form for the page since I set my own…
Tomas
  • 153
  • 6
10
votes
1 answer

How to open Google Chrome with RSelenium?

I am using RSelenium and I want to open and navigate Google Chrome. However, I always get an error when I want to open the browser from R. The following code is used: library("RSelenium") startServer() mybrowser <- remoteDriver(browserName =…
stats_guy
  • 695
  • 1
  • 9
  • 26
10
votes
1 answer

Scraping password protected forum in r

I have a problem with logging in in my script. Despite all other good answers that I found on stackoverflow, none of the solutions worked for me. I am scraping a web forum for my PhD research, its URL is http://forum.axishistory.com. The webpage I…
10
votes
1 answer

stumped on how to scrape the data from this site (using R)

I am trying to scrape the data, using R, from this site: http://www.soccer24.com/kosovo/superliga/results/# I can do the following: library(rvest) doc <- html("http://www.soccer24.com/kosovo/superliga/results/") but am stumped on how to axtually…
Peter Verbeet
  • 1,786
  • 2
  • 13
  • 29
10
votes
4 answers

How to fill in an online form and get results back in R

Has anyone ever filled in a web form remotely from R? I'd like to do some archery statistics in R using my scores. There is a very handy webpage, that gives you the classification and handicaps http://www.archersmate.co.uk/, which I naturally would…
Joanne Demmler
  • 1,406
  • 11
  • 31
9
votes
2 answers

R - Waiting for page to load in RSelenium with PhantomJS

I put together a crude scraper that scrapes prices/airlines from Expedia: # Start the Server rD <- rsDriver(browser = "phantomjs", verbose = FALSE) # Assign the client remDr <- rD$client # Establish a wait for an…
IRNotSmart
  • 351
  • 6
  • 18
9
votes
1 answer

Run RSelenium in parallel

How would i go about running RSelenium in parallel. The following is an example using rvest in parallel library(RSelenium) library(rvest) library(magrittr) library(foreach) library(doParallel) URLsPar <- c("http://www.example.com/",…
dimitris_ps
  • 5,849
  • 3
  • 29
  • 55
9
votes
1 answer

Scraping data from TripAdvisor using R

I want to create a crawler that will scrape some data from Trip Advisor. Ideally, it will (a) identify the links to all locations to crawl, (b) collect links to all attractions in each location and (c) will collect the destination names, dates…
IVR
  • 1,718
  • 2
  • 23
  • 41
8
votes
1 answer

How to check if an object is visible in a webpage by using its xpath?

I'm using the RSelenium package in R to do webscraping. Sometimes after loading a webpage, it's required to check if an object is visible in a webpage or not. For example: library(RSelenium) #open a browser RSelenium::startServer() remDr <-…
Mohammad
  • 1,078
  • 2
  • 18
  • 39
7
votes
5 answers

R: Selenium server signals port = 4567 is already in use

It seems this is a recurrent question, but I haven't found the solution to my problem. I am running the following: link <- 'https://www.google.com/' rD <- rsDriver(verbose = TRUE, port=4567L, browserName = 'chrome', …
Mig
  • 139
  • 2
  • 10
7
votes
1 answer

Cannot start a session with phantomjs in RSelenium

Cannot start a new session with phantomjs using rsDriver. Other browsers work fine, but when i try the option of phantomjs it does not work and I cannot fully grasp the meaning of the output of the error. How can I solve…
John Doe
  • 212
  • 1
  • 9
  • 28
7
votes
1 answer

I got error like Error in if (file.access(phantompath, 1) < 0) { : argument is of length zero when I use Phantomjs(port = 4567l)

my code is library(RSelenium) library(wdman) pDrv <- phantomjs(port = 4567L) below is what I got an error after runing above codes. checking phantomjs versions: BEGIN: PREDOWNLOAD BEGIN: DOWNLOAD BEGIN: POSTDOWNLOAD Error in if…
7
votes
2 answers

Rselenium can't connect to running shiny app

I configured selenium server in docker. It works ok - I can connect to it, but when I want to interact with running local shiny app Rselenium does not see it. Details below: I did step-by-step: I run selenium server: docker run -d -p 4445:4444…
Taz
  • 5,755
  • 6
  • 26
  • 63
7
votes
1 answer

Click on cross domain iframe element using Rselenium

I am using R, version 3.3.2. Using Rselenium package, I am trying to scrap some data from this website: http://www.dziv.hr/en/e-services/on-line-database-search/patents/ I am using Rselenium and my code looks like this: selServ <-…
Mislav
  • 1,533
  • 16
  • 37
1
2
3
62 63