Stack Overflow
Stack Overflow

Questions tagged [rselenium]

The goal of RSelenium is to make it easy to connect to a Selenium Server/ Remote Selenium Server from within R. RSelenium provides R bindings for the Selenium Webdriver API. Selenium is a project focused on automating web browsers. RSelenium allows you to carry out unit testing and regression testing on your webapps and webpages across a range of browser/OS combinations.

The goal of RSelenium is to make it easy to connect to a Selenium Server/ Remote Selenium Server from within R. RSelenium provides R bindings for the Selenium Webdriver API.

Selenium is a project focused on automating web browsers. See http://docs.seleniumhq.org/

RSelenium allows you to carry out unit testing and regression testing on your webapps and webpages across a range of browser/OS combinations. This allows us to integrate from within R testing and manipulation of popular projects such as shiny, sauceLabs.

Selenium Server is a standalone java program which allows you to run HTML test suites in a range of different browsers, plus extra options like reporting.

See vignette for more details- http://cran.r-project.org/web/packages/RSelenium/vignettes/RSelenium-basics.html

944 questions
0
votes
1 answer

Rselenium web scraping : apply as function

I've been trying to resolve this the whole day and I can't figure out a solution. Please help !! So to learn web scraping, I've been practicing on this website : https://www.net-a-porter.com/fr/fr/Shop/Designers/Fendi The goal is to scrape the…
Mouloune van Muzha
  • 27
  • 7
0
votes
1 answer

Finding a nested div using xpath (RSelenium)

New to RSelenium and xpaths, and though some questions have been asked about this topic I can't seem to make it work for me. I am trying to download the CSV file for the first widget on the page called "Interest over time". This option does not have…
snoepdogg
  • 1
  • 1
0
votes
0 answers

Rselenium in parallel: error when try to open page in a node

On following site: Run RSelenium in parallel, I have found out how to open multiply browsers (sessions) in parallel using parallel package: library(RSelenium) library(rvest) library(magrittr) library(foreach) library(doParallel) # number of…
Mislav
  • 1,533
  • 16
  • 37
0
votes
1 answer

Speed up web scraping using multiplie Rselenium browsers

I am using Rselenium to scrape following website: http://plovila.pomorstvo.hr/ Every time I have to enter 'NIB' field, execute and scrape all data. I am using Sys.time() function several time so my code is slow (cca 12 seconds for one NIB). I need…
Mislav
  • 1,533
  • 16
  • 37
0
votes
1 answer

Rselenium returns many more elements than expected

I would like to find the name of the different hockey tournament/leagues from this page. The problem is that I end up with close to 8000 elements, which I dont see why. library(RSelenium) rs <- rsDriver() remote <-…
MLEN
  • 2,162
  • 2
  • 20
  • 36
0
votes
0 answers

Can't set up profile with latest version of RSelenium for firefox

this code ran for last version I used in July: fprof <- getFirefoxProfile("c:/Users/cp/AppData/Roaming/Mozilla/Firefox/Profiles/j7a5lq0r.selenium", useBase = T) rS <- rsDriver(browser = "firefox", port = 4567L, extraCapabilities = fprof) but now…
Peter.k
  • 1,475
  • 23
  • 40
0
votes
1 answer

RSelenium getPageSource() hangs if window is closed

I am trying to get the text on a popup page but sometimes the popup closes by itself. It's no big deal in itself but if I just launched a remDr$getPageSource() it hangs forever. Worse, if I kill it (for example launching with a fork and killing…
cmbarbu
  • 4,354
  • 25
  • 45
0
votes
1 answer

RSelenium - get text from result form

I have consulted SO thoroughly to avoid duplicates, but still seem not to be getting anywhere. Proudly RSelenium and docker both work on my mac. The problem is how to extract the kms result from:…
Hendrik
  • 35
  • 1
  • 4
0
votes
1 answer

How to access a page scraped using RSelenium with rvest?

I am trying to scrape a webpage which uses angular.js. My understanding is that the only option in R is to use RSelenium to load the page first, and then parse the content. However, I find rvest more intuitive than RSelenium to parse the content,…
Dambo
  • 3,318
  • 5
  • 30
  • 79
0
votes
1 answer

Docker: error during connect

I am getting the above error whenever i am trying to use RSelenium package shell('docker run -d -p 4445:4444 selenium/standalone-chrome') docker: error during connect: Post http://%2F%2F.%2Fpipe%2Fdocker_engine/v1.30/containers/create: open…
Arunachalam
  • 53
  • 9
0
votes
1 answer

RSelenium: Scraping links on page

I'm relatively new to RSelenium. I have successfully managed to log into a site from where I need to pull all web links. That overview page looks like this: A2A
mr_bungles
  • 77
  • 1
  • 11
0
votes
1 answer

R - RSelenium, press Next button & change dropdown options to 25

OP Warning: I am not very good at HTML. I am trying to use RSelenium remote-drive (browserName='phantomjs') to scrape some links on a login required page. I was able to handle the login part but when I try to extract the links in the table, I…
Alperen Taciroglu
  • 351
  • 1
  • 5
  • 15
0
votes
1 answer

Rselenium executable does not exist

I try to run RSelenium using the following: library("RSelenium") #start RSelenium server rD <- rsDriver(verbose = FALSE) remDr <- rD$client remDr$open() However, in rsDriver(), I receive this error: Selenium message:The driver executable does not…
Sasak
  • 189
  • 5
  • 15
0
votes
1 answer

Is it possible to run multiple independent RSelenium browsers?

It is possible to run multiple scripts with multiple R sessions, but I can't get two r-scripts involving starting RSelenium server and browser to work. Is there away to make this work? Example: run one script involving www.bbc.co.uk and another…
Allan A
  • 427
  • 8
  • 17
0
votes
1 answer

What's an efficient way to find the last web element on a web page using RSelenium?

I'm using RSelenium to automatically scroll down a social media website and save posts. I want to find the last instance of a web element (specifically, the post dates), but it's taking unacceptably long using my current method (using findElements()…
jruf003
  • 980
  • 5
  • 19
1 2 3
…
62 63