Questions tagged [rcurl]

RCurl is an R package that provides an R-friendly wrapper for the libcurl C library.

RCurl is an R package that provides a wrapper for the libcurl C library (not the cURL command-line tool, ). RCurl greatly simplifies the process of interfacing R programs with web services and provides simple functions to perform common HTTP calls such as POST and GET. RCurl is cross-platform and installs necessary dependencies when it is added as an R package.

The core workhorse function in RCurl is curlPerform, which maps curl_easy_opt options almost verbatim. See listCurlOptions() for a list of arguments representing those options that can be passed to curlPerform (either directly or via other RCurl functions).

Users may also be interested in the package, which provides a further simplified wrapper around RCurl for common requests.

734 questions
0
votes
1 answer

Is there a way to know where on page something is placed html

Let's say I want to know if a call-to-action (like a fill-out form) is placed "within the fold" meaning it is visible as soon as you load the page without scrolling. Is there something in the html that would allow me to know this?
Cybernetic
  • 12,628
  • 16
  • 93
  • 132
0
votes
3 answers

Debugging RCurl-based authentication & form submission

SourceForge Research Data Archive (SRDA) is one of the data sources for my dissertation research. I'm having difficulty in debugging the following issue related to SRDA data collection. Data collection from SRDA requires authentication and then…
Aleksandr Blekh
  • 2,462
  • 4
  • 32
  • 64
0
votes
0 answers

twitteR error in function (type, msg, asError = TRUE)

I get the following error: twitCred$handshake(cainfo = system.file("CurlSSL", "cacert.pem", package = "RCurl")): Error in function (type, msg, asError = TRUE) : Could not resolve host: api.twitter.com; Host not found, try again How do I resolve…
0
votes
0 answers

Downloading Intra-Day Data From StockRageous... without link

I am wondering if it is possible to download Intra-day data using R from the following link: < http://www.stockrageous.com/charting.jsp?Symbol=NFLX > The problem is that in order to do so one must manually go to the Data tab and then select the…
Jason
  • 311
  • 1
  • 4
  • 14
0
votes
1 answer

R Rcurl's result different from firefox

I would like to access to a web page with R and rcurl package. Here is my code : library(RCurl) library(XML) URL <- "http://www.lfp.fr/ligue1/calendrier_resultat#sai=82&jour=1" siteHTML <- getURL(url=URL) xmltext <- htmlParse(siteHTML, asText=TRUE,…
0
votes
2 answers

How to fix this RCurl error?

I'd like to ask a question on the issue I'm currently stuck with. When trying to scrape an HTML page (using RCurl), I encounter this error: "Error in curlMultiPerform(multiHandle): embedded nul in string". I read a lot about this type of error and…
Aleksandr Blekh
  • 2,462
  • 4
  • 32
  • 64
0
votes
0 answers

keep connection open with rcurl

I'm connecting to a server to make thousands of requests. Based on what I'm seeing, it looks like RCurl is opening a connection to the server on every request. I'm wondering if there is a way to keep the connection open for a set amount of time.…
hedgedandlevered
  • 2,314
  • 2
  • 25
  • 54
0
votes
0 answers

What is the RCurl format to transfer a data file?

I am a bit puzzled because I can not get this to work from within R. I want to execute the following Curl request from within R using RCurl: curl -T 'temp.csv' -H 'Content-Type: text/csv' https://api.crowdflower.c.json?key={APIKEY} That is, I want…
devmag
  • 233
  • 3
  • 5
0
votes
1 answer

How to use RCurl to authenticate to spring security / grails app

Today I tried to figure out how to use the R package RCurl to log onto my grails application, which uses the spring security plugin and not base authentication. I wanted to figure out how to log on to the website to download some data. On the…
mlist
  • 285
  • 1
  • 9
0
votes
0 answers

Move remote file in SFTP using R and RCurl

I need to rename a remote file once I download them. I tried to use the following command, but its not working. input = getURL(url, userpwd="user:password", postquote=c("/inputs/", "RNFR abc.xml", "RNTO abc.xml_processed")) This is throwing the…
RP-
  • 5,827
  • 2
  • 27
  • 46
0
votes
1 answer

How do I use an XPath query to get a list of character vectors in R?

I would like to use XPath to return a character vector of the link inside each anchor tag. I can return the table of interest with library(RCurl) library(XML) url <- "http://dps.alaska.gov/sorweb/aspx/sorcra1.aspx" readHTMLTable(url,…
cylondude
  • 1,816
  • 1
  • 22
  • 55
0
votes
1 answer

Extract text from HTML node tree with R

I'm currently trying to scrape text from an HTML tree that I've parsed as follows:- require(RCurl) require(XML) query.IMDB <- getURL('http://www.imdb.com/title/tt0096697/epdate') #Simpsons episodes, rated and ordered by broadcast…
Simon Hayward
  • 694
  • 11
  • 26
0
votes
1 answer

curl -X POST command with RCurl

I'm trying to get the following HTTP POST containing XML to work using RCurl package in R: curl -X POST 'https://api.example.com/resource.xml' -d 'From=value' -d 'To=value' -d 'Body=value' -u username:password I have no problems running the…
user2844910
  • 77
  • 1
  • 6
0
votes
1 answer

How to translate the following simple curl call to R code using RCurl?

Consider the following commands (2 examples) curl -H "Accept:text/plain" http://rxnav.nlm.nih.gov/REST/rxcui/866350/allrelated curl -i -L -H "Accept: application/xml" …
userJT
  • 11,486
  • 20
  • 77
  • 88
0
votes
2 answers

R: postForm from the RCurl package and issues API call

Does anyone have experience with the limitations of postForm from the RCurl package? I am pulling data off an server and almost out of nowhere I got the error message * HTTP 1.0, assume close after body and then a 500 Internal Server Error. I…
Eric Fail
  • 8,191
  • 8
  • 72
  • 128