Questions tagged [rcurl]

RCurl is an R package that provides an R-friendly wrapper for the libcurl C library.

RCurl is an R package that provides a wrapper for the libcurl C library (not the cURL command-line tool, ). RCurl greatly simplifies the process of interfacing R programs with web services and provides simple functions to perform common HTTP calls such as POST and GET. RCurl is cross-platform and installs necessary dependencies when it is added as an R package.

The core workhorse function in RCurl is curlPerform, which maps curl_easy_opt options almost verbatim. See listCurlOptions() for a list of arguments representing those options that can be passed to curlPerform (either directly or via other RCurl functions).

Users may also be interested in the package, which provides a further simplified wrapper around RCurl for common requests.

734 questions
0
votes
1 answer

Loading database from github

I am trying to download a database stored on Github repository but I totally STACKED. The downloaded database is empty and has no tables inside.. I am trying to download this on a temporary file, make some operations and delete this database. Can…
Marcin
  • 7,834
  • 8
  • 52
  • 99
0
votes
2 answers

Bad-case for parsing html table with R

I faced a problem with parsing a html table using RCurl and XML in R. Method readHTMLTable returns 0-length named list for table. The problem is that readHTMLTable() doesn't recognize the parsing result as a HTML table, but it is one. Here is a R…
Maxim
  • 3
  • 2
0
votes
0 answers

Request to improve code to download sequence of URLs

in a file I have a table of 23,772 URLs that I need to download. In the code below, that is represented by dwsites. Due to the server restrictions, I am only able to download a block of 300 sites at a time. I have accomplished that task with the…
iembry
  • 962
  • 1
  • 7
  • 23
0
votes
0 answers

download csv from sftp server and use it as data frame

I would like to download a csv file from sftp server and use it as a data frame. I'm doing the following: library(RCurl) url<-c("sftp://data.ftp.net/data.csv") x <-getURL(url, userpwd=":") writeLines(x,…
rwn1v
  • 777
  • 3
  • 10
  • 23
0
votes
1 answer

Troubleshooting SPARQL rCurl queries in R

I'm doing a sparql query against an authenticated endpoint in R using the SPARQL library. The same query/endpoint/user works using the rrdf package. Unfortuantely, once I get the query working, I need to process the data in R and update the graph…
user1616353
  • 135
  • 7
0
votes
0 answers

Using R to grab Windows AD userid

Does anyone know if it's possible to use R to grab the Windows AD userid and password? I'm using RCurl to grab data from a BusinessObjects Web Service. Everything works fine except I have to pass my userid and password as parameters. Rather than…
0
votes
3 answers

Handling paginated SQL query results

For my dissertation data collection, one of the sources is an externally-managed system, which is based on Web form for submitting SQL queries. Using R and RCurl, I have implemented an automated data collection framework, where I simulate the…
Aleksandr Blekh
  • 2,462
  • 4
  • 32
  • 64
0
votes
1 answer

How to download a file using RCurl

I want to download a file but I have to send variables using POST to be able to do this. Right now I am using a postForm function to send the variables, but I don't know how to download the file. postForm return something like this: doc <-…
Mol
  • 3
  • 2
0
votes
1 answer

Rcurl with posting data using xml

I am trying to translate following curl command to Rcurl and am having trouble in posting the data using a file using RCURL curl –X POST –d @out2 http://211.211.211.211:27844/ssentsvc -- header 'SOAPAction: "http://google.com"' --header…
0
votes
2 answers

Assigning variables to the Get HTTP request in R

Is there any way to assign variable to a http GET request form using rcurl? eg: getURL("https://testme.com/www//LoginService/login?login=xyz&password=") I need to pass the value of password as a variable. Regards ...
san71
  • 47
  • 7
0
votes
0 answers

RCurl postForm fetching incorrect data

I am trying to replicate the following in R curl -XPOST -H 'Content-Type: application/json' -d '{"input":{"webpage/url":"http://http://www.mutualart.com/Exhibitions/Richard-Hamilton/4BC4569A3DCC902A"}}'…
0
votes
0 answers

SetInternet2 Proxy Behavoir with RCurl Package

I am working on a project web scraping where I want to use RCurl with the SetInternet2 proxy settings. My understanding based on research is that RCurl uses its own proxy. As the proxy settings are controlled by the network admin, I do not…
0
votes
2 answers

Disabling output has no effect

I noticed that, under some, unknown to me circumstances, some functions, whether from base R (for example, gc()), or from external packages (for example, getCurlHandle() from RCurl), still produce output, even after explicitly disabling it via…
Aleksandr Blekh
  • 2,462
  • 4
  • 32
  • 64
0
votes
2 answers

Get table from one frame HTML using Rcurl and XML

How I get one table that is generally from on search in http://portal.inep.gov.br/basica-censo-escolar-matricula The table is within th frame. I have to select the state that owns the data: e.g ACRE and click in "consultar" How can I do this?
shasj
  • 85
  • 1
  • 6
0
votes
1 answer

Posting a username and password with RCurl

I am trying to use R to log into this website: http://www.broadinstitute.org/cmap/signature?servletAction=edit with the following code library("RCurl") connectivityMap_detailed_results <- function(up_grp, down_grp){ params <- list('j_username' =…
Niek de Klein
  • 8,524
  • 20
  • 72
  • 143