Questions tagged [rcurl]

RCurl is an R package that provides an R-friendly wrapper for the libcurl C library.

RCurl is an R package that provides a wrapper for the libcurl C library (not the cURL command-line tool, ). RCurl greatly simplifies the process of interfacing R programs with web services and provides simple functions to perform common HTTP calls such as POST and GET. RCurl is cross-platform and installs necessary dependencies when it is added as an R package.

The core workhorse function in RCurl is curlPerform, which maps curl_easy_opt options almost verbatim. See listCurlOptions() for a list of arguments representing those options that can be passed to curlPerform (either directly or via other RCurl functions).

Users may also be interested in the package, which provides a further simplified wrapper around RCurl for common requests.

734 questions
0
votes
0 answers

scrape data from selected layer using Rcurl

I recently started with R, and got the advice to use RCurl when I was looking for soil data from the website http://www.bodemdata.nl (a dutch site with soil data). The query starts with a map of the Netherlands (a png-file, visible when the button…
0
votes
2 answers

RCurl with Moodle

I'm trying to login Moddle and get some log files with this: postForm('http://ead.portalinstitutounibanco.org.br/login/index.php', username = "Username value", password = "Password value", …
0
votes
0 answers

RCurl::url.exists() : how to get non-error for redirects (in the 300 range of HTTP status codes)

I have a bunch of URLs extracted by text-mining some PDF documents. Now I want to test the URLS for validity. Some urls have junk characters inside or appended, or the URLS are truncated. One approach is to filter them by calling each of them. To do…
knb
  • 9,138
  • 4
  • 58
  • 85
0
votes
1 answer

Cannot get PIN using ROauth

I want to connect R to Twitter. I have followed the steps set our here: http://cran.r-project.org/web/packages/twitteR/vignettes/twitteR.pdf The code that I have is as follows: library(ROAuth) cred <-…
user1966593
  • 69
  • 10
0
votes
1 answer

How to Use RCurl or RMongo via HTTP with Authentication and Self Signed SSL to Read in JSON Data

I am using R to write a program and perform some analyses. The data is being captured by an outside vendor with MongoDB in JSON format. They are providing it to me via a URI on port 443, which they want me to query using cURL. They have…
Jason
  • 259
  • 3
  • 14
0
votes
1 answer

Trying get the price of products with RCurl

Im scrapping the price of some products from a website . In Python I used the urllib2 without problems, but when I tried using RCurl in R I couldn't donwload the source code. I have to paste the source code with the product code, then I catch the…
Djongs
  • 48
  • 3
0
votes
1 answer

Is there a possibility to pass (binary) raster data directly to a spatial object?

I use getBinaryURL of curl packet to receive raster data (png, tiff, ...) from the web and save data to disk. This raster data is later used for spatial analysis where I currently use raster (and rgdal) packet to load raster data and create a raster…
0
votes
2 answers

Installing R package from command line

I am having real trouble installing couple of packages but the root cause is mainly missing libraries. I will list one example here. inside R-2.15.2 install.packages("RCurl") /usr/share/R/include/Rinternals.h:676: note: expected 'const char *' but…
Abhi
  • 6,075
  • 10
  • 41
  • 55
0
votes
2 answers

How to get the data with RCurl?

I want to get data with Rcurl, when I downloaded the web, the data I want are not in the file,how can I get it, any clue will be appreciated. require(RCurl) url="http://hk.ishares.com/product_info/fund/holdings/SEHK/2823.htm?ls=true& …
Ff Yy
  • 247
  • 2
  • 7
  • 12
0
votes
2 answers

Converting Twitter Stream JSON to R dataframe

I have a text file in JSON format that I downloaded using code from this link. It looks something like this: "{\"contributors\":null,\"coordinates\":null,\"in_reply_to_user_id\":null,\"truncated\":false,\"text\":\"'ello…
screechOwl
  • 27,310
  • 61
  • 158
  • 267
-1
votes
1 answer

Using RCurl with multiple quotes and parentheses

I am trying to get this API (that works in shell) to work within R: curl -H 'Content-Type: text/json' -d '{"Symbols":["FLDB","APOE"]}' https://toppgene.cchmc.org/API/lookup I followed this example and wrote this R…
user2167741
  • 277
  • 1
  • 10
-1
votes
1 answer

How do I get extract a table from an HTML Page as a data.frame using XML and Rcurl in R

I need to extract a table as a data.frame from the following HTML Page: https://www.forbes.com/powerful-brands/list/#tab:rank.html
Roy Sudip
  • 1
  • 1
-1
votes
2 answers

Using download.file to download a zip file from URL in R

I am trying to use download.file to extract a zip file from a URL and then push all the data in each of the files into a MySQL database. I am getting stuck in the first step where I use download.file to extract the zip file I have tried the…
Sushanta Deb
  • 529
  • 8
  • 20
-1
votes
1 answer

RCurl postForm with url encoded names

I am trying to submit a postForm request using RCurl from the following website, however the form attribute names are in a format that does not seem to be readable with the function because it uses brackets and single quotations. url =…
SteveM
  • 213
  • 3
  • 13
-1
votes
1 answer

R Error in reslist$subjects[[1]] : subscript out of bounds

I want to acquire the ranking score of some movies, and not knowing how to fix the problem with "subscript out of bounds". Here is my code. movieScoreapi <- function(x) { api <- "https://api.douban.com/v2/movie/search?q={" url <- paste(api, x, "}",…
victordongy
  • 325
  • 2
  • 4
  • 13
1 2 3
48
49