Questions tagged [revoscaler]

questions relating to the RevoScaleR package for R from Microsoft.

RevoScaleR is a (free but closed-source) machine learning package in R created by Microsoft. It is available as part of Machine Learning Server, Microsoft R Client, and Machine Learning Services in Microsoft SQL Server 2016.

27 questions
5
votes
1 answer

Logistic Regression in R: glm() vs rxGlm()

I fit a lot of GLMs in R. Usually I used revoScaleR::rxGlm() for this because I work with large data sets and use quite complex model formulae - and glm() just won't cope. In the past these have all been based on Poisson or gamma error structures…
Alan
  • 619
  • 6
  • 19
5
votes
1 answer

revoScaleR::rxGlm() Question in R - GLM Residuals

I might not find an answer here because I don't think the revoScaleR package is widely used. If I create a GLM using rxGlm() it works fine. However the model residuals available via rxPredict() seem to just be the "raw" residuals, ie observed value…
Alan
  • 619
  • 6
  • 19
3
votes
1 answer

Shortening Length of Function Calls in R - revoScaleR rxGLM()

I'm using R to create some GLM models on a large data set at the moment. Because of its size I'm using the rxGlm() function in the revoScaleR package - it runs a lot faster than the basic glm() function. I'm keeping all of the function calls in an R…
Alan
  • 619
  • 6
  • 19
1
vote
0 answers

Transforming columns in xdf files

Kindly advise on this code to transform a column, "Rate" into a factor named "Home_new" rxDataStep(RED_xdf, RED_xdf, transforms = list(Home_new = factor(Rate)) What did i do wrong?
St. Linus
  • 11
  • 1
1
vote
1 answer

RStudio not loading RevoScaleR on Ubuntu 16.04

Long story short: Calling rxImport() works fine in a Terminal R session but fails when using RStudio, despite using the same installation of R. Setup: I'd like to use RevoScaleR functions like rxImport(...) on Ubuntu. I have an installation of…
Dedalus
  • 340
  • 2
  • 10
1
vote
0 answers

Azure / R-server - head causes process to hang

I'm trying to use the head command for an hdfs data set in Azure using R-server via RStudio. This has worked in the past but in the last 2 days it seems like it's stopped working. When I execute it, it tells me the process has started running but…
screechOwl
  • 27,310
  • 61
  • 158
  • 267
0
votes
0 answers

Error in unserialize(rx_model): read error

I've created a model in R, published into SQL Server table and validated the model by calling it into SQL Server. However, I am failing to execute model stored procedure in SQL server. I get this error message: Msg 39004, Level 16, State 20, Line…
adey27
  • 439
  • 3
  • 19
0
votes
0 answers

rxLinMod and lm() are not consistent. Why is one of the coefficients being dropped?

I have been trying to fit a linear regression on different sets of values and I found something a bit odd. Whenever I try to get a linear regression with the function rxLinMod(), oone of the coefficients gets dropped and whenever I use lm(), this…
mfgg1992
  • 1
  • 2
0
votes
0 answers

GLMs in R - large data sets/complex model formulae

I use R to fit a lot of GLMs on medium-large data sets. Typically 500k-1M rows and up to 50 factors in my models (prior to simplification - banding or dropping factors that aren't predictive, etc. Base R's glm() doesn't seem to cope well with this…
Alan
  • 619
  • 6
  • 19
0
votes
1 answer

ANOVA problems with revoScaleR::rxGlm() in R

I build lots of GLMs. Usually on large data sets with many model parameters. This means that base R's glm() function isn't really useful because it won't cope with the size/complexity, so I usually use revoScaleR::rxGlm() instead. However I'd like…
Alan
  • 619
  • 6
  • 19
0
votes
1 answer

Problem with shinyapps.io and Microsoft R Client - "rsconnect package out of date"

I'm running RStudio 1.3 and Microsoft R Client 3.5.2 (to give me access to the revoScaleR package) on a Windows 10 PC. I'm now trying to set myself up to share Shiny apps using shinyapps.io so that I can - in future - send various "widgets" to…
Alan
  • 619
  • 6
  • 19
0
votes
1 answer

R Markdown - First Attempt - Strange Error Message

I'm trying to create an R Markdown script for the first time today in RStudio. I have an existing R script which produces lots of graphs, and I'm hoping to use Markdown to produce .pdf files containing these graphs. I started very simple: ```{r} 10…
Alan
  • 619
  • 6
  • 19
0
votes
0 answers

Summary of quantiles with R script in SQL Server + data.table + rxDataStep

I'm running a script in SQL Server that calculates quantiles and a few other "custom" metrics in chunks via rxDataStep. DECLARE @Rscript nvarchar(max) = N' library("data.table") connStr <- "Driver={ODBC Driver 13 for SQL…
KemuFI
  • 23
  • 5
0
votes
1 answer

Reverting to previous ordering of factor after using relevel() and fitting GLM in R

A convoluted question and I'm not sure I'm expressing it as concisely as I could, but... I'm in a position where I want to fit multivariate generalised linear models - and because of the size and complexity of my models I'm having to use rxGlm()…
Alan
  • 619
  • 6
  • 19
0
votes
1 answer

RevoScaleR package for Microsoft R Open 3.5.3

I've tried to install the RevoScaleR package within Microsoft R Open 3.5.3 but I get the message "package ‘RevoScaleR’ is not available (for R version 3.5.3)" which I suppose is clear enough. Is there any way around this? Or will I just have to…
Alan
  • 619
  • 6
  • 19
1
2