Questions tagged [snowfall]

Usability wrapper around snow for easier development of parallel R programs.

66 questions
1
vote
2 answers

HTML5 Canvas Falling Confetti / Snow Multiple Objects

I started from this example: http://thecodeplayer.com/walkthrough/html5-canvas-snow-effect I'm trying to add multiple shapes of falling objects. However only the last one I call seems to work. It overwrites the others on screen. The other thing…
paper_robots
  • 251
  • 2
  • 15
1
vote
2 answers

parallel regression in R (maybe with snowfall)

I'm trying to run R in parallel to run a regression. I'm trying to use the snowfall library (but am open to any approach). Currently, I'm running the following regression which is taking an extremely long time to run. Can someone show me how to do…
nathanf
  • 11
  • 2
1
vote
1 answer

sfLapply & apply.rolling on a xts object - Resulting Error: subscript out of bounds

My goal is to map daily return of 5 stocks (a xts object) to a rolling standard deviation of a look back period of 90 days (calculating the SD of the return of the last 90 days) with the same data structure and with fast speed. The approach by using…
Anthony Lei
  • 241
  • 1
  • 9
1
vote
1 answer

R Snowfall Environments issues

I am trying to get my head around the Snowfall library and its usage. Having writing a simulation that makes use of environments, I encountered the following issue. If I source a file to load functions within the parallel mode, the function seems to…
David
  • 9,216
  • 4
  • 45
  • 78
1
vote
1 answer

sfInit() snowfall package in R hangs on Windows 7

I have been trying to follow some guides for utilizing all (4) of my processors on my work machine running Windows 7. They all suggest the snowfall() package. However when I run the following code, R runs until I terminate it. In other words, R…
Liz Young
  • 408
  • 5
  • 17
1
vote
1 answer

parallel processing in R using snow

I have 1000's of list and each list has multiple time series. I would like to apply forecasting to each element in the list. This has became an intractable problem interms of computing resources. I don't have backgrounder in parallel computing or…
forecaster
  • 1,084
  • 1
  • 14
  • 35
1
vote
1 answer

Error in running sfLapply in R

My piece of code looks like: x<- c(1,2,3,4,5) library(snowfall) f1<- function(a,list){ f2<-function(b,num){ return(abs(num-b))} l1<-sfLapply(list, f2, num=a) l1<-sum(unlist(l1)) return(l1) } sfInit(parallel=TRUE,cpus=4) l2<-(sfLapply(x,…
jackStinger
  • 2,035
  • 5
  • 23
  • 36
1
vote
1 answer

How can I directly pass a process from local R to an Amazon EC-2 Instance?

I've been looking into running R on EC2, but I'm wondering what the deal is with parallel/cluster computing is with this setup. I've had a look around but I haven't been able to find a tutorial for this. Basically what I'm looking to do is have R…
Ger
  • 754
  • 1
  • 9
  • 33
1
vote
0 answers

Snowfall sfApply() is slower than apply()

I am new to multicore in R and is trying out the snowfall package to test if it is possible to speed up the apply function. Not sure what went wrong but my multi-core implementation of sfApply() is always about 2 times slower than the apply() Any…
0
votes
0 answers

Internal MPI error when initializing cluster with type 'MPI'

In R/snowfall, when initialize cluster with type 'MPI', it show error message. Anyone can help? Thanks! library(snowfall) library(Rmpi) sfInit(parallel=TRUE,cpus=3,type='MPI') sfStop() When run sfInit(parallel=TRUE,cpus=3,type='MPI') , the error…
anderwyang
  • 1,801
  • 4
  • 18
0
votes
1 answer

Error in setDefaultClusterOptions(type = .sfOption$type) :could not find function "setDefaultClusterOptions"

I'm new here. I've been struggling with analysing some data with the BaSTA package, the data works ok after running the "Datacheck" code , but right after running the following code this happens: multiout <- multibasta(object = datosJ, studyStart =…
0
votes
1 answer

Results of parallelization with snowfall library not reproducible?

Each time I run the following code, the numbers in the vector result_seq remain the same, since I have used set.seed(11) before generating the vector. However, it seems that even though I use set.seed(11) again before I generate the numbers in…
sonicboom
  • 4,928
  • 10
  • 42
  • 60
0
votes
0 answers

My functions in R package using Rcpp and snowfall are slower than not in the package

I am developing an R package that uses mainly Rcpp, RcppArmadillo and snowfall (for parallel computing). It passed both `devtools::check' and 'devtools::check_rhub()'. However, I noticed that my code is slower in the package and would like to close…
Joseph Yu
  • 133
  • 1
  • 2
  • 8
0
votes
1 answer

Parallelize R code using snowfall package

I am trying to run my R code in parallel. Following is the toy example in which myfunc function returns a number. library(snowfall); sfInit(parallel=TRUE,cpus=5) a <- 1 : 10000 sfExport("a") parwrapper <- function(i){ mysimulation <-…
Hello
  • 61
  • 1
  • 9
0
votes
0 answers

Exporting function with snowfall

I am currently developing an R package and would like to make use of parallelization with the package snowfall. I'd like to call a function (actually an Rcpp wrapper if this matters) from the package itself, so the function is currently not floating…
Louki
  • 215
  • 1
  • 12