Questions tagged [snow]

DO NOT USE FOR SNOW ANIMATION.The R package SNOW (acronym for Simple Network Of Workstations) provides a high-level interface for using a cluster of workstations for parallel computations. Use with the [r] tag.

The package snow (acronym for Simple Network Of Workstations) provides a high-level interface for using a cluster of workstations for parallel computations in R.

snow implements an interface to three different low-level mechanisms for creating a virtual connection between processes:

  • Socket
  • PVM (Parallel Virtual Machine)
  • MPI (Message Passing Interface)

The snowfall package provides a more recent alternative to snow. Functions can be used in sequential or parallel mode.

Resources:

127 questions
0
votes
1 answer

How to run a own function with clusterApply several times parallel

I try to run my own function "EMGMM(y, startmy = 0)" with different parameters parallel: require(snow) library(parallel) tasks = list( job1 = function(y) EMGMM(y=y, startmy = 0), job2 = function(y) EMGMM(y=y, startmy = 1), job3 =…
Corben
  • 23
  • 3
0
votes
1 answer

Passing information between threads (foreach with %dopar%)

I'm using doSNOW- package for parallelizing tasks, which differ in length. When one thread is finished, I want some information generated by old threads passed to the next thread start the next thread immediatly (loadbalancing like in…
Marc
  • 238
  • 1
  • 9
0
votes
1 answer

use clusterApply in snow package?

I'm trying to R code with snow package. i have function imp<-function(x,y) how can i use this function in clusterApply ? cl <- makeCluster(c("localhost","localhost"), type = "SOCK") clusterApply(cl, 1:6, get("+"), 3) stopCluster(cl) instead of…
vct
  • 73
  • 1
  • 10
0
votes
1 answer

Identical Results with Rmpi and snowfall

I'm doing analysis on some stuff with queueing system simulations in R and I'm using Rmpi and snowfall to run my program in parallel. Now, my program requires a lot of random number generation so this is especially bizarre. When I run simulations…
user1480248
  • 95
  • 1
  • 7
0
votes
3 answers

R large dataframe conversions in parallel

Essentially I've got a large dataframe: 10,000,000x900 (rows,columns) and I'm trying to convert the class of each column in parallel. The end result needs to be a data.frame Here's what I've got so far: Pretend df is the dataframe already defined,…
Kyle B
  • 21
  • 1
  • 4
0
votes
1 answer

R crashes when exporting a bigmatrix to snow cluster

has anyone here ever had success exporting a bigmatrix to a snow cluster in R? The commented lines in the examples of bigmatrix and attach.resource say that it's possible to do so, but I haven't had success. library(bigmemory) library(snow) z <-…
random_user
  • 820
  • 1
  • 7
  • 18
-1
votes
1 answer

Regressions using Parallel/Multi-core Processes

I am trying to run the following code in R on a Linux cluster. I would like to use the full processing power (specifying cores/nodes/memory). The code below essentially runs predictions based on a GAM regression and saves the results as a CSV file…
shouro
  • 31
  • 7
1 2 3
8
9