Stack Overflow
Stack Overflow

Questions tagged [snowfall]

Usability wrapper around snow for easier development of parallel R programs.

66 questions
0
votes
1 answer

Suppress start-up messages when loading a library to snowfall cluster with sfLibrary

Example of the code I am running below. library(snowfall) library(snow) sfInit(parallel = TRUE, cpus = 3) sfLibrary(raster) Library raster loaded. Library raster loaded in cluster. I want to stop sfLibrary from printing the messages. I can't…
TheRealJimShady
  • 777
  • 3
  • 9
  • 24
0
votes
1 answer

How to use sfInit and makeCluster type "MPI" / message passing in R / parallelization on cluster

I'm trying to adapt this R script for a speed test to work on a cluster. When using the sfInit and makecluster functions with the type "SOCK", then the script runs on the cluster successfully, but without any speed improvement - unlike on my…
GreenPirate
  • 37
  • 8
0
votes
1 answer

Using snowfall package in R to do some simulation

I am staring work with snowfall package in that way: library(snowfall) sfInit(parallel=TRUE, cpus=6, type="SOCK") #loading packages sfLibrary(package = lars) sfLibrary(package=covTest) Function that I want to compute multiple times using…
Math seeker
  • 3
  • 1
0
votes
0 answers

Speeding up ggplot2-plotting for animated plots in big dataset

I built an animated plot using ggplot2 and magick from a large dataset containing tenthousands of entries. Based on my post How to manage parallel processing with animated ggplot2-plot?, I'm now no longer concerned with speeding up the process for…
alex_555
  • 1,092
  • 1
  • 14
  • 27
0
votes
0 answers

parallel with snowfall - local vs remote speed

I am using snowfall for parallel processing on my desktop machine without any problems. I want to use several spare machines in the office to increase speed of the computations and want to distribute the parallel processing over the remote machines.…
Adrian
  • 684
  • 3
  • 20
0
votes
2 answers

CSS3 Snow Fall Animation Disable internal links

I want to using Snow Fall Animation by using CSS3. But when i use css code, my sites most of internal links disabled. Also i can not select any content from site. here my code : body { background-color:#333; } #snow{ background: none; …
fsuuaas
  • 165
  • 7
0
votes
1 answer

How to export a predefined function using snowfall?

I was trying to run some simulations in 4 cores using snowfall package. I have used 'mgcv' library and its 'rmvn' function to simulate some multivariate data within a user defined function. I called snowfall package in another user defined function,…
Hansy Kumaralal
  • 169
  • 3
  • 13
0
votes
0 answers

How can I optimize the cpu usage of R using snowfall?

I was trying to implement fibonacci function using snowfall parallel package in R. Following is the code I used. vec <- 1:37 fib <- function(x) { if (x==0) return(0) if (x==1) return(1) if (x==2) return(2) …
Hansy Kumaralal
  • 169
  • 3
  • 13
0
votes
3 answers

R snowfall : parallel apply on table columns

I have a table M with many columns and rows, obtained from a text file : M <- read.table("text.csv",header=TRUE,sep="\t") To obtain the ranks by columns I successfully used : M <- apply(M,2,rank) I would like to speed up the computation but I did…
Fred
  • 3
  • 2
0
votes
0 answers

How to implement a lock on write.table within snowfall (in R)?

I am trying to have multiple snowfall threads write to the same file using write.table(). In a small number of cases, the rows are broken, i.e I observed that it looks like multiple rows mixed up, which I presume is when two threads try to write to…
jackStinger
  • 2,035
  • 5
  • 23
  • 36
0
votes
0 answers

Web scraping with snowfall fails?

I'm lapplying over a bunch of URLs to get some data out and in this the readLines() command works fine. When I switch to sfLapply the code is unable to read the webpage. Anyone know why? Example below library(snowfall) library(rlecuyer) #…
TheComeOnMan
  • 12,535
  • 8
  • 39
  • 54
0
votes
1 answer

Snowfall effect using css3 on some background image

I have developed web page which is having snowfall effect using CSS3 and it is working fine. Refereed this link : - http://designshack.net/articles/css/make-it-snow-on-your-website-with-css-keyframe-animations/ But I am not able to do it with…
Curious_k.shree
  • 990
  • 2
  • 18
  • 37
0
votes
0 answers

Error to access folder in RStudio server when using snowfall

I am using RStudio server and snowfall. My parallel codes always give me these messages: > sfInit(cpus = 14, parallel = TRUE) > sfLapply(seq(along = trials), nvtPar, file) 23 Nov 2014 11:31:36 [rsession-users] ERROR svn: E070008: Can't read…
Bangyou
  • 9,462
  • 16
  • 62
  • 94
0
votes
1 answer

Turn on all CPUs for all nodes on a cluster: snow/snowfall package

I am working on a cluster and am using the snowfall package to establish a socket cluster on 5 nodes with 40 CPUs each with the following command: > sfInit(parallel=TRUE, cpus = 200, type="SOCK", socketHosts=c("host1", "host2", "host3", "host4",…
mlegge
  • 6,763
  • 3
  • 40
  • 67
0
votes
1 answer

R: quickly match records based on custom distance function and multiple criteria

I made some functions in R to match up chemical mass spectra (a matrix with two columns with integer masses and intensities) to libraries of such spectra based on a custom spectral similarity function and matching of the so-called retention index of…
Tom Wenseleers
  • 7,535
  • 7
  • 63
  • 103
1 2 3
4
5