Questions tagged [parallel-collections]
50 questions
0
votes
1 answer
Updating an Array via Scala Parallel Collections
I have this array of HashMap defined as below
var distinctElementsDefinitionMap: scala.collection.mutable.ArrayBuffer[HashMap[String, Int]] = new scala.collection.mutable.ArrayBuffer[HashMap[String, Int]](300) with…
MV23
- 285
- 5
- 17
0
votes
0 answers
How to limit the number of threads available to a scala/akka app
I wrote an application that uses scala parallel collections and akka actors, and I would now like to study its "strong scaling" properties, i.e. how the running time for a given problem instance changes, as a function of the number of cores/threads…
mitchus
- 4,677
- 3
- 35
- 70
0
votes
1 answer
Parallel processing in Scala 2.9
Suppose I have an array of ~10K elements and I need to process all elements of the array. I would like to process them in such a way that only K elements are processed in parallel.
I use Scala 2.9. I tried parallel collections (see below) but I saw…
Michael
- 41,026
- 70
- 193
- 341
0
votes
1 answer
Replacement for setMaximumPoolSize on ForkJoinPool
I noticed that since Scala 2.9.*, the setMaximumPoolSize method appears to have disappeared from ForkJoinPool and it looks like it does what I want. Most discussion of limiting parallelism in Scala's parallel collections centers around the…
Mysterious Dan
- 1,316
- 10
- 25
-1
votes
2 answers
Attemping to parallelize a nested loop in Scala
I am comparing 2 dataframes in scala/spark using a nested loop and an external jar.
for (nrow <- dfm.rdd.collect) {
var mid = nrow.mkString(",").split(",")(0)
var mfname = nrow.mkString(",").split(",")(1)
var mlname =…
jymbo
- 1,335
- 1
- 15
- 26