0

Something PLINQ style, for example:

var myTimeSeries = from kvp in myOtherTimeSeries.AsParallel() where kvp //etc.
Jorge Thomas
  • 127
  • 5

1 Answers1

0

Deedle does not currently have a parallel implementation of the methods. There are some operations that you could probably parallelize using ordinary Parallel LINQ by accessing the underlying observations (as a sequence of key value pairs):

 var myTimeSeries = 
   (from kvp in myOtherTimeSeries.Observations.AsParallel()
    where /* and some other things */
    select new KeyValuePair<...>(...)).ToSeries();

This might work if you want to do some basic things with the series, but then the overhead of turning the resulting data back into series might actually be more than the gain from the parallelization.

What operations are you trying to parallelize? Perhaps we could include a parallel implementation of some of them in Deedle..

Tomas Petricek
  • 240,744
  • 19
  • 378
  • 553
  • I perform pairwise() operations between Item2 and Item1 where I think it would be a nice advantage for huge variables. I can think of a parallelised "Frame.FromRecords(fromConcurrentDataStructure)". For Big Deedle, may be? =D. Another issue (not the same topic) is the memory limit of 1.3 GB per Variable in .NET (even when I'm on 64 bit using gcAllowVeryLargeObjects...) – Jorge Thomas Nov 30 '15 at 13:48