Questions tagged [pmap]

161 questions
1
vote
1 answer

Control the order of pmap output in R

I have a lot of statistical models to run and I am trying to use pmap to loop over the variable names needed for each model. I want to return the model summary along with extra information about each model. I'm able to run the models and return…
1
vote
1 answer

Julia pmap- writing to array

Can you please point me to a code using pmap that iterates over columns of an array writing to it complex structures that are not bit type objects? I understand that SharedArray has the limitation of requiring bit-type elements. Thanks,
1
vote
1 answer

Remove NA elements from column of vectors using dplyr

I am trying to merge columns into one column, I've combined them using pmap. Some columns have NAs, I'd like to remove the NAs from the combined column col_comb and leave the other values. df = tribble(~id, ~col1, ~col2, ~col3, 1, "a",…
1
vote
1 answer

pmap function in R

the following code for this sample dataset worked around until October 2020. Please note that this is a sample and I have vast data set. However, when I run it now it does not…
Sharif
  • 163
  • 1
  • 9
1
vote
1 answer

create a list of dataframes using purrr to select columns

These are my data: set.seed(1234321) # Original dataframe (i.e. a questionnaire survey data) answer <- c("Yes", "No") likert_scale <- c("strongly disagree", "disagree", "undecided", "agree", "strongly agree") d1 <- c(rnorm(10)*10) d2 <- sample(x =…
Scipione Sarlo
  • 1,470
  • 1
  • 17
  • 31
1
vote
3 answers

Get arguments supplied to a purrr::pmap call

I'm running a function with many arguments and I'm exploring how changes in some arguments affect the output of the function. I'm doing that through purrr::pmap. I'd like to keep track of the arguments used for each function call: I'd like the…
Ben
  • 429
  • 4
  • 11
1
vote
0 answers

Proving that an executable running many times using shared objects is working correctly and using less memory that statically linked version

I have a binary file for a program written in C/C++ that will be run many times on the same server (Linux CentOS 7, x64) in order to simulate a load test on a remote server. The executable can be either statically linked (.a) or dynamically linked…
hallio
  • 39
  • 2
1
vote
2 answers

Distributed Julia: parallel map (pmap) with a timeout / time limit for each map task to complete

My project involves computing in parallel a map using Julia's Distributed's pmap function. Mapping a given element could take a few seconds, or it could take essentially forever. I want a timeout or time limit for an individual map task/computation…
1
vote
0 answers

IBrokers: Looping through a dataframe of endDateTime and twsEquity parameter pairs for reqHistoricalData in r

I am having some difficulty get the following reqHistoricalData request in IBrokers to work. I am try to feed a data frame of date time and stock tickers pair to retrieve the intraday tickers at 5 minute intervals for historical research. I am…
Dan Mack
  • 11
  • 4
1
vote
2 answers

error in a pmap Error in UseMethod("filter_") : no applicable method for 'filter_' applied to an object of class "character"

I have written a function that is working fine when I enter the input variables as data frames. But then when I want to use pmap to enter the inputs as a list of data frames I get the following error: Error in UseMethod("filter_") : no applicable…
Zanboor
  • 33
  • 7
1
vote
0 answers

Why pmap(fib,array) results in type instability when map(fib,array) is type-stable?

I am playing with pmap, but noticing that it transforms my type-stable Fibonacci function (recursive version) in type unstable.. wondering why and if there is something wrong I am doing: julia> using BenchmarkTools julia> using Distributed julia> a…
Antonello
  • 6,092
  • 3
  • 31
  • 56
1
vote
1 answer

R: Why is pmap not working while map2 does?

I am fairly new to R and am teaching myself some machine learning techniques. Currently I am working on hyperparameter tuning and to get a better understanding of the matter I try to do the tasks more manually than they need to be. So I am using a…
francesco
  • 105
  • 1
  • 4
1
vote
1 answer

Using pmap in Clojure to parallelize merge sort. Program hangs at the end for ~1minute, before terminating

I am writing a program in Clojure that takes input from a text file 10000.txt (this has 10k, unsigned integers.) I then pass that list into my merge sort functions (a sigle thread, 2,4,8,16,32 threads). When I run the program, by typing "clojure…
Spencer Apel
  • 31
  • 2
  • 11
1
vote
1 answer

R - Using purrr::pmap() for row-wise iteration

I am trying to understand how pmap works. The tibble below contains a list-column values. I would like to create a new column New that depends on whether or not the corresponding elements in the values column are NULL. Since is.null is not…
user51462
  • 1,658
  • 2
  • 13
  • 41
1
vote
1 answer

SharedArrays and data movement across processes in Julia

I am trying to understand whether data of SharedArray type is being moved across processes and therefore causing overhead. After defining the variables in my Main module (process 1), I called pmap on Array (im1) and SharedArray (im1_shared) versions…
duls91
  • 11
  • 2