Questions tagged [pool]

A pool describes a cache of resources that an application can draw from to save instantiation time.

Pools typically refer to database connections but the term can be applied to graphics handles, files and other run-time processes. When the use of such a resource is complete but the application is still running, it will typically return the resource to the pool rather than release it.

1504 questions
3
votes
1 answer

multiprocessing with textacy or spacy

I am trying to speed up processing of large lists of texts via parallelisation of textacy. When I use Pool from multiprocessing the resulting textacy corpus comes out empty. I am not sure if the problem is in the way I use textacy or multiprocessing…
Diego
  • 812
  • 7
  • 25
3
votes
3 answers

Worker process taking high CPU%

All of my websites are hosted in IIS and configured with one application pool. This application pool consists 10 websites running. It is working fine till today, but all of sudden I am observing that there is sudden up and down % in CPU usage. I am…
max
  • 31
  • 1
  • 2
3
votes
1 answer

Python multiprocessing using pool.map with list

I am working on python code using multiprocessing. Below is the code import multiprocessing import os def square(n): #logger.info("Worker process id for {0}: {1}".format(n, os.getpid())) logger.info("Evaluating square of the number…
sudhir
  • 219
  • 5
  • 17
3
votes
1 answer

uma_zalloc and uma_zfree are thread safe in freebsd kernel space?

I have two threads which in both of them I use uma_zalloc() and uma_zfree() functions for the one variable of uma_zone_t. I want to know uma_zone_t is thread safe or not?
3
votes
1 answer

Is there any options to define specific time limit to dbGetQuery

This for R, DBI package. Is there any options or parameters to limit the SQL query time. couldn't find any options from dbConnect(drv, ...) dbGetQuery(conn, statement, ...) pool package provides idleTimeout options, but couldn't find options or…
Kg211
  • 132
  • 1
  • 7
3
votes
0 answers

Multiprocessing Pool Not Mapping

I am attempting to create Pool() objects, so that I can break down large arrays. Though, each time after the first I run through the below code, the map is never run. Only the first pass seems to enter the function, though the arguments are the same…
3
votes
1 answer

Using pool for multiprocessing in Python (Windows)

I have to do my study in a parallel way to run it much faster. I am new to multiprocessing library in python, and could not yet make it run successfully. Here, I am investigating if each pair of (origin, target) remains at certain locations between…
mah65
  • 578
  • 10
  • 20
3
votes
1 answer

Multiprocessing Pool.apply executing n-1 times

Im having an issues with multiprocessing.Pool.apply. My objective is to have 5 processes, each filling an array with 100 elements (100 for this test), and then merging then arrays into a single one with length 500. Problem is, it ends up with only…
chibi
  • 33
  • 3
3
votes
1 answer

How to terminate a python multiprocess pool early

I've recently started poking around at the multiprocessing module and find the pool.map function very useful for parsing a large array very quickly. Is there a way to terminate a pool early however? Lets say I have a huge list and I want to find a…
BobserLuck
  • 401
  • 1
  • 3
  • 13
3
votes
1 answer

How to close/quit Selenium Chrome drivers that were spawned from multiprocessing.Pool?

I have a list of article titles and ids that are used to generate the urls of the articles and scrape the contents. I'm using multiprocessing.Pool to parallelize the work. Here's my code: from selenium import webdriver from…
3
votes
2 answers

Shall I pool CUDA streams?

How lightweight are operations for creating and destroying CUDA streams? E.g. for CPU threads these operations are heavy, therefore they usually pool CPU threads. Shall I pool CUDA streams too? Or is it fast to create a stream every time I need it…
Serge Rogatch
  • 13,865
  • 7
  • 86
  • 158
3
votes
1 answer

purging the boost::pool_allocator for a std::map does not return the whole pool in VS2017

When I run the next code in VS2017: #include #include #include int main() { using Map = std::map, boost::pool_allocator>>; using Pool =…
JHBonarius
  • 10,824
  • 3
  • 22
  • 41
3
votes
3 answers

Python 3 Multiprocessing Pool

I'm learning to use pool with multiprocessing. I did this script as an exercise. Can anyone tell me why using a normal for loop took less time than using a pool? P.S: My CPU has 2 cores. Thank you very much. from multiprocessing import Pool from…
max fraguas
  • 438
  • 1
  • 6
  • 12
3
votes
1 answer

Python multiprocessing pool apply_async error

I'm trying to evaluate a number of processes in a multiprocessing pool but keep running into errors and I can't work out why... There's a simplified version of the code below: class Object_1(): def add_godd_spd_column() def…
WRJ
  • 617
  • 3
  • 9
  • 19
3
votes
1 answer

Oracle UCP performance issue during binding variables

Recently we change our connection pool to migrate for Oracle UCP. Before the migration, we used the pool embeded with the oracle jdbc driver (ojdbc6.jar). Our problem is the elapsed time during the phase of the bind variables. With UCP, the time to…