Use this tag for questions about Billiard, the fork of the Python 2.7 multiprocessing package. Billiard is a dependency for Celery.
Questions tagged [python-billiard]
11 questions
3
votes
1 answer
How do I properly import Billiard in a python script in order to use Queue?
I know this questions sounds stupid but i'm not finding a solution.
In Billiard's docs all the imports look like:
from multiprocessing import Process, Queue
When I do the import like that, I'm not using billiard but the python in-built…
lembon
- 125
- 7
3
votes
1 answer
Python Multiprocessing: billiard vs multiprocessing
Original problem: using celery task queue, I want the processes in the process pool to use shared CUDA arrays ( i.e. instead of each process having its unique array, I want one array to be accessed by all the processes. This is safe because only…
AgnosticCucumber
- 616
- 1
- 7
- 21
1
vote
2 answers
Data is duplicated three times when inserting in MySQL DB using Multiprocessing package : Billiard
I am running an Airflow job to load data into a table.
The task is :
query a database -> get results in pandas data frame -> pass the result set to a worker processes -> each worker process process the rows and load data into a different…
moe_
- 219
- 2
- 3
- 15
1
vote
0 answers
Error billiard librar. ERROR: "No such file or directory" (Python) (Multiprocessing)
I am using the billiard library with docker (in an ubuntu terminal within windows) and when initializing the object without parameters in the constructor it gives me an error. If instead of billiard I use multiprocessing it does work for me…
Luis
- 133
- 6
1
vote
1 answer
Python : Set the name of a Process from multiprocessing.Process
Is it possible to set the name of the Processes spawned by multiprocessing.Process or billiard.Process. SOmething like:
import billiard
for d in list:
processes.append(billiard.Process(target=evaluate))
for p in processes:
p.name = …
Varlor
- 1,421
- 3
- 22
- 46
1
vote
0 answers
Celery: how to customize multiprocessing pool initialization?
I want processes in the process pool to start with some GPU-allocated
array ( allocating the array on request is too time-costly ).
Is there a way to customize initialization of the pool s.t. every process in the pool has a GPU-allocated array…
AgnosticCucumber
- 616
- 1
- 7
- 21
0
votes
0 answers
airflow using billiard for multiprocessing stuck
I found in answer that can use billiard for multiprocessing in airflow, as python multiprocessing cannot pickle and joblib Parallel can only use threading mode. I tried billiard Pool map. The program just stuck when running this part and no error…
viminal
- 76
- 1
- 5
0
votes
0 answers
How can i shoot my billiard ball to angle which i picked in spinbox
Here is my code simply i want to shoot my ball to direction that i picked from spinbox. I aim with arrow and hit ball with the button Kresli. I will be very grateful if someone can help me with it because there is nothing on internet in this tkinter…
Dominik Spišák
- 1
- 1
0
votes
0 answers
Python multiprocess seems to run same task in different processors
I am using pythons billiard multiprocessing package to run some queries in a postgres db. I have a list with years let's say [2020, 2021, 2022] and a list of queries that take the years in a parametrised where clause. What I do is pass the the list…
Saraki
- 297
- 1
- 7
- 21
0
votes
0 answers
Spider wrapped in Django gets stuck how to stop?
I have a Scrapy spider wrapped in to Django and to start it programatically I am using scrapyscript which uses Billiard queues and Processes to run Scrapy. I know it's a strange setup but I need a spider that can be run by cron and work with django…
Stefan
- 828
- 12
- 24
0
votes
1 answer
No ExceptionInfo being passed to after_return handler in celery
Based on documentation, this handler is supposed to be called after the task returns.
The einfo argument refers to the ExceptionInfo instance, the definition for which is found at http://docs.celeryproject.org/en/3.1/_modules/billiard/einfo.html
I…
user3732361
- 377
- 8
- 13