Questions tagged [multiprocessing-manager]
88 questions
1
vote
0 answers
How can I update my data in matplotlib.Funcanimation using a variable from another process using multiprocessing manager in Python?
Basically what I want to do is draw a graph in real-time that updates/animates the data that is being shared across multiple processes. I have used Manager from the python multiprocessing module and shared a wave list (that is an array) that is…
deslay
- 46
- 5
1
vote
1 answer
Problems using multiprocessing.manager
I was having some trouble using the manager. I want to have two processes accessing one list, one writing and one reading it. But the data was coming corrupted, so I tried to make an example to post here. Now, I have another problem. I'm passing a…
NicoliHc
- 65
- 6
1
vote
0 answers
How to pass "non-picklable" objects from nested subprocesses back to the main thread in Python
I have a python program that starts a number of processes. And these processes in turn spawn their own subprocesses (nested processes). I like to keep a list of all processes started by either the main or any of the subprocesses, but could not…
Chu Bun
- 513
- 1
- 5
- 17
1
vote
0 answers
How to control number of process open in Python
My main goal is to open 30 child process from the parent process and then open unknown number of new processes from each of those 30 child processes. I am going to call redis for some location data from those new child processes and I am not sure…
O_o
- 1,103
- 11
- 36
1
vote
1 answer
Managed dict of list not updated in multiprocessing when using += operator
Consider the following python code:
from multiprocessing import Process, Manager
class MyClass():
def __init__(self, dic1, dic2):
self.dic1 = Manager().dict(dic1) # Create a managed dictionary
self.dic2 = Manager().dict(dic2) #…
Shinagan
- 435
- 3
- 15
1
vote
0 answers
Connect Flask server with many threads to single server-side thread
I'm have written a python script on a Raspberry Pi that controls a large and somewhat complex piece of hardware. Currently the use interface is a python console. I run the python program, and the can enter commands from the console with input(">…
Tim Vrakas
- 121
- 6
1
vote
1 answer
Share tkinter window object between python processes
Following is the scenario I am dealing with :
There is main process which launches a worker Process using Multiprocessing.Process. The worker process creates tkinter window for rendering.
In case I wish to terminate rendering, I simply do…
maverick9888
- 498
- 6
- 16
1
vote
1 answer
Python IPC with matplotlib
Project description:
Connect existing "C" program (main control) to Python GUI/Widget. For this I'm using a FIFO. The C program is designed look at frame based telemetry.
The Python GUI performs two functions:
Runs/creates plots (probably created…
csandy83
- 31
- 9
1
vote
0 answers
How to Process Serial Data in Parallel from a Single Data Source?
Problem:
I am downloading financial data from a server and processing this data afterwards. I do gather data for multiple stocks at the same time.
I need that the data downloader and the data processer to be processed in parallel (being that the…
joaoavf
- 1,343
- 1
- 12
- 25
1
vote
0 answers
Python Multiprocessing Process causes Parent to idle
My question is very similar to this question here, except the solution with catching didn't quite work for me.
Problem: I'm using multiprocessing to handle a file in parallel. Around 97%, it works. However, sometimes, the parent process will idle…
Nytrox
- 53
- 5
1
vote
0 answers
Python Multiprocessing Manager - Client unable to reconnect
I am running an application which cannot sit and wait the successful/unsuccessful connection to a Python Manager. The client application should try to send some info to the supposedly running server, and in case it fails, another measure is taken.…
luke_16
- 187
- 1
- 1
- 11
0
votes
1 answer
Python - Troubles sharing objects between processes using Manager.list
I am trying to share some images between two Python processes using a Manager().list() object.
I have a main file, where I create and launch the processes:
main.py
if __name__ == "__main__":
set_start_method("spawn")
# creating the list
…
Carlo
- 1,321
- 12
- 37
0
votes
0 answers
Why is reading values from a shared dictionary created with Python multiprocessing's manager much slower than reading from disk
I'm using Python's multiprocessing pool and I created a dictionary using a manager, which the pool will read values from. However, I have encountered an issue where reading values from this dictionary is very slow, even slower than reading from the…
user22143685
- 1
- 1
0
votes
1 answer
Multiprocessing concurrent.futures not update global dict and list
I need your help with multiprocessing to update global dict data.
I use two functions, the first function is to do multiprocessing in the for loop.
the second function is to update global dict data.
after multiprocessing, all the data was not…
vũ kiên
- 1
- 2
0
votes
1 answer
f-string and multiprocessing.Manager dict and list
I am writing this question, because it does not seem like what I am experiencing should be the desired behavior:
The following code is pretty much lifted from the 3.9.16 documentation on multiprocessing.Manager
from multiprocessing import Process,…
tipanverella
- 3,477
- 3
- 25
- 41