Node.js Cluster

Question

I am writing an application in Node.js which serves dynamic web pages. I would like this application to scale over multiple CPU cores, so I have decided to use cluster to create a worker for each CPU core.

I also use a 3rd party API which needs to be polled frequently checking for changes, and often needs to be queried and cached based on user input. As there are rate limits on this API, I would like to have a single instance of the API and cache between all workers.

What is the best way to share and communicate with a resource (cache and 3rd party API) between multiple workers? Should I create a separate worker for the resource, or use the master one?

score 1 · Accepted Answer · answered Mar 22 '16 at 05:52

1

As there are rate limits on this API, I would like to have a single instance of the API and cache between all workers.

Ideally you would make these API queries from the master and then use process.send to send them to the workers if you want.

answered Mar 22 '16 at 05:52

basarat

261,912
58
460
511

Users can also request data from the API via the worker threads, so I would need a way to request data from a worker. – user2248702 Mar 22 '16 at 05:56
yup. Just send it down to the workers from the master – basarat Mar 22 '16 at 05:57
But how would I request data from the master? – user2248702 Mar 22 '16 at 06:00

Node.js Cluster

1 Answers1