Questions tagged [pynsq]

PyNSQ is the official Python client library for NSQ.

PyNSQ is the official Python client library for NSQ.

NSQ is a realtime message processing system designed to operate at bitly’s scale, handling billions of messages per day.

It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee.

Operationally, NSQ is easy to configure and deploy (all parameters are specified on the command line and compiled binaries have no runtime dependencies). For maximum flexibility, it is agnostic to data format (messages can be JSON, MsgPack, Protocol Buffers, or anything else). Go and Python2 libraries are available out of the box.

Questions can also be posted to the nsq-users Google group.

Bugs can be filed on GitHub.


9 questions
1
vote
0 answers

pynsq: Giving up RDY count

WHAT: Could someone help me understand what this error message means. nsqadmin shows a lot of the messages being requeued / timed out on . Could these logs be the reason? I am using pynsq 0.4.2 STACKTRACE 2013-07-30 13:34:18,827 DEBUG…
Sagar Hatekar
  • 8,700
  • 14
  • 56
  • 72
0
votes
0 answers

How can I read messages from NSQ channel with aiohttp application

There is a good library pynsq, it uses tornado inside, so for example when I create simple tornado app, then there I can instantiate nsq.Reader instance, then when I start tornado server, this nsq.Reader() instance starts to work. In case when I…
0
votes
1 answer

What is _DEFAULT_CA_CERTS in pynsq and tornado

I'm getting this error: But I can't figure out what _DEFAULT_CA_CERTS is nor how to resolve this problem. Any thoughts would be greatly appreciated!
Bismo Funyuns
  • 73
  • 1
  • 7
0
votes
0 answers

How to read and process NSQ messages with existing Flask application properly?

So my problem is: I have existing Flask application that has several Celery periodic tasks (so Flask app running and Celery workers for process tasks are running). Now in our infrastructure appears NSQ and 3rd application that pushes messages to…
0
votes
1 answer

Avoiding message timeout in pynsq

For example, I send a message to NSQ by issuing: curl -d "test2" http://127.0.0.1:4151/pub?topic=hello I've found that if message handler execution takes longer than 100 second, it will throw and this message will be timed…
0
votes
1 answer

Is Nsqjs really slow compared to Pynsq?

I have the following code in javascript var nsq = require('nsqjs'); var reader = new nsq.Reader('output', 'out', { lookupdHTTPAddresses: '172.32.10.224:4161' }); reader.connect(); reader.on('message', function (msg) { console.log('Received…
user1870400
  • 6,028
  • 13
  • 54
  • 115
0
votes
1 answer

pynsq: Reader object has no attribute 'finish'

This error occurs on pynsq 0.4.2 STACKTRACE 2013-07-30 15:03:43,205 ERROR [ip-10-114-195-89:4150:nsq_msg_handler] failed to handle_message() Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/nsq/Reader.py", line…
Sagar Hatekar
  • 8,700
  • 14
  • 56
  • 72
0
votes
1 answer

pynsq: backing off for 'n' seconds

WHAT I am consuming messages from a NSQ server using 4 consumers. I am trying to debug the reason why I see the backing off logs as my consumers slow down when this happens. I am logging exceptions and that's when I return a False to requeue the…
Sagar Hatekar
  • 8,700
  • 14
  • 56
  • 72
-1
votes
1 answer

After nsq.run() my python script is not executing block of code in "pynsq" package

I am trying to use "pynsq" package (message broker service) to my django project. but when i run the Asynchronous consumer request using nsq.Reader() class by using nsq.run() command it takes my main thread and my code after this command is not…