Stack Overflow
Stack Overflow

Questions tagged [nsq]

NSQ is a realtime message processing system designed to operate at bitly’s scale, handling billions of messages per day.

NSQ is a realtime message processing system designed to operate at bitly’s scale, handling billions of messages per day.

It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee.

Operationally, NSQ is easy to configure and deploy (all parameters are specified on the command line and compiled binaries have no runtime dependencies). For maximum flexibility, it is agnostic to data format (messages can be JSON, MsgPack, Protocol Buffers, or anything else). Go and Python libraries are available out of the box.

Questions can also be posted to the nsq-users Google group.

Bugs can be filed on GitHub.

59 questions
1
vote
0 answers

pynsq: Giving up RDY count

WHAT: Could someone help me understand what this error message means. nsqadmin shows a lot of the messages being requeued / timed out on . Could these logs be the reason? I am using pynsq 0.4.2 STACKTRACE 2013-07-30 13:34:18,827 DEBUG…
Sagar Hatekar
  • 8,700
  • 14
  • 56
  • 72
0
votes
0 answers

Setting Up Nsq - ASP.net

I am trying to set up nsq and broadcast a message to address=127.0.0.1:4161 but the message is not going through. nsqd , nsqadmin and nsqlookup - are these services are up and running. on starting the nsqlookup for the confugured topic , i am…
Ankit K
  • 1
  • 1
0
votes
1 answer

Can I use nsq_to_file uitility with docker compose?

I work with nsq_to_file utility while running some automation code, I wanted to automate that utility as a docker-compose service. I can't find any documentation about using this utility with docker. I use it as follows: ./nsq_to_file…
Youssef Zahran
  • 1
0
votes
1 answer

How to do nsqd load balancing with its sticky connections?

I have a golang microservice project in kubernetes environment, that is running several nsqd-0, nsqd-1, ... pods, which are controlled by its statefulSet and grouped under nsqd service. The problem is when I want to make a producer, i import…
xakepp35
  • 2,878
  • 7
  • 26
  • 54
0
votes
1 answer

Attempt to reconnect to NSQ after clean close

I've created an NSQ producer in my Go microservice and I'm trying to create a method for it to attempt to reconnect after an NSQ restart. I've looked into the nsq config documentation hoping to see if I could provide a failover method on…
Jamie Belcher
  • 123
  • 2
  • 13
0
votes
1 answer

How to get a return value of a function in python

import gnsq class something(): def __init__(self, pb=None, pk=None, address=None): self.pb = pb self.pk = pk self.address = address def connect(self): consumer = gnsq.Consumer(self.pb, 'ch', self.address) …
swoopy
  • 326
  • 4
  • 18
0
votes
1 answer

depth of channel showing in nsqadmin increasing fast when producer send message to same topic via different nsqd

I play with nsqd a little bit and met the prob mentioned in the title. But when I send message via single nsqd, there is no such prob. Does this mean message should always be sent via same nsqd? Here is my project.…
hoozecn
  • 497
  • 4
  • 14
0
votes
1 answer

cannot connect to nsqd from another service defined in docker-compose file

I have a service connecting to nsqd to produce and consume messages. I have integration tests connecting to it (broadcast address 127.0.0.1) and this works fine executing it locally in the cli or the ide. Then I have created this service to up with…
hosseio
  • 1,142
  • 2
  • 12
  • 25
0
votes
1 answer

NSQD in docker compose

How should nsqd be used in a live microservices docker environment? Should we run nsqd in its own docker container or should each container that runs a producing service also contain an instance of nsqd? I've not managed to find any examples of how…
Paul
  • 144
  • 1
  • 6
0
votes
0 answers

Set IP address and port of Nsqlookupd in docker compose file

Is there a way to manually set the lookupd connection of the NSQd Node in the docker compose file through the command: \nsq? Below is the docker-compose file provided by nsq version: '3' services: nsqlookupd: image: nsqio/nsq command:…
vaughn ellis ramos
  • 29
  • 7
0
votes
1 answer

Ruby nsq how to listen for new messages

My setup is as follows: 1 Microservice that receives a request and writes a message in the queue(nsq) and a second microservice that must read the messages in the queue and do something based on them. I am new to the nsq concept in ruby on rails. I…
Lucian Tarna
  • 1,806
  • 4
  • 25
  • 48
0
votes
1 answer

Avoiding message timeout in pynsq

For example, I send a message to NSQ by issuing: curl -d "test2" http://127.0.0.1:4151/pub?topic=hello I've found that if message handler execution takes longer than 100 second, it will throw and this message will be timed…
jinze huang
  • 31
  • 3
0
votes
0 answers

Config nsq.io with public IP

I am using http://nsq.io/ for pub/sub in our system. Currently, we just use Nsq.io for local server only, I public a message use localhost as: $ curl -d "" http://127.0.0.1:4151/pub?topic=name I plan to use Nsq.io in public server…
Ha Doan
  • 611
  • 6
  • 20
0
votes
1 answer

Temporary NSQ Channels

I have nodes that need to connect to NSQ, they need to get all the messages for that topic. To do this, they each create a channel. I am wondering if there is a way for nsqd to clean them up after the consumers have been disconnected?
Vitaly Babiy
  • 6,114
  • 4
  • 26
  • 24
0
votes
1 answer

why nsqlookupd package use Context?

When I read the nsqlookupd part of nsq source code, I found that the author used a Context truct to wrap a NSQLookupd struct and no other funcs for Context.I don't know why we use it this way, what benefits we can get by this way? The source code…
关力宁
  • 1
1 2
3
4