Questions tagged [message-queue]

"Message queue" is a design pattern or software engineering component that defines discipline or API for communication between two or more interrelated processes or systems. The message queue enforces asynchronous processing and loose coupling. Depending on the implementation they may also provide delivery and order guarantees of the messages. Message processing guarantees are explicitly excluded from the design.

Message queue design pattern introduces an intermediary between the producer of messages and its consumer(s). This intermediary - the queue - accepts the messages and stores them until a consumer retrieves them or until some other event (e.g. expiration time). In general the producer does not know or care where, how, and when the messages in the queue will be consumed.

Software components such as MSMQ or IBM MQ or Tibco (usually called Queue Managers) provide queue storage and features for manipulation of messages in queues. These manipulations include: expiration, persistence, notification of expired messages (dead-letter queues), message cloning, queue security, distribution (between multiple Queue Managers).

This tag is best used for cross-platform message queuing questions. For questions about specific products, use or include the tag for that product:

3929 questions
1
vote
0 answers

Is Kafka a Message Queue or a Message Broker?

After going through a couple of articles explaining the difference between Message Queues and Message Brokers, I'm quite confused as to whether Kafka is a Message Queue or a Message Broker. The main difference that I know is that Message Queue offer…
1
vote
2 answers

Asynchronous Message Queue on Cluster

I've a site which in some cases use Message Queue asynchronously. The method which sends the message returns its id. Then I make an AJAX call to get the response for the message with the saved id. This works great, but now the site is going to be on…
Diego
  • 16,436
  • 26
  • 84
  • 136
1
vote
1 answer

Re-queue item for QueueTrigger if condition is not met

I have a queue trigger function that looks like this: [FunctionName(nameof("MyQueueFunction"))] public async Task Run([QueueTrigger("queue")] Model model, ILogger logger) { if (model.ID == 0) { // Ignore message in the queue for now …
William Troup
  • 12,739
  • 21
  • 70
  • 98
1
vote
1 answer

Does NNG(Nano Message Next Generation) automatically transmit some heartbeat periodically?

I'm using NNG as my inter-server msg-queue. Background: I'm implementing a pair of long time background services, those are communicating with NNG; Protocol: pair0 @ tcp; The payload message occurs maybe a second, or maybe a day; My question: Does…
Leon
  • 1,489
  • 1
  • 12
  • 31
1
vote
1 answer

Batch fetching from JMS queue

I need to implement the following workflow: Every N milliseconds fetch all available messages from JMS queue, but not more than K items Do some processing Acknowledge all of them once processing is done I'm interested in how to implement step #1…
dbf
  • 6,399
  • 2
  • 38
  • 65
1
vote
1 answer

communication between dash and another thread using a queue

I've written a program that periodically receives and processes geographic data. I'd like to plot the (latitude, longitude) pairs that are generated by that program in a dash app providing a plotly Scattergeo plot, more or less as the data comes…
Jonathan W.
  • 135
  • 1
  • 9
1
vote
1 answer

Problem linking to with Android.mk

I am writing a C program for use on the android command line. I haven't had any issues compiling until I started using message queues and including linux/msg.h (or sys/msg.h). I am not sure what the right library to link to is or even how to do it…
peter
  • 6,067
  • 2
  • 33
  • 44
1
vote
1 answer

basicNack and basicReject in RabbitMQ

1.what is mean by message in bulk in basicNack The AMQP 0-9-1 specification defines the basic.reject method that allows clients to reject individual, delivered messages, instructing the broker to either discard them or requeue them. Unfortunately,…
1
vote
1 answer

Karate api test: TestRunner.testParallel:15 Multi threaded access requested by thread Thread[pool-1-thread-1,3] but is not allowed for language(s) js

Testing api with Karate: mocks and queue implementation: Error TestRunner.testParallel:15 Multi threaded access requested by thread Thread[pool-1-thread-1,3,main] but is not allowed for language(s) js. is produced when try to consume a queue with…
1
vote
1 answer

Generating AWS SQS signature from java

I need to get message from AWS SQS with using Spring RestTemplate(binded a proxy), instead of aws sdk or spring cloud aws messaging, because of some proxy problem of the company. I need to generate a header string includes Authorization signature…
1
vote
0 answers

Kafka consumer : Maximum consumer rate

I am interested in learning/deducing the maximum consumption rate of a Kafka consumer in my consumer group. Maximum consumption rate is the rate at which the consumer can not keep up with the message arrival rate, and hence the consumer will fall…
1
vote
1 answer

Python3.6 is there a erlang style message queue?

I'm looking for a message queue implementation for python 3.6 (this exact version) that can be used to communicate between multiprocess.Processes, specifically, It should be a multiproducer, single consumer, fifo with priority receive of messages of…
Incömplete
  • 853
  • 8
  • 20
1
vote
2 answers

Rabbitmq msg_store_transient of a queue is consuming all disk space

erlang version = 1:24.0.2-1 rabbitmq-server version = 3.8.16-1 Recently installed latest rabbitmq on Ubuntu20. I verified that all was working fine and consumer was consuming the notification from messaging queue as required. After approximately a…
Rajat Jain
  • 201
  • 3
  • 12
1
vote
2 answers

How to perform long event processing in Node JS with a message queue?

I am building an email processing pipeline in Node JS with Google Pub/Sub as a message queue. The message queue has a limitation where it needs an acknowledgment for a sent message within 10 minutes. However, the jobs it's sending to the Node JS…
ask
  • 2,160
  • 7
  • 31
  • 42
1
vote
1 answer

Out of box distributed job queue solution

Are there any existing out of the box job queue framework? basic idea is someone to enqueue a job with job status New (multiple) workers get a job and work on it, mark the job as Taken. One job can only be running on at most one worker something…
dengying
  • 31
  • 1
  • 3