Questions tagged [consumer]

649 questions
0
votes
0 answers

Read From Kafka using Node and franz-kafka module

I try to read from Kafka using Node and franz-kafka module. I have followed the example at https://www.npmjs.com/package/franz-kafka. I have produced something like the following: var Kafka = require('franz-kafka') var kafka = new Kafka({ …
theShadow89
  • 1,307
  • 20
  • 44
0
votes
3 answers

Is it possible to write kafka consumer received output to a file using java

I have a Kafka Producer code written in java that writes kafka messages. And a consumer code that receives these messages. Is it possible to write theses received messages by consumer to any text file in java.
pratik dhamanekar
  • 113
  • 1
  • 2
  • 9
0
votes
1 answer

Producer-Consumer in C++11

I've begun learning about thread manipulation, and have begun with a simple program meant to generate random capital letters. The letters are randomly generated and added to a char array through the producer, and any added are outputted as…
T145
  • 1,415
  • 1
  • 13
  • 33
0
votes
1 answer

RabbitMQ prefetch ignored when consumer is Down and gets Up

I'm getting my basicQos ignored when consumer is down and, after, consumer gets up. For instance, suppose that consumer is down and 5 messages arrives from a producer. If consumer is not running, these messages will be stored in disk (I think!) if…
0
votes
0 answers

Multi-threading only-one to consume pattern

I'm trying to optimize the following snippet: lock() if (!consumed) { consume() consumed = true } unlock() Obviously, only the first one to come will execute the consume() function. Any later one will become no-op but in this case, they will…
w00d
  • 5,416
  • 12
  • 53
  • 85
0
votes
1 answer

Kafka consumer , able process tons of messages

In general case Kafka consumer could be anything, that connects to Kafka and gets messages. I'm interested in known Kafka consumers for several purposes: 1) process messages and save result in DB(Oracle) 2) process messages and save result in…
Vladimir Nabokov
  • 1,797
  • 1
  • 14
  • 19
0
votes
2 answers

Java : synchronizing on custom collection class

I want to have shared collection class which is filled by producer thread and output is shown by consumer thread. It's sometimes working with 0 element of the collection class but never goes further. In Eclipse I observer "DestroyJVM" thread after…
t3rmin41
  • 668
  • 2
  • 8
  • 18
0
votes
1 answer

Cannot implement Multiple Handler for a Consumer in RabbitMQ using EasynetQ Client for .Net

I'm using Rabbitmq Queue solution and i have 4 queues and one consumer. i want my consumer consume all of these queues and provide separate Handler for each one. I googled this and found that Rabbitmq and EasyNetQ (.Net Client for RabbitMQ),…
Javad Norouzi
  • 327
  • 4
  • 11
0
votes
1 answer

How should I use Consumer object in oauth2 v.2 in Python 3.4?

I am trying to use Yelp's API using oauth2 package (version 2), the Python 3.4 (in Anaconda's Spyder) code is like: consumer = oauth2.Consumer(CONSUMER_KEY, CONSUMER_SECRET) and I get this error message: AttributeError: 'module' object has no…
Asteroid
  • 1,049
  • 2
  • 8
  • 16
0
votes
1 answer

Akka - Measure time of consumer

I'm developing a system that pulls messages from a JMS(the consumer) and push it to a Kafka Topic(the producer). Since my consumer stays alive waiting for new messages arriving in the JMS queue and push it to Kafka, how can I effectively measure how…
Thiago Pereira
  • 1,724
  • 1
  • 17
  • 31
0
votes
2 answers

Wso2 cannot view consumer key/id in app on Identity Server 5.0.0

We use Mulesoft currently for our middleware. I am in the process of evaluating Wso2 as a possible alternative. Our primary focus is mobile clients. For the most part we implement OAuth. Before I give too much detail, when I register an OAuth2 app…
maldieve
  • 11
  • 1
  • 3
0
votes
1 answer

Kafka consumer - how to add a topic

In a scenario, where I have N consumers (all consumers have 1 stream/no partitioning), each subscribed to separate set of topics, how to process new topics, added by producers? Should I create new consumer to each added topic? Or can I add this…
Vladimir Nabokov
  • 1,797
  • 1
  • 14
  • 19
0
votes
1 answer

Posix thread consumer's get not printing properly

My program is supposed to use the producer thread to read in lines from a file to a buffer that will hold up to numlines at a time and then use the consumer thread to add the words of the file to a linked list depending on if the character count of…
0
votes
1 answer

Consume activemq to a log but keep the message in the queue

I have an activeMQ app. I want to read the body of incoming messages, but keep the message into the queue. How do I do that? Is there any trick?
Jonas Audenaert
  • 160
  • 2
  • 16
0
votes
1 answer

RabbitMQ publish to multiple queues via an exchange publishes to only the first queue only

I want to publish to Several queues bound to an exchange (fan out will not work here as I want to publish to only selective queues and not all the queues) The code goes like this: public int pushDataOverRabbitMQ(String[] deviceIDs, String msg)…