Stack Overflow
Stack Overflow

Questions tagged [consumer]

649 questions
0
votes
1 answer

How can an interprocess producer consumer message passing mechanism be protected against corruption due to one side crashing?

I have implemented an interprocess message queue in shared memory for one producer and one consumer on Windows. I am using one named semaphore to count empty slots, one named semaphore to count full slots and one named mutex to protect the data…
David Sackstein
  • 500
  • 1
  • 5
  • 19
0
votes
1 answer

Differentiate which queue was called when using wildcards in apache camel

In my application, I am using wildcards in apache camel and I have defined route builder like this: from("activemq:queue:*.processQueue").bean(beanOne,"someMethod"); While sending the message I will be sending message to "{uniqueID}.processQueue"…
ujjwal singh
  • 90
  • 8
0
votes
1 answer

Processing Kafka message byte array in Scala

I am trying to use Spark Streaming and Kafka to ingest and process messages received from a web server. I am testing the consumer mentioned in https://github.com/dibbhatt/kafka-spark-consumer/blob/master/README.md to take advantage of the extra…
Moe
  • 33
  • 5
0
votes
0 answers

Producer and Client Connection

I have am working on a small project that will create a connection between a Producer and a Client. The producer will take an email object, put it in a queue, and the client will pick it up. I have two questions about this. There is a separate Email…
malvarn123
  • 1
  • 1
0
votes
1 answer

KAFKA REMOTE AWS consumer.poll

Hi I have been trying to learn KAFKA and having issues with my remote poller/consumer. I have set up KAFKA in AWS EC2 instance with private and public ip. my server.properties looks like this. listeners=PLAINTEXT://172.31.31.58:9092 #AWS Private…
Sivakumar Varadharajan
  • 1
0
votes
2 answers

Java. Consumer - Producer with BlockingQueue. Search tool

I was trying to implement some Consumer-Producer problem with BlockingQueue. To do it with some purpose, I decided to write file searching tool. I decided that search mechanism is working recursively, and every new directory is going to have new…
Martin
  • 129
  • 1
  • 6
0
votes
1 answer

Sprint Boot - Post a single string/enum to a REST service

I'm trying to send a single string to a REST API via Spring Boot but I keep getting 400: Bad Request. I checked through postman that this json is accepted by the API: { "currency": "USD" } I wrote the following piece of code to post to this…
zhaider
  • 595
  • 2
  • 9
  • 26
0
votes
0 answers

Kafka consumer fails on commit offset and rebalancing

i have a Kafka consumer which is subscribed to only one topic. At a certain point in time, after working correctly, i get the following messages in my logs: Line 25694: 2017-05-15 17:59:53.656 [INFO ] [MeasureConsumerExecutor] AbstractCoordinator -…
vortex.alex
  • 1,105
  • 3
  • 11
  • 24
0
votes
1 answer

Apache Kafka - Consumer Fundamentals

I have to use Apache Kafka to connect to the brokers of my firm. The problem is that I never used this technology before, and this is something that I need to clarify a little bit. Actually, I created a "local" Kafka with a Zookeeper / Server /…
akioz
  • 53
  • 5
0
votes
1 answer

Pact JVM Junit Consumer Compilation Error

I am writing the Consumer Side Code for Pact using JVm-Junit library. However at the line : MockProviderConfig config = MockProviderConfig.createDefault(); i am getting error "createDefault() is not undefined for the type MockProviderConfig" What…
PaChSu
  • 297
  • 3
  • 13
0
votes
0 answers

Return Consumer with ?: operator

I have a problem with write simply consumer function which operator ?: I also don't know that it is possible to do what I want I can't change above syntax public Consumer restore(){ return (s) -> { if(s.equal("s")){ …
Mbded
  • 1,754
  • 4
  • 23
  • 43
0
votes
1 answer

kafka : How to delete data which already been consumed by consumer?

I set server.properties' log.retention.minutes=8 to clean data under kafka-logs/ every 8 minutes automatically , is it possible let the cleaner only clean up the data which have been consumed ,data not consumed by consumer will retain ? Thanks !
kylin
  • 19
  • 5
0
votes
0 answers

Reading from multiple dynamic locations in Apache Camel

I have a batch job in which I'm expected to download file from multiple locations in Apache Camel. I'm using following strategy to complete this process. Start route on a quartz2 schedule Retrieve list of endpoints to download files (This can be…
niyasc
  • 4,440
  • 1
  • 23
  • 50
0
votes
0 answers

logstash 2.3.2 connect to zookeeper

Install logstash using docker Want to be : logstash consumes data of kafka and stdout to console Spec Kafka 0.8.2.1 Logstash 2.3.2 Elasticsearch 2.3.3 Docker Logstash Code input { kafka { zk_connect => 'remoteZookeeperServer:2181' …
picachyu100
  • 1
0
votes
3 answers

How to change a list outside a consumer

I'm working on a problem for school. A lot of this method was already implemented and I'm not allowed to make too many changes. Actually I can only make changes in specific spots. Here's the code of the method I'm working on, although some words…
Typhaon
  • 828
  • 8
  • 27
1 2 3
…
43 44