Questions tagged [mapr-streams]

8 questions
4
votes
1 answer

Kafka - Multiple consumers (only one active) on same group/topic

Is it possible to have multiple copies of an application listen to the same Kafka group/topic so that only one is reading it at a time, but the other ones will start working if the main one crashes/stops reading? I need to make an application highly…
John Humphreys
  • 37,047
  • 37
  • 155
  • 255
2
votes
1 answer

pyspark streaming with kafka error

I am using spark 2.1.0 version with kafka 0.9 in MapR environment.I am trying to read from Kafka topic into spark streaming. However i am facing error as below when i am running Kafkautils createDirectStream command. py4j.protocol.Py4JError: An…
scn3089
  • 31
  • 7
2
votes
1 answer

Spring integration ErrorChannel issue

I am facing an issue with spring integration error-channel with maprstream. I have created my own error channel to perform few steps if any exception occurs in normal flow. But I don't want the error channel to be called if there are any exception…
kattoor
  • 195
  • 14
1
vote
0 answers

Kafka Consumer polls fewer messages when the messages are larger (MapR Streams)

We are facing an issue while running a Kafka consumer (Java). The poll returns fewer messages when the messages are larger. We have tried increasing different config parameters while constructing the consumer such as fetch.min.bytes,…
Vihit Shah
  • 314
  • 1
  • 5
0
votes
1 answer

SSL Handshake error with Mapr Streams to Azure

The error described below occurs in MapR 6.0, but I fail to see any MapR-specificity, so guess it could happen in other enrironments.. I'm mirroring a MapR Stream to Azure Kafka-enabled Event Hub, combining these two documents: Mirroring Topics…
Roman
  • 238
  • 1
  • 14
0
votes
1 answer

reprocess maprstream messages using spring integration kafka

This is related to the thread and I am using spring-integration-kafka 2.0 to consume the messages from mapr stream topics. I am facing difficulties to use the KafkaConsumer feature - reprocess maprstream messages - using offset and topic…
0
votes
1 answer

Issue while using Multiple KafkaProducerMessageHandler with spring integration

This is the extension of the post MaprStream with spring integration Kafka Producer issue I am facing issues with multiple KafkaProducerMessageHandlers when tried to achieve the sync property while publishing messages to…
0
votes
1 answer

MaprStream with spring integration Kafka Producer issue

I am using mapr-stream with spring integration and trying to create a publisher to send messages to maprstream topics. I am using the below Jar version compatibility matrix mentioned here. Spring-integration-kafka - 2.0.1.RELEASE Spring-Kafka -…
kattoor
  • 195
  • 14