Stack Overflow
Stack Overflow

Questions tagged [embedded-kafka]

75 questions
0
votes
1 answer

Mocking SchemaRegistryClient in stream processor Consumer

I have a Reactor-based Spring Boot Kafka stream processing app that I am working on writing integration tests for. I am using Spring's @EmbeddedKafka broker. It works great, I have it overriding the bootstrap broker urls that get configured on my…
NikeAGoGo
  • 45
  • 5
0
votes
1 answer

Embedded Kafka not showing consumer offset

Got an embedded kafka instance running as part of a test. I'm trying to verify that all the messages have been read but am getting an empty result from the kafka admin client. Map partitionOffset =…
Alex
  • 587
  • 11
  • 31
0
votes
2 answers

Embedded Kafka Test results fails, curly brackets added to Value

I am using Embedded Kafka Broker at Junits, for testing my values pushed to topic. I get following error logs. [ERROR] KafkaConsumerTest>KafkaConsumerTests.shouldNotRetry4XXResponse:256 expected:
Aditya Rewari
  • 2,343
  • 2
  • 23
  • 36
0
votes
0 answers

EmbeddedKafka does not invoke listener when using avro schema

I have been trying to write a simple Kafka Listener unit test using KafkaEmbedded. However my listener does not gets invoked. I have been using this link for inspiration since I also need an Avro Serializer/DeSerializer. Below are how my test class…
Mayank Porwal
  • 276
  • 1
  • 3
  • 13
0
votes
0 answers

Spark not able to read from an Embedded Kafka Topic

I am trying to write an integration test using Embedded Kafka but I keep getting NullPointerException. My test case is very simple. It has following steps: Read a JSON file & write messages to an inputTopic. Perform a 'readStream' operation. Do a…
DilTeam
  • 2,551
  • 9
  • 42
  • 69
0
votes
0 answers

How to write testcase for embedded kafka in springboot application using junit

i don't know How to write testcase for embedded kafka in springboot application using junit mockito i refer some code and i used that but KafkaEmbedded KafkaEmbedded is deprecated @TestConfiguration @EmbeddedKafka(partitions = 1,…
Arun Kumar T
  • 31
  • 6
0
votes
1 answer

Kafka Producer Integration Test Definition

I have an application code that produce events to a Kafka Topic. So now I needed to write Integration tests for it. After searching on internet, I got confused with definition of Integration test that whether should I use embedded Kafka server…
Vip
  • 1,448
  • 2
  • 17
  • 20
0
votes
2 answers

KafkaEmbedded throwing NoSuchMethodError: org.apache.kafka.common.config.ConfigDef$ValidString

I am trying to write functional test using embedded kafka. but getting below error while starting cluster: An exception or error caused a run to abort: …
p1q1w1e1
  • 1
  • 1
0
votes
2 answers

Spring Boot Cannot Find EmbeddedKafkaBroker Bean(Without using SpringbootTest)

I wanted to use embedded Kafka for a Spring boot application. I am able to use embedded Kafka for Junit testing, but while trying to use in main application, the embedded Kafka object is not being identified. When trying to load Spring boot…
Manu
  • 1,379
  • 6
  • 24
  • 53
0
votes
1 answer

Streaming database data to Kafka topic without using a connector

I have a use case where I have to push all my MySQL database data to a Kafka topic. Now, I know I can get this up and running using a Kafka connector, but I want to understand how it all works internally without using a connector. In my spring boot…
Nithin Prasad
  • 554
  • 1
  • 9
  • 22
0
votes
1 answer

Is message order not guaranteed using KafkaEmbedded?

I made a unit test using KafkaEmbedded (and KafkaTemplate), but the message order is random. Does anyone know if it is logical, and if it is possible guaranty order? here is my code: public class KafkaTest { private static String TOPIC =…
Juh_
  • 14,628
  • 8
  • 59
  • 92
0
votes
1 answer

Embedded Kafka Broker IP Not Resolving in Property File

I'm facing an issue where my Kafka ProducerConfig is getting an invalid bootstrap.servers value because my unit test @PropertySource isn't resolving the spring.embedded.kafka.brokers property. When I dump my producer config to the logs, I get the…
blackcompe
  • 3,180
  • 16
  • 27
0
votes
1 answer

Embedded Kafka migration State Store between two instances with different @StreamListener

I have a SpringBoot application with two stream processors mapped via Spring Cloud. Each processor has own @StreamListener for different topics. One processor writes aggregated data to the quarable state store. I facing the problem in my Unit test…
kovitals
  • 31
  • 3
0
votes
1 answer

Kafka Streams: mix-and-match PAPI and DSL KTable not co-partitioning

I have a mix-and-match Scala topology where the main worker is a PAPI processor, and other parts are connected through DSL. EventsProcessor: INPUT: eventsTopic OUTPUT: visitorsTopic (and others) Data throughout the topics (incl. original…
xmar
  • 1,729
  • 20
  • 48
0
votes
1 answer

Producer error in Scala Embedded Kafka with Kafka Streams

I have a test that temperamentally leaves an open producer thread with a continuous error logging. [2018-06-01 15:52:48,526] WARN [Producer clientId=test-deletion-stream-application-9d94ddd6-6f29-4364-890e-0d9676782edd-StreamThread-1-producer]…
xmar
  • 1,729
  • 20
  • 48
1 2 3 4
5