Stack Overflow
Stack Overflow

Questions tagged [quarkus-kafka]

10 questions
3
votes
2 answers

Quarkus Kafka Consumer: read from database before starting consuming

I'm working with a java application that use Quarkus and Kafka. I have a Kafka Consumer that reads from a topic but I need to read some data form a database before it start to consume. My consumer looks like this: @ApplicationScoped public class…
Kaiak
  • 88
  • 7
1
vote
1 answer

Quarkus kafka stream to postgres table

I have a use case in which I receive my input data in a Kafka topic. This data has to be transformed and enriched and sent to a PostgreSQL table. My application is using Quarkus Kafka streams to consume data from the input topic and process them.…
smang
  • 95
  • 1
  • 8
0
votes
1 answer

Quarkus Kafka Devservices - how to get the bootstrap servers?

I am using the Quarkus Kafka extension, but not in the intended way, as I need to connect to multiple different Kafka brokers to transfer messages between them - which the extension doesn't support. As such I am using the plain Kafka API to connect…
Jan Thomä
  • 13,296
  • 6
  • 55
  • 83
0
votes
1 answer

How to allow Kafka producer to start even if available node in the brower is lower than replication factor?

I am currently working with Kafka and i have a configuration with 2 nodes. (I know that i must have at least 3 nodes for HA, but for many reasons i can't have more than 2 nodes) So, i have 2 nodes configured with kafka with a replica factor = 2 and…
jojal
  • 67
  • 5
0
votes
0 answers

StreamsException when running @QuarkusTest with kafka streams in quarkus development mode

Quarkus 2.15.3, Problem When running my test case via gradle build or IDE (IntelliJ), everything is fine, test OK. When starting application in Quarkus Dev Mode, test fails with following exception: Caused by:…
Boerdy
  • 1
  • 1
0
votes
0 answers

Rollback kafka message on surrounding transaction failure in Quarkus

I have the following code that given an entity first persist it, and later send it to a Kafka topic. @POST @Path("/fruits") @Transactional public CompletionStage…
jesantana
  • 1,241
  • 2
  • 14
  • 27
0
votes
1 answer

Kafka Channel name with a 'period' in Quarkus application

While I am playing with repo kafka-quickstart , I noticed that if I add a period to the channel name quarkus is failing to start. The channel name in the github repo is 'quotes' and I changed it to 'quotes.ch' all over the occurrences. the…
Johnyzhub
  • 382
  • 2
  • 4
  • 18
0
votes
1 answer

Get partition assigned by Kafka

I’m using Quarkus Kafka consumer. And I need to know to which partitions my consumer has been assigned by Kafka broker. Any listener that I can use, just like the one that Kafka client provide. Otherwise how can I assign a specific partition in each…
paul
  • 12,873
  • 23
  • 91
  • 153
0
votes
1 answer

Change log level for smallrye kafka consumer extension

I have a quarkus app which uses the quarkus-smallrye-reactive-messaging-kafka extension. At runtime it produces a tons of debug logs: rent-orchestrator-service | 16:44:11.508 [smallrye-kafka-consumer-thread-0] DEBUG…
Vincenzo
  • 45
  • 3
  • 11
0
votes
1 answer

Referencing an Avro type from another Avro type fails in Quarkus with The type of the "id" field must be a defined name or a {"type": ...} expression

I'm migrating a Spring Boot application to Quarkus. It's an applications that publishes Kafka messages serialized with Avro. These are the schemas: id.avsc { "namespace" : "xxx", "type": "record", "name": "Id", …
codependent
  • 23,193
  • 31
  • 166
  • 308