Stack Overflow
Stack Overflow

Questions tagged [confluent-kafka-dotnet]

A Kafka .NET client, written by Confluent.

Source: https://github.com/confluentinc/confluent-kafka-dotnet

138 questions
0
votes
1 answer

Kafka ssl ca location for broker validation

I am using confluent kafka library for .net which is built on top of librdkafka. As per documentation over here : https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#ssl If ssl.ca.location is not set it will probe default paths. When…
Vikash Mishra
  • 123
  • 2
  • 10
0
votes
1 answer

Confluent Kafka Consumer doesn't receive anything

I faced the problem with the following code: public IActionResult Consume(string topic) { try { var config = new ConsumerConfig { BootstrapServers =…
Laser42
  • 646
  • 2
  • 7
  • 24
0
votes
0 answers

how do I handle committing two transactions?

I am currently in the situation where I need to commit two transaction, one going towards the database (postgres, interacted with the npgsql library), and the one going on a kafka message bus (interacted with the confluent.kafka library). Both…
I am not Fat
  • 283
  • 11
  • 36
0
votes
1 answer

Consuming latest messages from a topic and ignoring all previously published messages

Suppose I have a topic "test" which already have bunch of messages and now I want to subscribe to the topic. But I don't want to consume all the messages which are being published previous to the new subscription. Basically I want to consume only…
Ravi patel
  • 1
0
votes
1 answer

Verifying Confluent Kafka access rights programmatically

I'm trying to figure out if there is any way to programmatically check if provided credentials have read and write access to different Kafka topics using the Confluent Kafka lib for .NET. What I want to do is basically a smoke test upon system…
Roger Johansson
  • 22,764
  • 18
  • 97
  • 193
0
votes
0 answers

Confluent-kafka-dotnet - Consumers hangs when committing offsets after few seconds internet connection lost

Description I'm using this kafka client - https://github.com/confluentinc/confluent-kafka-dotnet Consumers hangs when committing offset after few seconds internet connection lost. How to reproduce I have running working consumer - everything is OK.…
Vadym
  • 111
  • 5
0
votes
0 answers

Kafka .NET consumer that consumes new messages from a multi partitioned topic (batch process)

I created a kafka consumer that executes on a batch process for a single partitioned topic. Every 15 minutes, my batch process will execute and consume all new messages that have been published to the topic. After consuming all available messages…
Evan Zimmerman
  • 1
0
votes
0 answers

AccessViolationException during application exit while using MassTransit with Kafka and in-memory bus

I'm using version 7.1.4 of MassTransit with .Net Core 3.1, ASP.NET Core Web Application. It happens when I close the application by Ctrl + C. When I press stop debugging button, it doesn't occur. The code responsible for registration goes as…
Rafał Ryszkowski
  • 365
  • 2
  • 15
0
votes
1 answer

what will happen after the Kafka consumer reads the whole partion?

I do have a .Net code that I'm using in a windows service that has the process of initializing a consumer object and consuming the Kafka. var config = new ProducerConfig { BootstrapServers = "host1:9092,host2:9092,...", ClientId = ..., …
Aman Shukla
  • 1
  • 1
0
votes
1 answer

Unable to connect to Azure Event Hub using the Confluent .Net client

I am trying to use the Confluent .Net client (1.5.2) to connect to an Azure Event Hub but I keep getting an SSL handshake failed error. My Confluent ProducerConfig looks like this: var config = new ProducerConfig { BootstrapServers =…
C. Wheeler
  • 1
  • 1
0
votes
1 answer

What Is The Correct Usage of Confluent Kafka Client Within docker-compose Stack On A Cloud CI Server Such As GitLab or Travis?

I am new Kafka user and have managed to get a docker-compose stack working locally to successfully run functional tests from an ASP.NET Core 3.1 test service. This exists within the same docker-compose stack as Kafa, Zookeeper and Rest-Proxy…
anon_dcs3spp
  • 2,342
  • 2
  • 28
  • 62
0
votes
1 answer

Dependency Injection With Autofac C# - Is It Possible To Specify A Factory Method When Registering A Generic Type

I am very new to DI and Autofac. I have a singleton class ProducerService, as listed below. This is used as a dependency in the constructor of a BackgroundService. The ProducerService has a constructor injected dependency, IKafkaProducerAggregate,…
anon_dcs3spp
  • 2,342
  • 2
  • 28
  • 62
0
votes
1 answer

Messages getting lost in Confluent Kafka Dotnet

I am using Confluent kafka package in my recent c# project. I created a producer in the following way: prodConfig = new ProducerConfig { BootstrapServers = "xxx.xxx.xxx.xxx:xxx"}; foreach(msg in msglist){ using(var producer = new…
TheBlaDe
  • 45
  • 5
0
votes
1 answer

Kafka producer with Async not returning DeliveryReport but DeliveryResult

I am trying to write messages into Kafka and below is my producer where if i use produce it has DeliveryHandler and i could access DeliveryReport, but when i use ProduceAsync then the return type is deliveryResult how do i get DeliveryReport and log…
VR1256
  • 1,266
  • 4
  • 28
  • 56
0
votes
1 answer

Confluent.Kafka - Topic Log Compaction

I'm currently building publisher and consumer assets using Confluent.Kafka and I'm trying to understand if there is anything different I need to do in code. I'm able to create the topic log compaction but I do not fully understand how to work with…
Janus
  • 125
  • 1
  • 8
1 2 3
…
9
10