Stack Overflow
Stack Overflow

Questions tagged [confluent-kafka-dotnet]

A Kafka .NET client, written by Confluent.

Source: https://github.com/confluentinc/confluent-kafka-dotnet

138 questions
0
votes
0 answers

Confluent Kafka producer on c# Webforms. Cant store error

I can't get the error from Kafka. I'm trying to store my results and errors in database (on cmd it is working fine). I Can store message, but never receive an error (for example when Kafka is down). Webforms, .net4.8, confuent.kafka 1.9.2 …
Capitan Planet
  • 155
  • 3
  • 14
0
votes
1 answer

.NET Kafka producer terminating unexpectedly

I am running into some issues when trying to publish a number of messages onto a Kafka topic using the Confluent.Kafka nuget package. Everything is set up correctly to the topic and I am able to write to it (before it terminates). It seems that the…
Ben Ritter
  • 1
0
votes
0 answers

Batching data and resiliency with Kafka in .NET

I am trying to come up with a solution that involves Kafka with .Net This video gives a nice introduction and also suggests configuring for Throughput or Latency. The related code here has configuration values like…
Codehelp
  • 4,157
  • 9
  • 59
  • 96
0
votes
1 answer

Kafka Connect .NET config mapping

I am tasked with porting some Kafka consumers and producers from Java to .NET and wanted to validate the config mapping for SSL. Some were trivial, but some seem not supported in .NET Config classes (or have different names). I don't have access to…
Xheox
  • 83
  • 6
0
votes
0 answers

Kafka Consumer Issue

We are using a kafka consumer app based on the example below: The problem: we receive Error in SetErrorHandler: {"Code":"Local_Transport","Message":"sasl_ssl://XXXX.servicebus.windows.net:9093/0: Disconnected (after 3654528ms in state…
Coooooool
  • 1
0
votes
1 answer

Commit offset in kafka consumer in VB .net

I have a case when consumer will be down then the offset should be used to check which message will be picked from where it left and not start from beginning. I have found many ways in other languages but I need the same in VB .net. How to implement…
Shiva Verma
  • 21
  • 3
0
votes
1 answer

Controller Base not Working with Kafka Consumer in Background Service

I am working on a Realtime Application where I have to consume messages from Kafka and process the message and create a status dictionary to display on webpage. The problem is that while Kafka is running as BackgroundService in my Application, The…
Mubashir Qazi
  • 1
  • 1
0
votes
1 answer

Confluent SchemaRegistry unable to update existing schema

Trying to Update existing schema in SchemaRegistry, but having error: Schema being registered is incompatible with an earlier schema for subject "kafka-2906-value" Existing JSON schema:…
Padmaraj
  • 1
  • 1
0
votes
1 answer

Does Confluent Kafka library allow to create a Consumer Group at run time using AdminClient

I have requirement to create consumer group at run time using Kafka IAdminClient or any other interfaces which Confluent Kafka exposes. I understand that by setting true to allow.auto.create.topics will solve my requirement. In my case am connecting…
Vishnu Kumar K S D
  • 21
  • 4
0
votes
0 answers

.Net Confluent.Kafka.SchemaRegistry ValueSerializer error

Manually registered schema in SchemaRegistry using curl command. Schema registered is: '{ "schema": "{ \"type\": \"record\", \"name\": \"Person\", \"namespace\": \"com.xxx\", \"fields\": [ { \"name\": \"firstName\", \"type\": \"string\" }, {…
Padmaraj
  • 1
  • 1
0
votes
2 answers

Confluent Batch Consumer. Consumer not working if Time out is specified

I am trying to consume a max of 1000 messages from kafka at a time. (I am doing this because i need to batch insert into MSSQL.) I was under the impression that kafka keeps an internal queue which fetches messages from the brokers and when i use the…
M.Hamza Ali
  • 103
  • 5
0
votes
1 answer

Unable to connect to Kafka server using .net

I am unable to connect to Kafka servers from .net. We had truststore.jks file using which we created .pem files using below commands keytool -exportcert -alias $alias -keystore $keyStore -rfc -file $outputFolder/certificate.pem -storepass…
Ronak
  • 187
  • 2
  • 17
0
votes
1 answer

Confluent Kafka Connector Configuration with C# / .net

I'm trying to build a connector to go into the confluent kafka library. I have seen many examples in java that use configDef to define the configuration options. However I havent seen anything doing the same in C# and i'm unsure about how to achieve…
S Rosam
  • 375
  • 1
  • 3
  • 16
0
votes
2 answers

Kafka Producer can't connect to servers and will not throw any exception

I have an extremely simple setup for sending message to Kafka: var producerConfig = new ProducerConfig { BootstrapServers = "www.example.com", SecurityProtocol = SecurityProtocol.SaslSsl, …
yesman
  • 7,165
  • 15
  • 52
  • 117
0
votes
1 answer

How can I create a topic on Event Hub/Kafka using the AdminClient?

I'm trying to create a topic (an Event Hub) programmatically from the Kafka interface using AdminClient.CreateTopicsAsync. This works when connecting to Kafka, but not to Event Hub. I'm running into the following error: Default partition count…
Asik
  • 21,506
  • 6
  • 72
  • 131
1 2 3
…
9 10