Kafka with .Net Client

Question

I want to use kafka on our production environment. I want to know if the latest version of client is bug free for production launch. Is it working with consumer group? I want to pass 10000 records per second, is it suitable for it or not?

score 21 · Answer 1 · answered May 25 '17 at 18:22

21

I might be late to the conversation, but confluent has a great .net kafka library. It's easy to implement consumer groups and highly configurable.

https://www.nuget.org/packages/Confluent.Kafka/

answered May 25 '17 at 18:22

franzke

517
1
6
18

I haven't tried conluent kafka yet, but as first view - ot seemed the most proffesional solution. i.e kafka-net always read from beginning and doesn't have built in function to retreive records from last offset. rd-kafka has that possibility, but as I see conluenct kafka had all of above. Also the time for the next consume, session timeout and some many parameters which are not available on other libraries. Seems complicated to learn, but I would give it a chance. – Eitan Jun 06 '17 at 11:46
You are right... As of now, confluent Kafka seems to be the best .NET client given that it has kafka core team support – Tharaka Jul 10 '17 at 07:16
Yah but can you not use avro and schema reg with that client? both are a huge pain if not needed. – Brian Sep 05 '18 at 13:47

score 9 · Answer 2 · answered Nov 02 '16 at 00:42

9

Currently microsoft kafka client is not actively developed/supported. Instead the author recommends to use rdkafka-dotnet It has better documentation and is easy to use

answered Nov 02 '16 at 00:42

Konstantin Chernov

1,899
2
21
37

7

Now rdkafka-dotnet recommends confluent-kafka-dotnet https://github.com/confluentinc/confluent-kafka-dotnet – Hans Jespersen May 26 '17 at 06:00

score 3 · Answer 3 · answered Oct 28 '18 at 21:03

I might be very late to the conversation. But we are using Kafka in production using DotNet client. Here is the most up-to update and official supported version https://github.com/confluentinc/confluent-kafka-dotnet

confluent-kafka-dotnet is derived from librdkafka (https://github.com/edenhill/librdkafka/)

Matthias J. Sax · Answer 4 · 2016-06-28T10:27:56.040

I am only aware of a single .net Kafka Client (https://github.com/Jroland/kafka-net) and the README say clearly:

The current version of this project is a functioning "work in progress" as it was only started in early February.

Furthermore:

This is a pet project for me and is not currently backed by a need for a Kafka server client. Which means the client is only currently being tested against a small set of Kafka test servers and not against any server that has any real data load.

A list of available clients is maintained here: https://cwiki.apache.org/confluence/display/KAFKA/Clients So you can watch if another .net client becomes available.

score 2 · Answer 5 · edited Jun 07 '19 at 11:18

2

I recommend you Microsoft .NET Kafka library in link below. This library much nicer than kafka-net as far as I know.

https://github.com/Microsoft/CSharpClient-for-Kafka

Hope this help.

edited Jun 07 '19 at 11:18

Konstantin Chernov

1,899
2
21
37

answered Jul 18 '16 at 05:17

pkongkietvan

46
3

Kafka with .Net Client

5 Answers5