Stack Overflow
Stack Overflow

Questions tagged [librdkafka]

The Apache Kafka C/C++ library

librdkafka is an Apache Kafka C/C++ library, which is an implementation of the apache-kafka protocol.

The library provides a Consumer, Producer and Admin client for the brokers.

A bunch of other language bindings has been built on top of it, including Haskell, Node.js, OCaml, PHP, Python, Ruby, C# / .NET.

Links

Related Tags

179 questions
0
votes
0 answers

Getting /libgcc_s.so.1: version 'GCC_3.4' does not exist: error while testing a c++ program using librdkafka library

I am compiling the below sample C++ kafka producer program using librdkafka library in Solaris OS and getting error while linking: Sample program: #include #include "rdkafkacpp.h" int static producer_1() { std::string brokers =…
Bhima Vuchula
  • 1
  • 1
0
votes
1 answer

PHP7.2 unable to load rdkafka

I need to install rdkafka on Ubuntu20 with Apache2 web server for a Laravel project. The PHP version is 7.2. I followed the documentation in Official Link and it finally shows Installing '/usr/lib/php/20200930/rdkafka.so' Now I see the…
M a m a D
  • 1,938
  • 2
  • 30
  • 61
0
votes
1 answer

Does librdkafka and confluent-kafka-go support connecting to a kafka broker via an HTTP proxy with HTTP CONNECT?

I have a kafka producer written in Go using the confluent-kafka-go bindings. I want my kafka producer to establish a connection to a kafka broker that is behind an HTTP proxy that supports HTTP CONNECT tunneling. Does librdkafka support this? Does…
Jonathan Cano
  • 57
  • 6
0
votes
1 answer

Kafka ssl ca location for broker validation

I am using confluent kafka library for .net which is built on top of librdkafka. As per documentation over here : https://github.com/edenhill/librdkafka/blob/master/INTRODUCTION.md#ssl If ssl.ca.location is not set it will probe default paths. When…
Vikash Mishra
  • 123
  • 2
  • 10
0
votes
0 answers

Bundle Install | rdkafka 0.8.1 ERROR: Version string is empty

I am running bundle install and encountering this error: Installing rdkafka 0.8.1 with native extensions ERROR: Error installing rdkafka: ERROR: Failed to build gem native extension. checking for strlcpy (by compile)... ok checking for strerror_r…
Jhon Jerme Dela Cruz
  • 1
0
votes
0 answers

Where's the bottleneck when I wait for a Kafka message then return a value in Actix Web?

I am trying to communicate between 2 microservices written in Rust and Node.js using Kafka. I'm using actix-web as web framework and rdkafka as Kafka client for Rust. On the Node.js side, it queries stuff from the database and returns it as JSON to…
SaltyAom
  • 81
  • 2
  • 4
0
votes
1 answer

PHP with Kafka - rdkafka

Iam dealing with kafka and php, Im beginner the kafka has been set upped correctly on the server, now am on local I have installed: librdkafka.dll on xamp/php and php_rdkafka.dll on xamp/php/ext and i added this on…
Ahmed Al Omari
  • 23
  • 6
0
votes
1 answer

How to add a interceptor using librdkafka C++ client?

I am trying to write a Kafka producer using librdkafka C++ client, I found there is no API to add a custom interceptor in C++ version, while i found some function to add interceptor in C which are not exposed in C++ client…
Jiewei Yuan
  • 1
0
votes
1 answer

Create Producer when the first broker in the list of brokers is down

I have a multi-node Kafka cluster which I use for consuming and producing. In my application, I use confluent-kafka-go(1.6.1) to create producers and consumers. Everything works great when I produce and consume messages. This is how I configure my…
Noel Augustin
  • 11
  • 1
0
votes
1 answer

How to set topic level config while creating a new topic using node-rdkafka?

I've been using node-rdkafka npm package for working with node and kafka. For creating a new topic I've been using the following code: client.createTopic({ topic: topic.name, num_partitions: _.get(topic, "partitions", 1), replication_factor:…
Nishant Petkar
  • 1
0
votes
1 answer

USER1: Initializing port 0 EAL: Error - exiting with code: 1 Cause: Cannot setup TX queue; port=0, err=Invalid argument (fastcapa)

i am trying to run fastcapa (metron project) on VM(ubuntu20.04) with dpdk and librdkafka installed and built. but when i run this commande i got this error: cmnd: sudo ./fastca …
refka ben marzouk
  • 1
0
votes
1 answer

Does librdkafka and confluent-kafka-go supports JKS based SSL Configuration?

Can we configure librdkafka and confluet-kafka-go to use jks files
Yashdeep Hinge
  • 382
  • 2
  • 14
0
votes
0 answers

Librdkafka Go consumer and websocket issue

I am trying to write some simple Go code that uses librdkafka Kafka Consumer, consumes a message on a Kafka topic and publishes that message to HTTP (upgraded to a websocket) endpoint. Something like the following Kafka Topic(myTopic) --> Go -->…
Nick
  • 157
  • 2
  • 14
0
votes
1 answer

Spring Kafka: C++ producer of reply for ReplyingKafkaTemplate

I use ReplyingKafkaTemplate to send a request to Kafka and receive the reply. Consumer of the request is a C++ program. After processing the request, its reply is produced by the C++ application. Now my problem is about format of the reply, because…
H.Morshedlou
  • 23
  • 4
0
votes
1 answer

What does librdkafka.redist's logs mean

This is an extract from a console log relating to Confluent.Kafka's librdkafka.redist dependency. %3|1602097315.970|FAIL|rdkafka#consumer-2| [thrd:kfkqaapq0002d.ch.me.com:9092/bootstrap]: kfkqaapq0002d.ch.me.com:9092/bootstrap: Failed to resolve…
runnerpaul
  • 5,942
  • 8
  • 49
  • 118
1 2 3
…
11 12