Stack Overflow
Stack Overflow

Questions tagged [kafka-rest]

Provides a RESTful interface to a Kafka cluster, so you can produce and consume messages, as well as perform administrative actions through any REST client.

Confluent REST Proxy

(From the official Readme.md linked below)

The Kafka REST Proxy provides a RESTful interface to a Kafka cluster. It makes it easy to produce and consume messages, view the state of the cluster, and perform administrative actions without using the native Kafka protocol or clients. Examples of use cases include reporting data to Kafka from any frontend app built in any language, ingesting messages into a stream processing framework that doesn't yet support Kafka, and scripting administrative actions.

It is a Confluent open-source project, included as part of their Confluent Platform.

Resources:

Introduction: https://github.com/confluentinc/kafka-rest/blob/master/README.md

Github Repository: https://github.com/confluentinc/kafka-rest

Complete documentation: https://docs.confluent.io/current/kafka-rest/docs/

116 questions
0
votes
2 answers

REST Wrapper around Kafka- Anti-Pattern?

More than a question, this is an architectural dilemma that I am facing. Is it a good idea to have REST wrapper around a Kafka Producer and integrate with it, instead of directly integrating with Kafka Producer in my code? I could use a generic…
Karthik PV
  • 78
  • 1
  • 1
  • 5
0
votes
1 answer

HTTP error 403 when using Confluent Kafka REST Proxy

I use Confluent Kafka REST Proxy to send messages to Apache Kafka. I set up basic authentication on the REST Proxy and whenever I submit a HTTP request to the proxy, I get the 403 HTTP Error !role. The proxy requires Zookeeper, Kafka and Schema…
BuahahaXD
  • 609
  • 2
  • 8
  • 24
0
votes
2 answers

How to access to Kafka rest proxy metrics through JMX

I am trying to build my own metrics collector from the rest server, I need to access to a variety of metrics through JMX, to gather data, scrape and expose mBeans of the jmx server. Like Prometheus JMX exporter.
Mohamed Zouari
  • 395
  • 1
  • 5
  • 14
0
votes
1 answer

How does one use Kafka with OpenID-Connect?

I'm starting out with Kafka. I see that I'm able to pass headers when producing messages. Traditionally one would have a web client (single page app) where to user logs in via some remote oidc idp and receives a token. That token is then sent via…
user12207064
0
votes
1 answer

KafkaRestProxy multiple instances issue

I'm having an architecture of microservices where each service's producer write to the same topic. I have two instance of kafkaRestproxy each listen to that topic but the problem here is that : Suppose a request come to instance-1 of a restproxy…
Madhukar Choudhary
  • 15
  • 4
0
votes
0 answers

The Kafka Rest Api does not work with two or more consumers in the same group

Sometime after connecting a second consumer with the same group id, I get the error "Consumer instance not found" (code: 40403). I noticed that when connecting the second consumer, my request to receive new messages from Kafka freezes for both…
Vladisalv
  • 1
0
votes
2 answers

How to freeze new version of AVRO schema of a topic so that non compliant message is rejected?

With Java Client producer, the message can be fine tune to comply with the schema format before publish to topics. With kafka rest proxy, how to reject messages if the message unable to be deserialize with kafka avro schema version? This is to…
Tachyonis Space Github
  • 1
0
votes
1 answer

Sending JSON data from COBOL program to KAFKA rest server

"SQUARE BRACES" is missing from JSON data when I am trying to send from COBOL program to KAFKA I have started the KAFKA-REST server and tried to format the json data in COBOL program and sent the data using "WEB SEND POST". NOTE: Media Type used for…
vikash
  • 1
  • 2
0
votes
1 answer

Connecting REST Proxy to Confluent Cloud trying to connect to zookeeper

I'm trying to connect kafka rest proxy to confluent cloud. kafka-rest-start ccloud-kafka-rest.properties Here is my file with properties…
Maksim Ploter
  • 431
  • 1
  • 6
  • 13
0
votes
2 answers

How to change Kafka Rest Proxy CURL command in order to use it in a browser

I'm trying out Rest Proxy in Kafka. When I type the following url in my browser http://192.168.0.30:8082/topics, I get the expected results :…
Jin Lee
  • 3,194
  • 12
  • 46
  • 86
0
votes
1 answer

Kafka rest proxy for windows

Any solution for windows to setup and run the Kafka rest proxy? so i can browse and send the API get/post message via IP/browser? e.g. at windows browser to get the topics, and use the soapui tool to send GET message to do query?…
user2201789
  • 1,083
  • 2
  • 20
  • 45
0
votes
2 answers

how to access latest offset of topic in confluent kafka rest proxy to calculate lag

In confluent kafka rest proxy we can get the last committed offset of particular consumer group but how can we get the latest offset of topic to calculate the lag.
Sagar Shinde
  • 31
  • 3
  • 6
0
votes
1 answer

it's possible to install rest-proxy confluent in apache kafka cluster kafka version 2.0.0

I would integrate kafka-rest-proxy confluent solution with apache kafka 2.0.0 Could some one explain how I install only kafka rest proxy for my cluster with 3 nodes kafka and 3 znodes ?
Mehdi Frid
  • 25
  • 5
0
votes
1 answer

Posting avro serialised data using kafka-rest proxy

I am trying to Post some data on a kafka topic for which the avro schema of the data contains union types.I am using kafka-rest proxy on android to produce messages. Given that data contains union type;none of the pojo to json converters seem to…
arpit115
  • 38
  • 6
0
votes
2 answers

How do I send JSON data to kafka using confluent's REST proxy?

For my bachelors thesis I am trying to send machine data (in this case historical data sent with a python script) using a http connection to kafka. I am using the confluent platform running in docker on a windows system. Using the python script I…
LukasM
  • 43
  • 8
1 2 3 4 5 6
7
8