Questions tagged [kafka-rest]

Provides a RESTful interface to a Kafka cluster, so you can produce and consume messages, as well as perform administrative actions through any REST client.

Confluent REST Proxy

(From the official Readme.md linked below)

The Kafka REST Proxy provides a RESTful interface to a Kafka cluster. It makes it easy to produce and consume messages, view the state of the cluster, and perform administrative actions without using the native Kafka protocol or clients. Examples of use cases include reporting data to Kafka from any frontend app built in any language, ingesting messages into a stream processing framework that doesn't yet support Kafka, and scripting administrative actions.

It is a Confluent open-source project, included as part of their Confluent Platform.

Resources:

Introduction: https://github.com/confluentinc/kafka-rest/blob/master/README.md

Github Repository: https://github.com/confluentinc/kafka-rest

Complete documentation: https://docs.confluent.io/current/kafka-rest/docs/

116 questions
0
votes
2 answers

Ingest Streaming Data to Kafka via http

I am very new with Kafka and Streaming Data in general. What I am trying to do is to ingest data which is to be sent via http to kafka. My research has brought me to the confluent REST proxy but I can't get it to work. What I currently have is…
LukasM
  • 43
  • 8
0
votes
2 answers

Zookeeper connection failing cp-rest-proxy with spotify kafka image

I have been using the kafka image provided by spotify to run kafka locally. I'm currently trying to use it with cp-kafka-rest and schema-registry images. I need help resolving this issue: ERROR (Log Group:…
vamsiampolu
  • 6,328
  • 19
  • 82
  • 183
0
votes
1 answer

Caused by: java.lang.ClassNotFoundException: io.confluent.monitoring.clients.interceptor.MonitoringProducerInterceptor

Trying to publish message to kafka topic using rest proxy by Confluent platform using this command and responds with an error as mentioned below Request: $ curl -X POST -H "Content-Type: application/vnd.kafka.avro.v2+json" \ -H "Accept:…
mrsrinivas
  • 34,112
  • 13
  • 125
  • 125
0
votes
1 answer

Could not resolve host: rest-proxy when I add a new avro consumer

knowing that my kafka_cluster work fine and I'm using docker-compose I put inside the container :registery schema curl -X POST -H "Content-Type: application/vnd.kafka.v1+json" \ --data '{"name": "my_consumer_instance", "format": "avro",…
0
votes
1 answer

How do I configure a producer and consumer in Kafka REST Proxy?

How do I set up a producer and consumer in Kafka REST Proxy? If i use kafka-clients.jar and implement it in java, i can easily make all the settings. acks, commit method, and so on. I know that the basics can be set in confluent-4.1.1 / etc /…
김태우
  • 1,033
  • 1
  • 12
  • 29
0
votes
1 answer

How to run two instances of Kafka rest

I am trying to run a second instance for Kafka Rest. Here's the properties file for the first…
Giorgos Myrianthous
  • 36,235
  • 20
  • 134
  • 156
0
votes
1 answer

How to produce JSON to Kafka broker from Javascript running on a browser, with least ceremony?

I have a javascript application which is extremely small, I want to consume my Kafka broker from the javascript application (only a single pushJasonBatch function). I'd rather not deal with installing additional tools as much as I can. I don't use…
Mohsen
  • 4,000
  • 8
  • 42
  • 73
-1
votes
1 answer

How to setup Rest proxy on kafka clusture (excluding confluent or any other third party licensed )?

Every search returns the Confluent pages for Kafka REST proxy. Is there any other way to setup with the vanilla application or any open source ones?
-1
votes
1 answer

Kafka consumer - count the number of offsets from beginning to end

i was able to fetch data form beginning to end of specific Kafka topic by using consume param(earliest). responses: offset 180 , msg abc.... . . offset 12000 , msg klp... i want to count the number of counts from specific offet to latest offset to…
user2201789
  • 1,083
  • 2
  • 20
  • 45
-2
votes
1 answer

I have been trying push the data from mobile apps (Android/IOS) into kafka broker?

I am trying to push the mobile apps data into kafka broker. I have read many posts and blogs, got to know there's Rest Proxy which can push the data on HTTP to Kafak broker. I followed…
DP0808
  • 33
  • 1
  • 6
-3
votes
1 answer

Connecting to topics using Rest proxy

I am new to Kafka .I have implemented my consumer as normal Java springboot application.I need to connect to the topic deployed on remote broker using Kafka rest proxy. I am not able to understand how it will function differently if i use Kafka rest…
Ag863
  • 27
  • 7
1 2 3 4 5 6 7
8