Stack Overflow
Stack Overflow

Questions tagged [amazon-msk]

27 questions
0
votes
0 answers

Interrupt exception in kafka library

I am getting a kafka exception in java library thread_name org.springframework.kafka.KafkaListenerEndpointContainer#1-0-C-1 java.lang.IllegalStateException: This error handler cannot process 'org.apache.kafka.common.errors.InterruptException's; no…
dead programmer
  • 4,223
  • 9
  • 46
  • 77
0
votes
2 answers

Kafka brokers behavior after deleting a topic

i'm new to kafka and figuring out its behavior. I have a kafka cluster that has three brokers in it. I have given 2GB for the cluster and my cluster disk storage reached 95%. So what i did was deleted the main topic which i used for testing. (This…
Dushan
  • 1,365
  • 20
  • 26
0
votes
2 answers

AWS MSK IAM - Authentication Failure Access Denied Spring Boot

I have a spring boot app deployed on AWS EKS POD and have provisioned AWS MSK with IAM authentication they both are under the same VPC and roles has been configured as well as in MSK inbound rules the port 9098 has also being added. To test…
giiyiraj
  • 51
  • 1
  • 6
0
votes
1 answer

Schema Registry URL for IIDR CDC Kafka subscription

I have created a cluster Amazon MSK. Also, created an EC2 instance and installed Kafka on it to create a topic in Amazon MSK. I am able to produce/consume messages on the topic using Kafka scripts. I have also installed the IIDR Replication agent on…
dossani
  • 1,892
  • 3
  • 14
  • 23
0
votes
0 answers

Is it possible to set up Amazon MSK Mutual TLS Authentication with Custom DNS?

I've already set up Mutual TLS Authentication with my AWS MSK cluster using a Java application where it uses the default broker addresses (*.mymskcluster.1t2cpu.c12.kafka.us-west-2.amazonaws.com). Unfortunately I have had no luck with custom DNS. I…
Matt Watson
  • 1
  • 1
0
votes
1 answer

kafkaconnect backup to s3 - the region 'us-east-1' is wrong; expecting 'eu-north-1'

I am trying to backup my kafka topic to s3 following this guide. I have filled in all the blanks for the configuration and specified aws.region eu-north-1. aws kafkaconnect create-connector \ --capacity…
Bjarte Brandt
  • 4,191
  • 2
  • 23
  • 25
0
votes
1 answer

How to create MSK Cluster configuration with Cloud Formation?

I'm creating MSK with Cloud Formation. By the way, I can't find how to create MSK Cluster configuration, in Cloud Formation documents. So how can I create MSK Cluster configuration with Cloud Formation or do I can't create MSK Cluster configuration…
정원희
  • 13
  • 2
0
votes
1 answer

How to consume events form from AWS MSK cluster using KafkaConsumer java SDK?

I have created a cluster in AWS MSK and created a topic. I can produce and consume events from the EC2 instance in the same VPC as the cluster. The specific use case is that I want to consume events using Java. The KafkaClient AWS SDK doesn’t have…
sd99
  • 13
  • 4
0
votes
1 answer

Kafka: Topic list discrepancy between zookeeper and bootstrap-server

On a couple of my clusters I'm seeing a discrepancy between the list of topics returned by zookeeper as compared to the broker i.e the following commands return different (fewer in the case of the broker) results kafka-topics.sh --zookeeper…
JustCatchingRye
  • 11
  • 3
0
votes
0 answers

Mulesoft Kafka connector and Amazon MSK

I am trying to connect Mulesoft to Amazon MSK using the Kafka connector. I followed the steps from amazon https://docs.aws.amazon.com/msk/latest/developerguide/getting-started.html but not sure if I need to create that EC2 instance.. is a…
Santos
  • 177
  • 1
  • 1
  • 15
0
votes
1 answer

Not able to produce message into kafka topic using aws lambda function

So i am trying to write a lambda function on S3 event which will put message into kafka topic . My aws lambda function is triggering and not getting any error also . But i am not able to see those messages into Kafka topic . Here is my lambda…
Atharv Thakur
  • 671
  • 3
  • 21
  • 39
0
votes
1 answer

HTTP endpoint for AWS Managed Kafka?

Can a HTTP endpoint be setup with AWS's Managed Streaming for Apache Kafka (MSK)? With which we can send data using HTTP POST? We can't use the AWS SDK because the client is very thin (it is our CDN actually) and it can only do simple HTTP requests…
bjfletcher
  • 11,168
  • 4
  • 52
  • 67
1
2