For questions specific to the usage and features of Amazon Managed Streaming for Apache Kafka. Use this tag in combination with the more generic [apache-kafka] tag when appropriate.
Questions tagged [aws-msk]
371 questions
0
votes
1 answer
How to set S3SinkConnector (Failed to find class)
How can i set S3SinkConnector to stream data from my topic to S3 bucket? I've download plugin from confluent hub, created a file connect-standalone.properties and s3-sink.properties.
When I try to run ./connect-standalone.sh…
user866364
0
votes
1 answer
Ubuntu client awscli unsupported by AWS MSK Kafka?
Are kafka commands through the awscli not supported in ubuntu? Do we have to use 'Amazon Linux 2 AMI (HVM), SSD Volume Type' for any consumers/producers interacting with MSK?
When we stood up an Ubuntu 18.04 instance it saying that
awscli is…
b15
- 2,101
- 3
- 28
- 46
-1
votes
2 answers
Kafka consumers in Clojurescript lang
Is there a way to create kafka consumers in a clojurescript app that I am trying to create. My kafka cluster is at AWS MSK which is configured to use SASL_SSL/IAM auths. And my client-side application is build on clojurescript. I tried to search for…
ctrl_dev
- 1
-1
votes
2 answers
Alter client.dns.lookup in MSK connector
I have an AWS MSK managed connector which seems to use this default configuration - client.dns.lookup = use_all_dns_ips
I'd like to change this value but when I try set client.dns.lookup in connector configurations it appears that it makes no…
rix
- 10,104
- 14
- 65
- 92
-1
votes
2 answers
List topics and their configuration with AWS CLI
Is it possible to use the AWS CLI tool to list the Kafka MSK topics and display the configuration of them?
l4t3b0
- 39
- 1
- 4
-2
votes
1 answer
Which AWS data streaming service (Kinesis or MSK) is a better fit for small-to-medium Lambda-centric workloads?
I work for a company that is trying to scale some of their workloads by leveraging either Kinesis or managed Kafka (Amazon MSK) as a message queue and streaming service.
All of our systems are running on AWS. Most of our compute workload is handled…
John Smith
- 45
- 7
-2
votes
1 answer
Can kafka publish messages to AWS lambda
I have to publish messages from a kafka topic to lambda to process them and store in a database using a springboot application, i did some research and found something to consume messages from kafka
public Function,…
user15125148
-3
votes
1 answer
How to connect to an existing Kafka MSK Cluster step by step?
I would like to know more about how to connect to a Kafka MSK Cluster.
Alison Quintero
- 13
- 3
-3
votes
1 answer
How to connect Python consumer to AWS MSK
I'm trying to connect my python consumer to AWS MSK cluster. how can I do that?
Have an AWS MSK Cluster running
I'm trying consume message from the MSK cluster using python and kafka python.
error I'm getting
Traceback (most recent call last):
…
Sanker
- 69
- 1
- 7