Strimzi is an open source project to allow Apache Kafka runs in container such as Kubernetes and OpenShift.
Strimzi is an open source project to allow Apache Kafka runs in container such as Kubernetes and OpenShift.
Questions tagged [strimzi]
198 questions
1
vote
1 answer
Strimzi cant resize PV
I followed Strimzi blog to resize PV.
I use Openshift v3.11 deployed on Azure VMs with PV as Azure managed disk
My Kafka cluster storage config
..
config:
offsets.topic.replication.factor: 2
transaction.state.log.replication.factor:…
Veerendra K
- 2,145
- 7
- 32
- 61
1
vote
1 answer
Unable to connect: Communications link failure
I am trying to follow the tutorial Deploying Debezium using the new KafkaConnector resource.
Based on the tutorial, I am also using minikube but with docker driver. Basically just follow exactly step by step.
However, for the step "Create the…
Hongbo Miao
- 45,290
- 60
- 174
- 267
1
vote
1 answer
Strimzi - Connecting to External OpenShift Route Listener with SCRAM-SHA-512 Authentication with TLS with Sarama
I have a Strimzi cluster setup with the follow yaml.
apiVersion: kafka.strimzi.io/v1beta2
kind: Kafka
metadata:
name: kafka
spec:
kafka:
replicas: 3
listeners:
- name: plain
port: 9092
type: internal
tls:…
animusdx
- 380
- 3
- 16
1
vote
1 answer
Static membership in Kafka Connect
I'm trying to implement the static membership in Kafka Connect.
Our Kafka Connect cluster is deployed on K8S using the Strimzi Kafka operator.
I have tried putting the following config for the workers (in the KafkaConnect…
omer bar lev
- 341
- 1
- 4
- 11
1
vote
0 answers
Extract JSON API payload and modify it for Kafka bridge messages in Python
I'm trying to specify data formats and HTTP headers to ensure valid requests are submitted to the Kafka Bridge using Strimzi Kafka.
Message format
When sending messages using the /topics endpoint, you enter the message payload in the request body,…
qafro
- 13
- 5
1
vote
1 answer
Using my trusted certificate in Kafka Strimzi
I have configured a Kafka cluster on Kubernetes using Strimzi. Using this article - https://itnext.io/kafka-on-kubernetes-the-strimzi-way-part-2-43192f1dd831
But the security service in my company does not want to deploy this solution in UAT with a…
Vitalii Fedorenko
- 279
- 6
- 18
1
vote
1 answer
Strimzi MirrorMaker2 Topic restart/reset
We're using the Strimzi MirrorMaker2 CRD to replicate data from one Kafka cluster to another.
The replication is now in sync and I've noticed that the topic offset for one topic (with 3 partitions) is not correct, the source has more messages than…
RyanS
- 78
- 1
- 10
1
vote
0 answers
Use SCRAM-SHA-512 authentication with SSL on LoadBalancer in Strimzi Kafka
I am trying to access my Strimzi Kafka Cluster deployed in k8s cluster on AWS (kops not EKS) using kafka-python.
Here's the listener setup:
I am using an external listener of type loadbalancer
TLS Encryption is disabled
Authentication is…
Aravindan Sridhar
- 21
- 4
1
vote
0 answers
Use plain mode to access kafka
I have a Kafka cluster on OpenShift cloud, a customer outside of cloud send message to Kafka cluster, then we set authentication and authorization for Kafka cluster and topic, ans create an user.
Now from external customer can publish messages to…
Joe
- 623
- 7
- 16
1
vote
1 answer
TopicAuthorizationException
I create a KafkaUser to access Kafka topic on cloud from external, its definition as following, I can use SSL mode to access this topic from external with port 9094.
apiVersion: kafka.strimzi.io/v1beta1
kind: KafkaUser
name: data-user
namespace:…
Joe
- 623
- 7
- 16
1
vote
1 answer
Is there any exception for synchronous Kafka producer
As you know, there are two kinds of ways to send message - synchronous and asynchronous.
When we code with synchronous mode, the code looks the following
producer.send(new ProducerRecord(topicName, event)).get();
Reading from Kafka…
Joe
- 623
- 7
- 16
1
vote
1 answer
Prometheus Monitoring difference Podmonitor vs additionalScrapeConfigs
I am trying to monitor Strimzi using the kube-prometheus-stack helm chart. I have set it up following the tutorial from the official Strimzi documentation. In this tutorial, they both use Podmonitors and a Prometheus config to get some metrics.
But…
Manuel
- 649
- 5
- 22
1
vote
1 answer
strimzi operator 0.20 kafka 'useServiceDnsDomain' has no effect
PROBLEM:
For some reason client pod can only resolve fully qualified fully-qualified DNS names including the cluster service suffix.
That problem is stated in this quesion:
AKS, WIndows Node, dns does not resolve service until fully qualified name…
Savin
- 131
- 5
1
vote
1 answer
Kafka Consumer not consuming from last commited offset after restart
I have a consumer polling from subscribed topic. It consumes each message and does some processing (within seconds), pushes to different topic and commits offset.
There are totally 5000 messages,
before restart - consumed 2900 messages and committed…
krishna reddy
- 295
- 2
- 15
1
vote
1 answer
Datetime substitution in Apache - Camel Kubernetes Yaml file
I wanted to deploy S3 kafka sink connector (using Apache Camel) in kubernetes using reference document https://ibm-cloud-architecture.github.io/refarch-eda/scenarios/connect-s3/
DateTime placeholder (${date:now:yyyyMMdd-HHmmssSSS} used in this…
saranya elumalai
- 429
- 2
- 5
- 14