Stack Overflow
Stack Overflow

Questions tagged [apache-pulsar]

Apache Pulsar is an open-source distributed pub-sub messaging system

339 questions
2
votes
1 answer

How to work with protobuf schema messages in Python Apache pulsar pulsar-client package?

Is there a way to publish message to an Apache Pulsar topic using Protobuf schema using pulsar-client package using python? As per the documentation, it supports only Avro, String, Json and bytes. Any work around for…
Murthy Vissapragada
  • 23
  • 2
2
votes
1 answer

Setup Pulsar transaction coordinator in Kubernetes setup

How to setup Apache Pulsar transaction coordinator in Kubernetes setup? I couldn't see much docs on this, though I could modify the broker.conf configmap unsure if that even works.
vvra
  • 2,832
  • 5
  • 38
  • 82
2
votes
1 answer

Pulsar client thread balance

I'm trying to implement a Pulsar client with multiple producers that distributes the load among the threads, but regardless the value passed on ioThreads() and on listenerThreads(), it is always overloading the first thread (> 65% cpu while the…
user2262368
  • 57
  • 6
2
votes
1 answer

Pulsar: If a message gets nack'd (negativeAcknowledge()) when will it be redelivered?

If we cannot process a message (perhaps due to some timing problem or race condition) and we call consumer.negativeAcknowledge(messageId); When will it be redelivered to retry processing? I am unable to figure out what the default setting for…
kellyfj
  • 6,586
  • 12
  • 45
  • 66
2
votes
1 answer

What does Autorecovery do in Apache Pulsar?

What is the function of the Autorecovery process in Apache Pulsar? What are the risks if the process is not run?
kellyfj
  • 6,586
  • 12
  • 45
  • 66
2
votes
2 answers

How to migrate data between Apache Pulsar clusters?

How do folks migrate data between Pulsar environments either for disaster recovery or blue-green deployment are they copying data to a new AWS region or K8S namespace?
kellyfj
  • 6,586
  • 12
  • 45
  • 66
2
votes
2 answers

How does Deduplication work in Apache Pulsar?

I'm trying to use Deduplication feature of Apache Pulsar. brokerDeduplicationEnabled=true is set in standalone.conf file, But when I send the same message from producer multiple times, I get all the messages at consumer end, is this expected…
Shubham Jain
  • 876
  • 1
  • 9
  • 17
2
votes
1 answer

failed to get Partitioned metadata : authorization failed

I'm seeing this exception in my app when trying to interact with my Pulsar topic: "message":"[persistent://exampleTenant/example-app-consumer/example-app-REPLAY] failed to get Partitioned metadata : Authorization…
devinbost
  • 4,658
  • 2
  • 44
  • 57
2
votes
0 answers

apache pulsar: storage write latency vs publish latency

While looking at the metrics for the broker, I found there are two different latency metrics in pulsar broker: storage write latency and publish latency. I'm aware of the fact that apache pulsar in general guarantees <5ms for publish latency and…
pandawithcat
  • 571
  • 2
  • 13
2
votes
1 answer

Apache Pulsar Async Consumer Setup (Completable Future)

I am trying to setup an asynchronous consumer for Apache Pulsar, but my problem is only 1 message is received and no other messages come through unless I restart my Spring Boot application. Unfortunately, the documentation around using the…
user521990
  • 669
  • 1
  • 5
  • 21
2
votes
0 answers

Azure Load balancer( L4) will support SNI?

Currently i set up the pulsar in azure vm using this link https://pulsar.apache.org/docs/en/deploy-bare-metal/ Now i would like to set up the SNI to the pulsar cluster is there any way to do this…
Bala Krishna
  • 47
  • 2
  • 8
2
votes
1 answer

TimeoutException when trying to run a Pulsar source connector

I'm trying to run a Pulsar DebeziumPostgresSource connector. This is the command I'm running: bin/pulsar-admin \ --admin-url https://localhost:8443 \ --auth-plugin org.apache.pulsar.client.impl.auth.AuthenticationToken \ --auth-params…
Soroush
  • 1,055
  • 2
  • 18
  • 26
2
votes
1 answer

apache pulsar using docker-compose not working (/pulsar/conf/standalone.conf (No such file or directory))

I am able to run Apache Pulsar using this docker command: docker run -it \ -p 6650:6650 \ -p 8080:8080 \ --mount source=pulsardata,target=/pulsar/data \ --mount source=pulsarconf,target=/pulsar/conf \ apachepulsar/pulsar:2.6.0 \ …
rohit534
  • 107
  • 3
  • 8
2
votes
1 answer

Apache Pulsar disk usage in a container

I am running Apache pulsar in a Docker container in standalone mode. I am publishing log file lines into the pulsar topic. The total logs are about 60G in size. The pulsar container keeps running out of disk space on the / disk and has to…
punekr12
  • 653
  • 2
  • 7
  • 14
2
votes
1 answer

Apache Pulsar: Error Checking/Getting Partition Metadata while Subscribing

I'm trying to subscribe to an Apache Pulsar topic, and I know for certain the tenant, namespace, and topic all exist because other consumers are able to subscribe to this exact same topic. I've double-checked that my URL and port are correct and…
devinbost
  • 4,658
  • 2
  • 44
  • 57
1 2 3
…
22 23