Stack Overflow
Stack Overflow

Questions tagged [apache-pulsar]

Apache Pulsar is an open-source distributed pub-sub messaging system

339 questions
3
votes
1 answer

Pulsar: consuming from several partitioned topics

Let's consider the following example. We have two topics. Each of the topics has 4 partitions. Two consumers connect to these topics. We use key_shared subscription. Is there any guarantee in pulsar that records with the same keys from both topics…
Victor Denisov
  • 717
  • 5
  • 13
3
votes
1 answer

Excluding consumer of a topic by sender in Pulsar

Intro We're developing a system to support multiple real-time messages (chat) and updates (activity notifications). That is, user A can receive via Web Socket messages for : receiving new chat messages receiving updates for some activity, for…
BVtp
  • 2,308
  • 2
  • 29
  • 68
3
votes
1 answer

Exception: Pulsar error: IncompatibleSchema

I am new to Pulsar and I am just exploring the functionalities for a new project. I am trying a very basic example to send data from a producer based on schema. To give some background, my idea is to send the data from apache-pulsar to Clickhouse…
Newbie_Python
  • 115
  • 7
3
votes
1 answer

non-persistent message is lost when throughput is high

I found that non-persistent messages are lost sometimes even though the my pulsar client is up and running. Those non-persistent messages are lost when the throughput is high (more than 1000 messages within a very short period of time. I personally…
Jack Ng
  • 33
  • 2
3
votes
4 answers

Apache Pulsar Unauthorized to validateTopicPolicyOperation for operation [WRITE] on topic

We've been trying to add JWT auth on our 2.8.1 Apache Pulsar cluster and it seems to be working properly, except for permissions. So basically, the state we are right now is that: Without token, client gets a 401 With a token, it can access but has…
Kin
  • 31
  • 2
3
votes
1 answer

Message Expiry for pulsar messages

How to get the expiry date for particular message in pulsar by using Pulsar admin API ( or ) is there any way to findout whether particular message is expired or not ?
Pavan Kalyan
  • 59
  • 3
3
votes
2 answers

Retrieving all past messages from a apache pulsar topic

I think a simple example would describe my question better. For example, let's say there is a topic named "A" and I have produced 100 messages(message1...message100). I have already consumed and acknowledged up to message 50 using subscription "A_1"…
pandawithcat
  • 571
  • 2
  • 13
3
votes
1 answer

Multithreading with pulsar message listeners

I'm fairly new to java message listeners and apache pulsar. Assume that I've maintained a listener like so, private MessageListener generateListener() { MessageListener listener = (consumer, respMsg) -> { String…
Ivak
  • 57
  • 6
3
votes
1 answer

Apache Pulsar - What is the behaviour of the Consumer.seek() method by timestamp?

https://pulsar.apache.org/api/client/2.4.0/org/apache/pulsar/client/api/Consumer.html#seek-long- When calling seek(long timestamp) method on the consumer, does timestamp have to equal the exact time a message was published? For example, if i sent…
pandawithcat
  • 571
  • 2
  • 13
3
votes
2 answers

What is the most efficient way to delete/expire all messages in a Apache Pulsar topic?

I'm trying to figure out what would be the best way to remove all the messages from a Pulsar topic (either logically or physically), so that they are no longer consumable by subscriptions? I know we can simply do $ pulsar-admin persistent delete…
fhussonnois
  • 1,607
  • 12
  • 23
3
votes
2 answers

How to reference secrets generated by cert-manager with hash suffix in name?

The scenario: I'm having Apache Pulsar v2.6.0 deployed in Rancher Kubernetes, together with jetstack/cert-manager: helm install cert-manager jetstack/cert-manager --namespace cert-manager --set installCRDs=true helm install --values ./values.yaml…
user14321182
  • 51
  • 5
3
votes
1 answer

Is there a way to check if there exists a Pulsar producer with the same name on the same topic?

Pulsar allows multiple producers to subscribe to the same topic only if they have different producer names. Is there a way to check if a producer with the same name (and same topic) already exists?
doctopus
  • 5,349
  • 8
  • 53
  • 105
3
votes
1 answer

How to use Pulsar as an Appender to Log4j2?

I'm trying to set up Apache Pulsar as an appender to log4j2. There isn't much documentation for it, but I manage to find a few examples here. I've set up a toy example where a Producer is logging a single message and a Consumer is subscribed to the…
doctopus
  • 5,349
  • 8
  • 53
  • 105
3
votes
3 answers

Apache Pulsar message delivery semantics

I went through Apache Pulsar Documentation for Message Delivery Semantics. The delivery semantics mentioned for Apache functions(atleast once, atmost once and effective once), If we don't use Apache functions then what are all the different Delivery…
Balasubramanian Naagarajan
  • 338
  • 3
  • 17
3
votes
1 answer

What's the difference between backlog quotas and TTL

From the doc: https://pulsar.apache.org/docs/en/cookbooks-retention-expiry/#get-the-ttl-configuration-for-a-namespace, it is a little bit confusing about the difference between backlog quotas and TTL. As I understand so far, a message arrives…
Xiang Zhang
  • 2,831
  • 20
  • 40
1
2
3
…
22 23