Questions tagged [apache-pulsar]

Apache Pulsar is an open-source distributed pub-sub messaging system

339 questions
0
votes
1 answer

The log file is just for log or it is to stored the message?

For the pulsar bookeeper, the log file under the path /bookkeeper/ledgers/current/*.log is just the log file or it is used to store the message? Will it will lose the message, if I delete the log file?
hezonglin
  • 19
  • 3
0
votes
1 answer

HAProxy TLS/SSL with Apache Pulsar

I am using HAProxy as a TCP load balancer in front of a series of Apache Pulsar Proxy. I am trying to enable SSL/TLS encryption for my connection to Apache Pulsar cluster. For testing I am using a let's encrypt cert. Unfortunately, when I am trying…
madtowneast
  • 2,350
  • 3
  • 22
  • 31
0
votes
1 answer

Pulsar-Functions on existing messages

I am new to Apache Pulsar but I'm trying to use Pulsar-Functions to process existing messages on a topic. It seems that these functions are intended for streaming purposes only, so they would only get triggered when new messages arrive to the input…
0
votes
1 answer

Error connecting to broker: PulsarClientException Connection Refused

We saw this exception in our Pulsar client app: Error connecting to…
devinbost
  • 4,658
  • 2
  • 44
  • 57
0
votes
1 answer

Consumer is receiving only 50 percent of the messages published to the topic

We're noticing that exactly 50 percent of the messages produced to my Pulsar topic are reaching my app. Everything was working fine yesterday where our Pulsar consumer app was getting 100% of messages that were produced to the topic. We haven't made…
devinbost
  • 4,658
  • 2
  • 44
  • 57
0
votes
1 answer

PulsarClientException: Connection already closed - verified network, firewall, Pulsar token and role are correct

I'm using a Java Spring consumer for Apache Pulsar, and my app won't start. We've verified the following: the Pulsar token is correct. (We're using Pulsar token auth.) we can hit our target SSL Pulsar port (6651) using telnet and curl commands, so…
devinbost
  • 4,658
  • 2
  • 44
  • 57
0
votes
1 answer

DotPulsar :How to set consumer receiveQueue Size?

Pulsar .Net SDK -DotPulsar How to set consumer receiveQueue Size? await using var consumer =…
0
votes
1 answer

I'm looking for code to connect PyFlink to Pulsar

I've been trying various examples, but I need to see how to connect PyFlink to Pulsar. I have Pulsar 2.8.0, Flink 1.13.1 and Scala 2.11. I just need to see how to set the parameters for PyFlink to connect to a topic on Pulsar. Please help.
0
votes
0 answers

Pulsar: got Connection refused while trying get started with Java client

I'm trying to get started with Pulsar (source: https://pulsar.apache.org/docs/en/client-libraries-java/) in Intellij IDEA, but I'm facing with a problem: I can not create a producer because of client uses port. I supose that the mistake is very…
0
votes
1 answer

how to deploy message queues like rocketMq or pulsar in environments where initiating connections are not allowed?

I need to publish messages to clients who run in environment where initiating connections are not allowed, but accepting connections are ok. with rocketmq or pulsar, the issue I run into is that they all require clients (or broker, or proxy) to…
0
votes
1 answer

Message Brokers - Multiple consumers with this same client ID

I've been considering some multiple consumer problem with my system and unfortunately I'm really stuck. I mean - I see some solutions, which are below, but they are propably not enought efficient. Let me introduce system: User has their specific Id.…
0
votes
1 answer

Is it possible for a producer to know if a message was acknowledged?

Topic says it all. My guess is that the delivery guarantees of Pulsar make this question nonsensical but I would like to know for sure.
astifter
  • 65
  • 1
  • 9
0
votes
1 answer

How to get unique pulsar message id in different case

interface: MessageId impl: MessageIdImpl BatchMessageIdImpl RawMessageIdImpl The implement have different properties, different toString() method, that confused me much.
h.xn
  • 25
  • 1
  • 5
0
votes
1 answer

How store a json document in an elasticsearch index using the Apache Pulsar connector?

I want to store JSON schema as {"name": "Jane", "age": 25, ...} in Elasticsearch using Apache Pulsar connector. I tried using this https://pulsar.apache.org/docs/en/io-elasticsearch-sink/#configuration, but I can only store JSON with the structure…
0
votes
1 answer

Apache pulsar - function execution not effecting the output

I followed the manual here: pulsar functions I have this function declaration in Java: package org.example.test; import java.util.function.Function; public class ExclamationFunction implements Function { @Override public…
omriman12
  • 1,644
  • 7
  • 25
  • 48