Questions tagged [redis-streams]

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data. Use this tag for questions related to the Redis Stream data type.

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data.

88 questions
0
votes
2 answers

How to send JSON in Redis stream NodeJs

I am creating one script where I want some dummy data to send to redis server using streams. For that, I am using "ioredis" module for Redis stream. Its working fine when I send simple key value structure i.e {a:"hello",b:"world"}. But not working…
shubh gaikwad
  • 127
  • 2
  • 10
0
votes
2 answers

Order of processing different Redis Streams messages

Given that I have a service P (Producer) and C (Consumer) my P service needs to: Create an object X Create an object Y (dependent on X) Create an object Z (dependent on Y) Notify C about X, Y, and Z (via Redis Streams) C needs to use data from Z,…
Jovan Perovic
  • 19,846
  • 5
  • 44
  • 85
0
votes
1 answer

Spring Redis Does Not Delete the Stream Entries

I'm using the Redis Template and I want to delete the entries of the stream after processing it. I used the below code but it didn't delete from the Redis Streams. redisTemplate.opsForStream().delete("my-stream-key",record.getId().getValue());
0
votes
1 answer

From Redis streams get all the remaining pending(PEL) mesages from XPENDING

I would like to receive all the pending messages from PEL(Pending entry list) for a given stream and a consumer group. Problem is that XPENDING command has a mandatory count variable. But I don't know how many pending messages beforehand. I just…
PasanNadeera
  • 101
  • 1
  • 9
0
votes
2 answers

How do I clear the PEL list for a consumer group in Redis

I would like to know how to clear the PEL list for a given Redis consumer group without individually acknowledging every message. Context I have a consumer group for my one of my Redis streams. For testing purposes, I need to clear the PEL list of…
PasanNadeera
  • 101
  • 1
  • 9
0
votes
1 answer

Can Redis consumer group guarantee that multi-consumers running parallelly consume different exclusive subset from the same stream?

Currently, I have a redis stream which have many entries produced. I want to process stream parallelly but make sure each entry is processed only once. I search the official document about redis stream. It seems that consumer group is one…
Spaceship222
  • 759
  • 10
  • 20
0
votes
2 answers

Redis Stream NOMKSTREAM

What is this NOMKSTREAM in redis stream? I went through the documentation. Too bad they do not even provide simple description about it. https://redis.io/commands/xadd Can someone please explain?
RamPrakash
  • 2,218
  • 3
  • 25
  • 54
0
votes
1 answer

Redis XREAD and XREVRANGE in Node.js

client.xrevrange('TEST_STREAM','count 1',function (err,Data) { if (err) { return console.error(err); } else console.log("Data from stream is:",Data); }); I'm trying to read the data from Redis stream and this line is giving me this…
0
votes
0 answers

Not work NoAck in XReadGroup with go-redis

The package I use to generate the connection and read the messages is: "github.com/go-redis/redis" I am trying to declare not to use NOACK when I read events from a group in golang, but when a new event arrives, it leaves this new event as if it had…
0
votes
1 answer

How to constantly consume and output messages from a stream using redis cli?

How to constantly consume and output messages from a stream using redis cli? I tried the command below, however it only consume the last one message but what I want from the redis cli is to constantly consume and output messages on the screen while…
user1870400
  • 6,028
  • 13
  • 54
  • 115
0
votes
1 answer

Redis / Kafka - Why stream consumers are blocked?

Are Kafka stream/redis stream good for reactive architecture? I am asking this mainly because both redis and kafka seem to be blocking threads when consuming the messages. Are there any reasons behind this? I was hoping that I could read messages…
RamPrakash
  • 2,218
  • 3
  • 25
  • 54
0
votes
1 answer

Unpack object into optional parameters

I'll take Redis's XADD command as an example. I'm trying to allow my write function to write objects of varying lengths to the redis stream. Originally, the command in redis-cli looks something like this: XADD streamName objectId key1 val1 key2 val2…
W2a
  • 736
  • 2
  • 9
  • 23
0
votes
1 answer

Can we acknowledge a range of entries (or entries older than a certain id) in Redis streams?

Is it possible to acknowledge multiple entries in a redis stream based on a range of IDs? I am specifically interested in acknowledging everything before a certain ID, instead of acknowledging one by one. Or alternatively, is it possible to only…
svakili
  • 1,909
  • 4
  • 19
  • 24
0
votes
2 answers

Getting int or float response from redis stream and python

I am adding data to a redis stream with the data being integers or floats > XADD name 1-0 field 1 > XADD name 1-1 field 2 I then have a python app that reads the stream data. r = redis.Redis(host=HOST,port=PORT,decode_responses=True) latest =…
0
votes
1 answer

Redis, XREADGROUP stream with block for a year, stupid?

Are there any downsides to telling XREADGROUP to block until there is a message rather than the client having to poll? From: https://redis.io/commands/xreadgroup It is not clear that this means: "On the other side when XREADGROUP blocks, XADD will…
mjs
  • 21,431
  • 31
  • 118
  • 200