Stack Overflow
Stack Overflow

Questions tagged [redis-streams]

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data. Use this tag for questions related to the Redis Stream data type.

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data.

88 questions
0
votes
1 answer

Move data from Redis stream to a storage which is not in memory

The https://redis.io/topics/streams-intro#capped-streams documentation mentions the capped streams to prevent memory overload: ...Sometimes it is useful to have at maximum a given number of items inside a stream, other times once a given size is…
Artem Salabaev
  • 33
  • 4
0
votes
1 answer

How to get pending items with minIdleTime greater then some value?

Using Redis stream we can have pending items which aren't finished by some consumers. I can find such items using xpending command. Let we have two pending items: 1) 1) "1-0" 2) "local-dev" 3) (integer) 9599 4) (integer) 1 2) 1) "2-0" 2)…
Max Grigoriev
  • 1,021
  • 2
  • 13
  • 29
0
votes
1 answer

Reverse read of multiple Redis Streams (imaginary XREVREAD command)

With redis streams I can read multiple streams in a chronologically forward direction. Each stream is read from a point in time up to to newest point in that stream. I can get the oldest item multiple streams XREAD COUNT 1 STREAMS streamA streamB…
user368604
  • 166
  • 3
0
votes
1 answer

Use XREADGROUP to get the id specified

I'm wondering if there is a command or parameter with which I can get the message for the RecordId specified e.g. XREADGROUP GROUP mygroup myconsumer COUNT 1 STREAMS mystream 12345-0 I want the message with the ID 12345-0, but it seems I get the…
anstue
  • 990
  • 12
  • 24
0
votes
1 answer

Get pending messages with Redis Streams and Spring Data

I use Redis Streams in my Spring Boot application. Within a scheduler I regularly want to get all the pending messages and check how long they are already processing and re-trigger them if necessary. My problem is now that I can get the pending…
anstue
  • 990
  • 12
  • 24
0
votes
0 answers

How does influxDB implement ordered bulk inserts

I have a requirement that since the Redis-Stream structure holds a specified length of data that I wish to transfer to influxDB in bulk, but during the transfer process the data inserted in bulk will not be in the same order as the original data An…
moluzhui
  • 1,003
  • 14
  • 34
0
votes
2 answers

Why i get (nil) when read redis stream

In my stream I have 1 pending message: redis[7]> XREADGROUP GROUP symfony consumer COUNT 1 STREAMS messages 0 1) 1) "messages" 2) 1) 1) "1592850947048-0" 2) (nil) redis[7]> XPENDING messages symfony 1) (integer) 1 2)…
maxgu
  • 137
  • 1
  • 11
0
votes
1 answer

Event Driven Architectures - Topics / Stream Design

This could be some kind of best practice question. Someone please who has worked on this clarify with examples. So that all of us could benefit! For event-driven architectures with Kafka / Redis, when we create topics/streams for events, what are…
RamPrakash
  • 2,218
  • 3
  • 25
  • 54
0
votes
1 answer

Redis stream 50k consumer support parallel - capacity requirement

What are the Redis capacity requirements to support 50k consumers within one consumer group to consume and process the messages in parallel? Looking for testing an infrastructure for the same scenario and need to understand considerations.
Sowmyan Soman
  • 853
  • 1
  • 9
  • 21
0
votes
1 answer

Redis Streams fetch multiple values with XREAD

I have a redis stream "mystream" and I am trying to use: XREAD COUNT 5 BLOCK 50000 STREAMS mystream $ to read five new entries appended to mystream with blocking for 50s. As soon as I execute command to add data to mystream using: XADD mystream a 5…
Pranav Gupta
  • 651
  • 9
  • 14
0
votes
1 answer

How to get multiple records with XRange in redis stream efficiently

Looking at Redis streams and building indexes on a stream ( like EventStore does) , this works pretty well and i can get a bunch of entries in a stream except i cant find a nice way to return all the records by id eg like an MGET. This is a…
user1496062
  • 1,309
  • 1
  • 7
  • 22
0
votes
1 answer

How does COUNT work with multiple streams in XREADGROUP?

I want to use the Redis XREADGROUP command to consume messages from multiple Redis streams. What does the COUNT parameter mean in such cases (i.e. is it the total number of messages, or a number of messages per stream)? Also, is it possible to read…
Eugene Yarmash
  • 142,882
  • 41
  • 325
  • 378
-1
votes
1 answer

Am unable to filters on Date fields with Redis

Am unable to filter on Date fields with Redis-search eg: entityStream.of(Object.class), at the same time, being able to filter other data types but not with Date type tried with the below patterns but not working SearchStream search =…
baddi lingamurthy
  • 1
  • 1
1 2 3 4 5
6