Questions tagged [redis-streams]

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data. Use this tag for questions related to the Redis Stream data type.

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data.

88 questions
2
votes
1 answer

Redis streams: groups/consumers naming and cleanup

I have a rather primitive use-case for streams: multiple producers and 1 consumer that periodically process messages in batches. Sometimes there will be more than 1 consumer and this is why I want to switch from "traditional" unreliable queue…
Oleg Antonyan
  • 2,943
  • 3
  • 28
  • 44
2
votes
1 answer

Redis consumer unable to consume a particular event

I have a producer in a spring boot project that is producing two events to the same redis consumer group and a consumer (another spring boot project) consuming the same. The redis consumer is able to consume only one type of event. I see the below…
cyberman123
  • 412
  • 5
  • 14
2
votes
0 answers

Can Redis Streams be used as source for Flink

I am new to Flink and going through documentation. I found out that Redis can be used as SINK (through Apache Bahir). But there is no mention of using Redis Streams as source, for streaming data. Is it possible to add Redis stream as source to…
Bharath
  • 21
  • 1
2
votes
1 answer

How to define TTL for redis streams?

I have two micro services and I need to implement reliable notifications between them. I thought about using redis streams - serviceA will send a request to serviceB with an identifier X. Once serviceB is done doing the work serviceA asked for,…
shani
  • 23
  • 1
  • 5
2
votes
1 answer

Redis Stream - Order Guarantee of the events

I have used Kafka. In Kafka, order of the event is guaranteed by using id. Do we have anything similar in Redis? If I have order-events stream and multiple consumers in a consumer group, all the events related to one particular order should be…
RamPrakash
  • 2,218
  • 3
  • 25
  • 54
1
vote
1 answer

How to remove completed redis stream events?

Trying to remove the completed redis stream events after particular time interval. Currently, we can remove the redis stream events after particular time interval using XTRIM command , but it will remove all stream events even when it is pending. I…
Dhivagar
  • 11
  • 1
1
vote
1 answer

Spring Boot Data Redis Stream consume messages in Batch

I am trying to consume messages from Redis Stream in Batch using Imperative StreamMessageListenerContainer of Spring Boot Data Redis. But this have method signature of 'MapRecord message' How to use List or Set for this. I…
Pritam Kumar
  • 77
  • 12
1
vote
1 answer

Debezium is not working with redis streams and postgresql

I'm having an issue with running debezium with redis and postgresql. My docker compose is: version: "3.3" services: redis-stack: image: redis/redis-stack:7.0.6-RC4 restart: unless-stopped ports: - 10001:6379 - 13333:8001 …
Arkan
  • 579
  • 1
  • 6
  • 20
1
vote
1 answer

How do I delete an entire stream in redis?

I am new to redis streams, I have googled a lot, but I still cannot figure this question out: How do I delete an entire stream in redis? I don't need that stream anymore, I want to delete it to release memories and storagies, I wonder if I have to…
Jack Zhou
  • 163
  • 7
1
vote
0 answers

Getting data with Pending status from redis

Good afternoon. I am trying to solve a queue problem with radis stream. Task description: we need to implement a queue to store the data that we will send to the user's email. How it works: I have a queue, when I create a queue, I also create a…
alex
  • 524
  • 2
  • 11
1
vote
0 answers

How to change UpdateColumns of DB.Transaction to asynchronous in Go/redis-sentinel?

How to change UpdateColumns of DB.Transaction to asynchronous in Go/redis-sentinel, I have some update action with below code in go, and we would like to change them to asynchronous in Go and redis-sentinel, I am very new to Go, is there anyone know…
Elsa
  • 1
  • 1
  • 8
  • 27
1
vote
2 answers

Why is Redis source connector not available for Flink?

We are looking to use existing redis streams in our application and process messages using Apache Flick, but could not find Redis source connector ? Any reason why Redis source connector is not available ? any constraint, is it technically not…
naresh b
  • 13
  • 2
1
vote
1 answer

how to work with XREAD .NET Redis to read actual changes

When i am set stop point at line with XREAD programm doing nothing. Maybe i need to configure this XREAD command? public async void ListenTask() { var readTask = Task.Run(async () => { while…
bynik
  • 67
  • 4
1
vote
0 answers

Reply to Consumed Messages in Redis Stream

I'm working with Java and Redis. I have service A and Service B. Service A produced the messages and Service B consume those messages and do some processing. I want to reply to the same message which is send by the Service A. Service A need to get…
Reg Reg
  • 49
  • 4
1
vote
0 answers

Handling PENDING messages from Redis Stream with Spring Data Redis

When using StreamMessageListenerContainer a subscription for a consumer group can be created by calling: receive(consumer, readOffset, streamListener) Is there a way to configure the container/subscription so that it will always attempt to…
Bryan Bende
  • 18,320
  • 1
  • 28
  • 39