Stack Overflow
Stack Overflow

Questions tagged [redis-streams]

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data. Use this tag for questions related to the Redis Stream data type.

Redis Streams is a data structure released as part of Redis 5.0. Conceptually inspired by Apache™ Kafka, they are a log-like structure designed for storing append-only semi-structured data.

88 questions
1
vote
1 answer

Upper limit on number of redis streams consumer groups?

We are looking at using redis streams as a cluster wide messaging bus, where each node in the cluster has a unique id. The idea is that each node, when spawned, creates a consumer group with that unique id to a central redis stream to guarantee…
wezell
  • 573
  • 3
  • 7
1
vote
1 answer

Redisson RStreams not receiving messages

I am trying to use streams with redis using Reddison lib. I am using code StreamReadGroupArgs.neverDelivered() when receiving the messages. But if I don't ack it then the next time when readGroup is called it does not get those messages. The problem…
Sachin Jain
  • 97
  • 1
  • 10
1
vote
0 answers

how to implement a short lived queues for ETL

I am looking for a suggestion on how we can implement a short lived queues(topic) to perform an ETL, after the ETL is completed that queue(topic) and data is not needed anymore. Here is the scenario.. where a particular job runs, it has to run a…
Varma
  • 47
  • 4
1
vote
1 answer

Redis stream call back not able to return value

I am using redis stream with node js, I am facing issue when returning the async callback value. please give me suggestion on how I can return value below is my code const redis = require('redis') const redisClient = redis.createClient({ host:…
vlas fama
  • 59
  • 5
1
vote
1 answer

Block until Complete Count

I am using Redis streams and need to block my clients until there are at least say X number of messages in the stream and return when it reaches that X count.. Is there any way to achieve this? EG: XREADGROUP GROUP G1 C2 COUNT 10 BLOCK 0 STREAMS L >…
Laukik
  • 424
  • 4
  • 13
1
vote
1 answer

The interoperability between redis-graph and redis-streams

I'm interested in the project and wanna understand more about the internals of RedisGraph, and looks for the feasibility of the interoperability between Redis-Streams and Redis-Graph modules. Thus, I'm wondering on what native data structures of…
Mohammed Ragab
  • 31
  • 6
1
vote
1 answer

Redis Streams one message per consumer with Java

I'am trying to implement a java application with redis streams where every consomer consumes exactly one message. Like a pipeline/queue where every consumer takes exactly one message, processes it and after finishing the consumer takes the next…
mbauer
  • 348
  • 1
  • 6
  • 25
1
vote
1 answer

Influxdb bulk insert using influxdb-python

I used influxDB-Python to insert a large amount of data read from the Redis-Stream. Because Redis-stream and set maxlen=600 and the data is inserted at a speed of 100ms, and I needed to retain all of its data. so I read and transfer it to influxDB(I…
moluzhui
  • 1,003
  • 14
  • 34
1
vote
1 answer

Redis guarantees on XREAD return value?

Can XREAD (or perhaps another command) be used to atomically detect whether data was written to a Redis stream? More specifically: Suppose you added some data to a Redis stream in one process and saw that the data was added successfully with some…
Max
  • 1,670
  • 1
  • 12
  • 17
1
vote
1 answer

Spring Data Redis Streams, Cannot figure out what is happening to my unacknowleded messages?

I am using the following code to consume a Redis stream using a Spring Data Redis consumer group, but even though I have commented out the acknowledge command, my messages are not re-read after a server restart. I would expect that if I didn't…
WickedElephant
  • 327
  • 2
  • 9
1
vote
0 answers

Redis transaction logs through redis streams

Does redis provide transaction logs via redis streams equivalent to Dynamo Db streams over changes in Dynamo Db data?
user4593933
  • 11
  • 1
  • 3
0
votes
0 answers

Redis Streams, Event Driven Architecture and Schema Evolution

I'm really interested in using Redis Streams as the messaging backbone for a platform utilising event driven architecture in place of Kafka for the following reasons: Lower cost Drastically lower complexity (and virtually zero deployment and…
Daisy Day
  • 652
  • 7
  • 19
0
votes
0 answers

how can i put all tabels changes in one streams in debezium&redis-stream

I want to monitor one postgres database's changes with debezium-server and put all these changes into redis stream.But after my test i can only xread one table's change in one command, like xread block 1000000 streams…
王抒凛
  • 1
0
votes
0 answers

Redis streams consumer naming in Openshift/Kubernetes

Given: A redis stream consumer application runs in Openshift/Kubernetes. The service can be scaled and hence multiple consumers will run on different pods. To distinguish them a name should be given to each replica pod. Is there a good practice or a…
Artem Salabaev
  • 33
  • 4
0
votes
1 answer

How can I go around an ambigous reference to overloaded definition error in Scala

I am getting the error ambiguous reference to overloaded definition. My code looks like this override def process(record: Row) = { var asset = record.getString(0); var count = record.getLong(1); if(jedis == null){ connect() …
Tito Lulu
  • 85
  • 6
1 2
3
4 5 6