Stack Overflow
Stack Overflow

Questions tagged [twemproxy]

Twemproxy (nutcracker) is a fast, light-weight proxy for memcached and redis built by Twitter.

also known as nutcracker, is a fast and lightweight proxy for memcached and redis protocol. It was primarily built to reduce the connection count on the backend caching servers.

It was open-sourced by Twitter, under the Apache License, Version 2.0.

Features

  • Fast
  • Lightweight
  • Maintains persistent server connections
  • Keeps connection count on the backend caching servers low
  • Enables pipelining of requests and responses
  • Supports proxying to multiple servers
  • Supports multiple server pools simultaneously
  • Shard data automatically across multiple servers
  • Implements the complete memcached ascii and redis protocol
  • Easy configuration of server pools through a YAML file
  • Supports multiple hashing modes including consistent hashing and distribution
  • Can be configured to disable nodes on failures
  • Observability through stats exposed on stats monitoring port
  • Works with Linux, *BSD, OS X and Solaris (SmartOS)

Resources

37 questions
1
vote
1 answer

Difference between original and old conf file in redis

What is difference between original and old conf file in redis and what is location of old file persisted in redis server. I have read about that in config rewrite command in redis documentation. URL :- https://redis.io/commands/config-rewrite
vishal
  • 71
  • 2
  • 7
1
vote
1 answer

Unable to call HSCAN with pattern from .Net using Stackexchange Redis

I'm trying to run the HSCAN command in Redis to match only the hash fields that are needed via C# This is what the code looks like var options = new ConfigurationOptions { EndPoints = { "endpoint" }, Proxy = Proxy.Twemproxy }; twemproxy_new =…
Ashish Joshi
  • 46
  • 1
  • 5
1
vote
0 answers

Seek phpredis redisArray consistent hashing algorithm info

We are using phpredis redisArray to distribute keys on 2 servers. But we now we have a new need to use same data set with other languages than php. So can anybody suggest which hash function (crc32. crc32a, jenkins...etc) in combination with which…
amolrajoba
  • 262
  • 1
  • 4
  • 10
1
vote
1 answer

Would Twemproxy rebalance after adding more redis servers?

We are planning to use redis with twemproxy. Initially, we have two redis servers, but will add more redis servers down the road. I'm wondering if twemproxy will rebalance the redis servers after we have added more redis servers. Or should we start…
atsu
  • 81
  • 7
1
vote
2 answers

redis client pipeline does not work in twemproxy environment

I use redis-py to operate on redis, and our environment use twemproxy as redis proxy. But looks clinet pipeline doesn't work when connect to twemproxy. import redis client = redis.StrictRedis(host=host, port=port, db=0) pipe =…
linbo
  • 2,393
  • 3
  • 22
  • 45
1
vote
1 answer

Authenticate in config file?

I am using twemproxy for redis and already registered in RedisToGo.com. There is a similar link to my account : redis://user:pass@grideye.redistogo.com:9478 But twemproxy does not support this form. What should I do? Thanks in advance
Soroush Khosravi
  • 887
  • 2
  • 11
  • 30
1
vote
2 answers

twemproxy (nutcracker) performance degradation with .net ServiceStack.Redis client

Setup redis and nutcracker on CentOS 6.4. and trying to connect using ServiceStack.Redis client. Found major performance issue. For testing left only 1 redis instance beta: listen: 0.0.0.0:22122 hash: fnv1a_64 distribution: ketama …
serg
  • 537
  • 6
  • 14
1
vote
1 answer

Twemproxy only connect one redis instance

I run 3 redis-server instances on my server, The instances have different config files and db files. e.g: redis1 set the db location as /var/lib/redis_1, and the redis2 set the db location as /var/lib/redis_2. I have the twemproxy config: alpha: …
varobj
  • 11
  • 1
  • 3
0
votes
1 answer

Redis Cluster vs Twemproxy - MOVED responses

I want to use Redis for a particular use case. I am not sure to go with a Redis Cluster or with Twemproxy + Sentinel. I know the Cluster is a winner any day. I am just skeptical due to the MOVED responses. In case of MOVED responses, the client…
Tarun
  • 152
  • 1
  • 15
0
votes
1 answer

Does Twemproxy / nutcracker support MGET command of Redis

I am using nutcracker in my application to fetch data from Redis nodes. Just wanted to know whether it supports multi get or it internally fetches all keys one by one.
RKP
  • 750
  • 2
  • 12
  • 23
0
votes
1 answer

Redis active - active replication across datacenters / Kubernetes clusters

I have deployed a highly available Redis service on Kubernetes (the redis version used is 4.0.9) with aof persistence. Three sentinel nodes monitoring one master node and two slave nodes. I now have the following use case: Deploy two instances of…
user10004767
  • 1
  • 2
0
votes
1 answer

Codis - Redis cluster proxy installation

I am exploring a production-stable proxy for redis cluster called codis . It is a mentioned as a great alternative to twemproxy, especially as one of my needs is pipelining and twemproxy does not offer that. However the documentation in English is…
tanvi
  • 927
  • 5
  • 17
  • 32
0
votes
1 answer

Can twemproxy load balance read requests?

I want to use redis with master and slaves. I.e. several shards. Each shard has one master and several slaves. Is it possible to configure twemproxy to use masters to write and slaves to read? Or all requests will go to the master?
Oleksandr
  • 3,574
  • 8
  • 41
  • 78
0
votes
1 answer

Redis and twemproxy

I have initially formed a Redis cluster with 3 masters and 3 slaves in my local machine. Now I want to use twemproxy on Redis cluster so I have used, the below lines(see below) as my config file and implemented twemproxy with Redis cluster. But the…
justbegancoding
  • 53
  • 1
  • 4
0
votes
1 answer

Can I use twemproxy for load balancing by redis queue size?

Can I use twemproxy as a load balancer for a pool of redis instances, according to size of redis queue (amount of keys per instance)? Is twemproxy able to turn off from the upstream one of the redis instances, if it reaches a preconfigured maximum…
d.ansimov
  • 2,131
  • 2
  • 31
  • 54
1
2
3