Twemproxy

Twemproxy, also known as the nutcracker, is a fast and lightweight Redis proxy developed by Twitter. The purpose of this project is to provide a proxy and data sharding solution for Redis and to reduce the number of client connections to the backend Redis Servers.

As a proxy, Twemproxy supports both Redis and Memcached protocols. You could set up multiple Redis servers behind Twemproxy. Clients only talk to the proxy and do not need to know the details of backend Redis instances.

The following diagram shows the basic architecture of how Twemproxy works in the environment of multiple Redis instances:

Twemproxy is able to shard data automatically across configured backend Redis instances. It supports multiple hashing modes. With consistent hashing supported, you can set up a reliable sharded Redis easily, using Twemproxy.

Twemproxy can be also configured to disable backend nodes on failure and retry after some time.

Using Twemproxy does not mean there is a single node failure problem...