Clustering Redis with Twemproxy
Twemproxy is an open source project released by Twitter for creating a caching proxy between a client and backend made up of either Memecache or Redis instances. Twemproxy separates the client calls, in our case any suitable Redis client, from the datastore backend through the use of an intermediary middleware. This middleware then implements a sharding strategy based on your preferences that are set in a configuration YAML file. Twemproxy supports twelve different hash functions including md5
, crc16
, two versions of crc32
, four variants of the
Fowler-Noll-Vo (FNV), among others with the default being a fnv1a_64
hash functions.
With Twemproxy being a C program such as Redis, the steps to get Twemproxy running require a couple of different methods. To get started quickly, go to https://github.com/twitter/twemproxy/releases and download Twempoxy's distribution tarball. (You can also download a source tarball or clone the repository with Git, both requiring the...