Building high-availability services using Heartbeat
High-availability services are those that can survive the failure of an individual machine or network connection. The primary technique for high availability is redundancy, otherwise known as throwing hardware at the problem. Although the eventual failure of an individual server is certain, the simultaneous failure of two servers is unlikely enough that this provides a good level of redundancy for most applications.
One of the simplest ways to build a redundant pair of servers is to have them share an IP address using Heartbeat. Heartbeat is a daemon which runs on both machines and exchanges regular messages—heartbeats—between the two. One server is the primary, and normally has the resource: in this case, an IP address (known as a virtual IP, or VIP). If the secondary server fails to detect a heartbeat from the primary, it can take over the address, ensuring continuity of service.
In this recipe, we'll set up two machines in this configuration...