Latency
As covered in previous chapters, latency is the delay that occurs before an operation can complete, sometimes also known as lag. You may not be able to control the latency of the infrastructure that your software runs on, but you can write your application in such a way that it can cope with this latency in a graceful manner.
The two main types of latency that we will discuss here are network latency and disk latency. As the names suggest these are, respectively, the delay in performing an operation over the network and the delay to read from or write to a persistent storage medium. You will often deal with both at the same time, for example, a database (DB) query to a server on a remote virtual machine will require the following operations:
- A network operation from web server to DB server
- A network operation from DB server to remote disk on a Storage Area Network (SAN)
- A disk operation to look up data on the physical drive
Note
Although Solid State Drives (SSDs) have much lower...
