The internet, and the WWW (World Wide Web), is probably the most prominent source of information today. Most of that information is retrievable through the HTTP protocol. HTTP was invented originally to share pages of hypertext (hence the name HyperText Transfer Protocol), which started the WWW.
This operation is very familiar, as it is what happens in any web browser. But we can also perform those operations programmatically to automatically retrieve and process information. Python has included in the standard library an HTTP client, but the fantastic requests module makes it very easy. In this chapter, we will see how.