Reading remote files
We've given these functions names such as local_text
and local_gzip
because the files are located on our local machine. We might want to write other variations that use urrlib.request.urlopen()
to open remote files. For example, we might have a log file on a remote server that we'd like to process. This allows us to write a generator function, which yields lines from a remote file allowing us to interleave processing and downloading in a single operation.
We can use the urllib.request
module to handle remote files using URLs of this form: ftp://username:password@/server/path/to/file
. We can also use URLs of the form file:///path/to/file to read local files. Because of this transparency, we might want to look at using urllib.request
for all file access.
As a practical matter, it's somewhat more common to use FTP to acquire files in bulk.