Saving a dataframe
Saving on Optimus can be done by simply calling any of the methods available on the save
accessor of a dataframe instance. In this section, we'll learn how to save to a local or remote filesystem, and also to a previously established database or remote storage connection.
When saving data in files, it is important to understand which format to use so that you can gain speed when reading or processing. There is plenty of information available about how to select the correct date format. I like the following for simplicity:
(Datanami, https://www.datanami.com/2018/05/16/big-data-file-formats-demystified/)