Adding a new engine
The ultimate thing you can do with Optimus is expand its functionality to make it do whatever you want. In this section, we will explore how Optimus is structured so that can know where to go to expand or add specific functionality. To make this a complete exercise and understand where every piece goes, we'll add a completely new engine, such as pandas, Dask, cuDF, or Dask-cuDF. Here, we'll be adding Vaex as the engine of choice.
Cloning the repository from GitHub
To start, let's clone a clean Optimus repository from GitHub. Be aware that the file path and Optimus's internal structure may change a little in upcoming releases:
- First, let's clone the Optimus repository. From the CLI, enter
git clone
https://github.com/ironmussa/Optimus.git.The easiest way to test the new code in Optimus is by using a couple of handy comments from a Jupyter Notebook.
In the first cell, add the following:
%load_ext autoreload %autoreload 2
This will...