Creating GitHub repos
So, we are going to set up our GitHub infrastructure and use GitHub Actions. First things first, let’s create our repositories. They will have empty README files. I am going to create five repositories, one for infrastructure as code, one for docs, one for an ML application, one for an ETL application, and one to manage DDL:
infra
:gh repo create infra-project --
public --add-readme
docs
:gh repo create docs-project --
public --add-readme
ML-Job
:gh repo create ML-Jobs-project --
public --add-readme
ETL-Jobs
:gh repo create ETL-Jobs-project --
public --add-readme
SCHEMA-Jobs
:gh repo create SCHEMA-Jobs-project --
public --add-readme
Now that every repo is created, let’s introduce a new tool we will use on all the Python repositories. We will use Poetry to manage our projects, which is a very easy-to-use package management system. It will also allow you to deploy Python applications very easily to PyPI. To install Poetry...