Introducing SageMaker Pipelines and Model Registry
In previous chapters of this book, you were introduced to different options in SageMaker to process data, extract features, train models, and deploy models. These options provide you with the flexibility to pick the components of SageMaker that work best for your use case and stitch them together as a workflow. In most cases, these workflows are repeatable and need to be executed in different environments. Hence, you need to maintain them using an external orchestrating tool that helps you design the workflow and maintain it for repeated runs. This is where SageMaker Pipelines comes in.
SageMaker Pipelines is a model-building pipeline that allows you to create a visual directed acyclic graph (DAG) for the various steps of your model-building process and manage it as a repeatable workflow. The DAG is exported in JSON format and provides details about relationships between each step in the pipeline. You can pass the output of one...