Section 3 Apache Beam: Advanced Concepts
In this section, you will cover more advanced concepts and see how splittable DoFn closes the gap between batch and streaming I/Os. It also covers how to use splittable DoFn for non-I/O applications. The section ends with a detailed explanation of how a typical Apache Beam runner evaluates pipelines, and what are the typical building blocks of such a runner.
This section comprises the following chapters:
- Chapter 7, Extending Apache Beam's I/O Connectors
- Chapter 8, Understanding How Runners Execute Pipelines