Cloud Bytes — selected guide
Dataflow in a minute
Twelve one-minute orientations across compute, data, operations, networking, and security
Twelve short primers introduce the roles of Google Cloud compute, storage, databases, messaging, analytics, observability, networking, and access controls. These 2020–2022 overviews help orient service choices rather than provide deployment recipes.
In this collection Browse 12 summaries 7 of 12
Dataflow processes data into the format downstream systems need. This 2020 primer describes a pipeline that reads from an input source, transforms the data, and writes to an output destination, or sink. Dataflow provisions and scales the worker virtual machines that run that pipeline 00:00–00:55(opens in a new tab).
Key Points Covered
- One pipeline model covers batch and streaming data: Apache Beam supplies open-source libraries for defining the processing, and Dataflow executes it as a job. The primer's portability claim concerns that pipeline model, not every deployment or operational choice 00:00–00:55(opens in a new tab).
- Write a pipeline or reuse a template: The 2020 overview includes custom code, prebuilt and custom templates, and SQL-based authoring. Suggested uses include stream analytics and preparing data for a warehouse 00:55–01:49(opens in a new tab).
Full video: https://www.youtube.com/watch?v=XdsuDOQ9nkU(opens in a new tab)