Ingesting and Processing Data: Pub/Sub, Dataflow and Dataproc
Building batch and streaming pipelines with Pub/Sub, Dataflow (Apache Beam), Dataproc and Data Fusion.
GCP-311 12 lessons planned ▶ Video lessons coming soon
Offered by HSM University · Google Cloud Certification Prep
Course content
- 1Pipeline planning and data sourcesComing
- 2Pub/Sub topics, subscriptions and deliveryComing
- 3Apache Beam programming modelComing
- 4Dataflow batch pipelinesComing
- 5Dataflow streaming: windows, triggers and watermarksComing
- 6Dataproc and Spark on Google CloudComing
- 7Serverless SparkComing
- 8Cloud Data Fusion pipelinesComing
- 9Change data capture with DatastreamComing
- 10Transformation in BigQuery with SQL and DataformComing
- 11Testing and deploying pipelinesComing
- 12Lab walkthrough: a streaming analytics pipelineComing
Requirements
Recommended background. You can start any course at any time.
Description
Building batch and streaming pipelines with Pub/Sub, Dataflow (Apache Beam), Dataproc and Data Fusion.