In this video, explore a scenario about complex event data pipelines.
- [Instructor] Many of the Big Data pipelines … that I work on process events. … And you might be surprised at the complexity … of scenarios such as the one shown here. … Now I want to highlight the sections … that focus on data processing. … When we're thinking about what type of services … we can use on GCP, to process massive amounts of data, … there are a number of services … that have been available for a while and some new ones too. … So in this typical type of complex … event processing architecture, … you have needs to process information coming in, … from both streaming and batch. … And in this case, the streaming information … is coming in through Pub/Sub. … Notice the processing is being handled by Cloud Dataflow. … And then the processed events … are being dumped into Cloud Bigtable. … For batch, we're using ETL to do pre-processing on the data … as it sent in each batch. … The data is then dumped into another … instance of Cloud Dataflow, which is a Rules Engine, … and another service for even more rules processing, …
- Enterprise concerns
- Enterprise scenarios
- Setting up your organization’s account
- Managing billing
- Enterprise compute services
- Enterprise storage and database services
- Enterprise data pipelines
- GCP developer and DevOps tools
Skill Level Intermediate
Working with cloud services1m 13s
1. GCP for the Enterprise
2. Enterprise Setup and Security
3. Enterprise Compute
4. Enterprise Storage and Database
5. Enterprise Data Pipelines
6. Dev and DevOps Tools
Next steps1m 20s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.