Review patterns for implementing HA for a big data pipeline including using VPC and redundant servers.
- [Instructor] This next scenario…is a mix of serverless and server based services…and another aspect that's interesting about it…is the volume of data going through,…it's a big data pipeline.…In this particular case we have for…compute, files, data, and other,…the following set of services.…For compute we're working with Lambda,…for files we're working with S3,…for data we're working with RDS Aurora in this case…and elastic map reduce…and we have some other services running.…We're running AWS data pipeline, the key management service,…and the simple notification service or SNS…so what are our HA considerations in this architecture?…By now we're probably familiar that…with Lambda we're concerned with versioning.…
Now you might be surprised that…I've added VPC configuration.…When Lambda first was released it wasn't available…to be placed in a VPC beings the idea that…serverless architectures didn't need VPCs…as I showed in an earlier movie,…however customers are using Lambda in ways…that Amazon didn't initially plan…
- Understanding high availability (HA)
- Preparing for HA
- Designing for HA
- Understanding continuous deployment (CD)
- Types of verification tests used in CD
- Server mutability and CD
- Implementing CD
- Advanced CD pipeline techniques
- CD pipeline with Step Functions
Skill Level Intermediate
1. Understanding High Availability
2. Design for High Availability
HA for a big data pipeline5m 51s
3. Understanding Continuous Deployment
4. Implementing Continuous Delivery
Next steps1m 6s
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.