Review file scaling considerations for a hybrid data pipeline.
- [Instructor] Now let's build on our hybrid cloud scenario.…In term of scalability, let's look at files.…And you might remember that the use case…is a really common one.…It's to integrate on-premises information…with an AWS solution that is a type of a data warehouse…and to provide aggregate information back out to the users.…So, we have some different functions to consider,…in terms of scalability, networking and compute,…files, data, and other data we'll get to…in the subsequent set of movies.…
So, for networking and compute,…we're hosting EMR and Redshift as our services…for networking and compute.…And, for scalability, we're concerned…with server configuration and cluster management.…For files, we learned a lot in this set of movies about S3.…We're concerned with cost, archiving, replication, security,…lifecycle management, bucket management.…Really, in essence, S3 needs to be managed…with the level of attention as a database.…Additionally, since we have data going back and forth…from on-premise up to the cloud, back down,…
Author
Released
5/29/2018- Scalability in AWS application design
- Scaling serverless vs. server-based applications
- Scaling files
- Storage design approaches
- Design approaches to scaling data and data storage
- Scaling SQL queries
- Understanding Data Migration Service
- Scaling applications
Skill Level Advanced
Duration
Views
Related Courses
-
Introduction
-
Welcome1m 50s
-
-
1. Scaling Networks
-
Networks in hybrid scenarios3m 24s
-
2. Scaling Files
-
Storage design approaches7m 29s
-
Moving files to the cloud5m 57s
-
Life cycle for file storage8m 19s
-
Scaling files in a data lake6m 18s
-
-
3. Scaling Data
-
Data design approaches3m 42s
-
Moving data to the cloud3m 50s
-
Scaling SQL queries10m 25s
-
Data in hybrid scenarios2m 59s
-
-
4. Scaling Applications
-
Application scaling patterns8m 16s
-
Scale a serverless website3m 22s
-
Scale a dynamic website6m 52s
-
Scale a big data pipeline5m 15s
-
-
Conclusion
-
Next steps2m 24s
-
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.
CancelTake notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.
Share this video
Embed this video
Video: Scaling files in hybrid scenarios