In this video, learn how to differentiate between shared memory architectures, in which all processors access the same memory space, and distributed memory architectures, which have separate memory spaces. Learn how to recognize the common symmetric multiprocessing architecture, which implements a shared uniform memory access (UMA) scheme and understand its relationship to non-uniform memory access (NUMA) architecture.
- In addition to a parallel computer's architecture … which can be categorized using Flynn's taxonomy, … another aspect to consider is, ugh. … (snapping finger) … - Memory. … It's important to understand how the memory is organized, … and how the computer accesses data. … - Right, you could put a billion processors in a computer … but if they can access memory fast enough … to get the instructions and data they need, … then you won't gain anything … from having all those processors. … Computer memory usually operates … at a much slower speed than processors do … and when one processor is reading or writing to memory, … that often prevents any other processors from accessing … that same memory element. … There are two main memory architectures … that exist for parallel computing, … shared memory and distributed memory. … In a shared memory system, … all processors have access to the same memory as part … of a global address space. … Although each processor operates independently, … if one processor changes a memory location, …
- Parallel vs. sequential computing
- Shared vs. distributed memory
- Execution scheduling
- Thread lifecycle
- Mutual exclusion
- Synchronized methods
- Checking for liveness
Skill Level Advanced
Java Essential Training: Objects and APIswith David Gassner2h 46m Intermediate
Java Essential Training: Syntax and Structurewith David Gassner3h 9m Intermediate
1. Parallel Computing Hardware
2. Threads and Processes
3. Mutual Exclusion
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.Cancel
Take notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.