Spark with ADAM for genomics

- [Narrator] We've covered a lot of territory,…looking at computation with Spark,…both at the core level with RDDs…and some of the lower level objects,…and with libraries such as SQL for Spark,…R for Spark, machine learning, so on and so forth.…I thought it would be interesting…to kind of pull this together,…and think about some use cases.…And a great place for us to look…is where Spark was actually invented,…at UC Berkeley.…So the AMPLab is a place that not only…works with Spark, lot of committers to Spark…actually are working there.…

But they extend Spark for some important use cases.…One that I've been particularly interested in…is cancer genomics.…So you can see in this relatively complex diagram…how Spark works in ecosystems to solve important problems.…At the very bottom, you'll remember…from earlier movies, you'll start…with some sort of resource virtualization,…and your choices include Apache Mesos or Yarn.…Next level up is you need storage for your data.…And you can see HDFS,…S3, and some other types of storage…