Big Data Analysis with Scala and Spark

  • flag Coursera
  • student All Levels
  • database eLearning
  • earth English
  • clock 28h


Manipulating big data distributed over a cluster using functional concepts is rampant in industry^ and is arguably one of the first widespread industrial uses of functional ideas. This is evidenced by the popularity of MapReduce and Hadoop^ and most recently Apache Spark^ a fast^ in-memory distributed collections framework written in Scala. In this course^ we ll see how the data parallel paradigm can be extended to the distributed case^ using Spark throughout. We ll cover Spark s programming model in detail^ being careful to understand how and when it differs from familiar programming models^ like shared-memory parallel collections or sequential Scala collections. Through hands-on examples in Spark and Scala^ we ll learn when important issues related to distribution like latency and network communication should be considered and how they can be addressed effectively for improved performance.

Covered topics:

  • Scala Programming
  • Big Data
  • Apache Spark
  • SQL