Description
There s been a lot of buzz about Big Data over the past few years^ and it s finally become mainstream for many companies. But what is this Big Data? This course covers the fundamentals of Big Data via PySpark. Spark is “lightning fast cluster computing framework for Big Data. It provides a general data processing platform engine and lets you run programs up to 100x faster in memory^ or 10x faster on disk^ than Hadoop. You’ll use PySpark^ a Python package for spark programming and its powerful^ higher-level libraries such as SparkSQL^ MLlib (for machine learning)^ etc.^ to interact with works of William Shakespeare^ analyze Fifa football 2018 data and perform clustering of genomic datasets. At the end of this course^ you will gain an in-depth understanding of PySpark and it’s application to general Big Data analysis.