Apache Spark 2 for Beginners

Rajanarayanan Thottuvaikkatumana



Develop large-scale distributed data processing applications using Spark 2 in Scala and Python

Spark is one of the most widely-used large-scale data processing engines and runs extremely fast. It is a framework that has tools that are equally useful for application developers as well as data scientists.

This book starts with the fundamentals of Spark 2 and covers the core data processing framework and API, installation, and application development setup. Then the Spark programming model is introduced through real-world examples followed by Spark SQL programming with DataFrames. An introduction to SparkR is covered next. Later, we cover the charting and plotting features of Python in conjunction with Spark data processing. After that, we take a look at Spark's stream processing, machine learning, and graph processing libraries. The last chapter combines all the skills you learned from the preceding chapters to develop a real-world Spark application.

By the end of this book, you will have all the knowledge you need to develop efficient large-scale applications using Apache Spark.

Table of Contents

1: SPARK FUNDAMENTALS
2: SPARK PROGRAMMING MODEL
3: SPARK SQL
4: SPARK PROGRAMMING WITH R
5: SPARK DATA ANALYSIS WITH PYTHON
6: SPARK STREAM PROCESSING
7: SPARK MACHINE LEARNING
8: SPARK GRAPH PROCESSING
9: DESIGNING SPARK APPLICATIONS