Learning Apache Spark 2

A beginner's guide to real-time Big Data processing using the Apache Spark framework

Publisher:Packt Publishing Limited

By: Muhammad Asif Abbasi

Paid access

|Jan 2025

E-Book €30.99Institutions €130.95

Description

Learn the fundamentals of Apache Spark 2 and build high-value Big Data solutions with ease

Key Features

Familiarize yourself with the new features introduced in Apache Spark 2, as well as its components for Big Data processing and analytics
Manipulate your data, perform stream analytics and machine learning, and deploy your Spark models to production using practical examples
If you are new to Apache Spark and want to quickly get started with it, this book will help you

Book Description

Apache Spark has seen an unprecedented growth in terms of its adoption over the last few years, mainly because of its speed, diversity and real-time data processing capabilities. It has quickly become the preferred choice of tool for many Big Data professionals looking to find quick insights from large chunks of data. This book introduces you to the Apache Spark framework, and familiarizes you with all the latest features and capabilities introduced in Spark 2.
Starting with a detailed introduction to Spark’s architecture and the installation procedure, this book covers everything you need to know about the Spark framework in the most practical manner. You will learn how to perform the basic ETL activities using Spark, and work with different components of Spark such as Spark SQL, as well as the Dataset and DataFrame APIs for manipulating your data. Then, you will perform machine learning using Spark MLlib, as well as perform streaming analytics and graph processing using the Spark Streaming and GraphX modules respectively. The book also gives special emphasis on deploying your Spark models, and how they can be operated in a clustered mode.
During the course of the book, you will come across implementations of different real-world use-cases and examples, giving you the hands-on knowledge you need to use Apache Spark in the best possible manner.

What you will learn

Get a thorough overview of Big Data processing and analytics, and its importance to organizations and data professionals
Get familiarized with the Apache Spark ecosystem, and the new features released in Spark 2 for data processing and analysis
Get a thorough understanding of different modules of Apache Spark such as Spark SQL, Spark RDD, Spark Streaming, Spark MLlib and GraphX
Work with data of different file formats, and learn how to process it with Apache Spark
Introduce yourself to SparkR and walk through the details of data munging including selecting, aggregating and grouping data using R studio
Realize how to deploy Spark with YARN, MESOS or a Stand-alone cluster manager
Build effective recommendation engines with Spark using collaborative filtering

Who this book is for

This book is intended for aspiring Big Data professionals and anyone who wants to get started with Apache Spark for Big Data processing and analytics. If you’ve worked with Apache Spark before and want to get familiarized with the new features introduced in Spark 2, this book will also help you. Some fundamental understanding of Big Data concepts and knowledge of Scala programming is required to get the best out of this book.