Mastering Apache Spark 2.x

Advanced techniques in complex Big Data processing, streaming analytics and machine learning

Publisher:Packt Publishing Limited

Paid access

|Aug 2017

E-Book €32.99Institutions €132.95

Advanced analytics on your Big Data with the latest Apache Spark 2.x

Key Features

Master the art of real-time Big Data processing using Apache Spark 2.x
Perform machine learning, deep learning and streaming data analytics by extending the most up-to-date functionalities of Apache Spark
An advanced guide with a unique combination of tips, instructions and practical examples on using Apache Spark effectively

Book Description

Apache Spark is an in-memory, cluster-based Big Data processing system that provides a wide range of functionalities such as graph processing, machine learning, stream processing, and more. This book will take your knowledge of Apache Spark to the next level by teaching you how to expand Spark’s functionality and build your data flows and machine/deep learning programs on top of the platform.

The book starts with a quick overview of the Apache Spark ecosystem, and introduces you to the new features and capabilities in Apache Spark 2.x. You will then work with the different modules in Apache Spark such as interactive querying with Spark SQL, using DataFrames and DataSets effectively, streaming analytics with Spark Streaming, and performing machine learning and deep learning on Spark using MLlib and external tools such as H20 and Deeplearning4j. The book also contains chapters on efficient graph processing, memory management and using Apache Spark on the cloud.

By the end of this book, you will have all the necessary information to master Apache Spark, and use it efficiently for Big Data processing and analytics.

What you will learn

Get to grips with the newly introduced features in Apache Spark 2.x
Perform highly optimised unified batch and real-time data processing using
SparkSQL and Structured Streaming
Evaluate large-scale Graph Processing and Analysis using GraphX and GraphFrames
Perform advanced machine learning and deep learning with Spark MLlib, SparkML, SystemML, H2O and DeepLearning4J
Learn how specific parameter settings affect overall performance of an
Apache Spark cluster
Apply Apache Spark in Elastic deployments using Jupyter and Zeppelin Notebooks, Docker, Kubernetes and the IBM Cloud

Who this book is for

If you are an intermediate-level Spark developer looking to master the advanced capabilities and use-cases of Apache Spark 2.x, this book is for you. Big Data professionals who wish to know how to integrate and use the features of Apache Spark to build a strong Big Data pipeline will also find this book to be a useful resource. A fundamental knowledge of Apache Spark and the Scala programming language is assumed.

A first taste and what
Apache Spark SQL
The Catalyst Optimizer
Project Tungsten
Apache Spark Streaming
Structured Streaming
Apache Spark MLlib
Apache SparkML
Apache SystemML
DeepLearning on Apache Spark with DeepLearning4J, ApacheSystemML,H2O
Apache Spark GraphX
ApacheSpark GraphFrames
ApacheSpark with Jupyter Notebooks on IBM DataScience Experience
ApacheSpark on Kubernetes

https://github.com/packtpublishing/mastering-apache-spark-2x

PDF ISBN: 978-1-78528-522-6

Publisher: Packt Publishing Limited

Publication date: 2017

Language: English

Pages: 354

Related subjects:

Computer sciences,

Databases and data mining

Mastering Apache Spark 2.x

Key Features

Book Description

What you will learn

Who this book is for

Table of Contents

People also read

Publications carousel

Learning Apache Spark 2

Apache Spark 2.x Cookbook

Apache Spark 2.x for Java Developers

Apache Spark Quick Start Guide

Fast Data Processing with Spark 2

Apache Spark for Machine Learning

Apache Spark 2.x Machine Learning Cookbook

Mastering Machine Learning with Spark 2.x

Mastering Spark for Data Science

Spark for Data Science

Paradigm

My account