Have a personal or library account? Click to login
Machine Learning with Spark Cover

Machine Learning with Spark

Develop intelligent, distributed machine learning systems

Paid access
|Sep 2025
Product purchase options

Create scalable machine learning applications to power a modern data-driven business using Spark 2.x

Key Features

  • Get to the grips with the latest version of Apache Spark
  • Utilize Spark's machine learning library to implement predictive analytics
  • Leverage Spark’s powerful tools to load, analyze, clean, and transform your data

Book Description

This book will teach you about popular machine learning algorithms and their implementation. You will learn how various machine learning concepts are implemented in the context of Spark ML. You will start by installing Spark in a single and multinode cluster. Next you'll see how to execute Scala and Python based programs for Spark ML. Then we will take a few datasets and go deeper into clustering, classification, and regression. Toward the end, we will also cover text processing using Spark ML.

Once you have learned the concepts, they can be applied to implement algorithms in either green-field implementations or to migrate existing systems to this new platform. You can migrate from Mahout or Scikit to use Spark ML.

By the end of this book, you will acquire the skills to leverage Spark's features to create your own scalable machine learning applications and power a modern data-driven business.

What you will learn

  • Get hands-on with the latest version of Spark ML
  • Create your first Spark program with Scala and Python
  • Set up and configure a development environment for Spark on your own computer, as well as on Amazon EC2
  • Access public machine learning datasets and use Spark to load, process, clean, and transform data
  • Use Spark s machine learning library to implement programs by utilizing well-known machine learning models
  • Deal with large-scale text data, including feature extraction and using text data as input to your machine learning models
  • Write Spark functions to evaluate the performance of your machine learning models

Who this book is for

If you have a basic knowledge of machine learning and want to implement various machine-learning concepts in the context of Spark ML, this book is for you. You should be well versed with the Scala and Python languages.

Table of Contents

  1. Getting Up and Running with Spark
  2. Maths for Machine Learning
  3. Designing a Machine Learning System
  4. Obtaining, Processing, and Preparing Data with Spark
  5. Building a Recommendation Engine with Spark
  6. Building a Classification Model with Spark
  7. Building a Regression Model with Spark
  8. Building a Clustering Model with Spark
  9. Dimensionality Reduction with Spark
  10. Advanced Text Processing with Spark
  11. Real-time Machine Learning with Spark Streaming
  12. Pipeline APIs for Spark ML
https://github.com/packtpublishing/machine-learning-with-spark
PDF ISBN: 978-1-78588-642-3
Publisher: Packt Publishing Limited
Copyright owner: © 2017 Packt Publishing Limited
Publication date: 2025
Language: English
Pages: 532