Real-Time Big Data Analytics

Design, process, and analyze large sets of complex data in real time

Publisher:Packt Publishing Limited

By: Shilpi Saxena

Paid access

|Jul 2025

E-Book €30.99Institutions €130.95

Description

Design, process, and analyze large sets of complex data in real time

Key Features

Get acquainted with transformations and database-level interactions, and ensure the reliability of messages processed using Storm
Implement strategies to solve the challenges of real-time data processing
Load datasets, build queries, and make recommendations using Spark SQL

Book Description

Enterprise has been striving hard to deal with the challenges of data arriving in real time or near real time.
Although there are technologies such as Storm and Spark (and many more) that solve the challenges of real-time data, using the appropriate technology/framework for the right business use case is the key to success. This book provides you with the skills required to quickly design, implement and deploy your real-time analytics using real-world examples of big data use cases.

From the beginning of the book, we will cover the basics of varied real-time data processing frameworks and technologies. We will discuss and explain the differences between batch and real-time processing in detail, and will also explore the techniques and programming concepts using Apache Storm.

Moving on, we’ll familiarize you with “Amazon Kinesis” for real-time data processing on cloud. We will further develop your understanding of real-time analytics through a comprehensive review of Apache Spark along with the high-level architecture and the building blocks of a Spark program.
You will learn how to transform your data, get an output from transformations, and persist your results using Spark RDDs, using an interface called Spark SQL to work with Spark.

At the end of this book, we will introduce Spark Streaming, the streaming library of Spark, and will walk you through the emerging Lambda Architecture (LA), which provides a hybrid platform for big data processing by combining real-time and precomputed batch data to provide a near real-time view of incoming data.

What you will learn

Explore big data technologies and frameworks
Work through practical challenges and use cases of real-time analytics versus batch analytics
Develop real-word use cases for processing and analyzing data in real-time using the programming paradigm of Apache Storm
Handle and process real-time transactional data
Optimize and tune Apache Storm for varied workloads and production deployments
Process and stream data with Amazon Kinesis and Elastic MapReduce
Perform interactive and exploratory data analytics using Spark SQL
Develop common enterprise architectures/applications for real-time and batch analytics

Who this book is for

If you are a Big Data architect, developer, or a programmer who wants to develop applications/frameworks to implement real-time analytics using open source technologies, then this book is for you.

Introducing Big Data Technology Landscape and Analytics Platform
Getting acquainted with Storm
Processing data with Storm
Introduction to Trident and Optimizing the Storm Performance
Getting acquainted with Kinesis
Getting acquainted with Spark
Programming with RDDs
Sql Query Engine for Spark - Spark Sql
Machine Learning using Spark MLLib
Introducing the Lambda Architecture

Table of contents

Authors

Metrics

PDF ISBN: 978-1-78439-740-1

Publisher: Packt Publishing Limited

Publication date: 2025

Language: English

Pages: 326

Related subjects:

Computer sciences,

Databases and data mining

Real-Time Big Data Analytics

Key Features

Book Description

What you will learn

Who this book is for

Table of Contents

People also read

Publications carousel

Practical Real-time Data Processing and Analytics

Practical Big Data Analytics

Big Data in Practice

An Architecture for Fast and General Data Processing on Large Clusters

Big Data Analytics with Java

Frontiers of Multimedia Research

Stream Analytics with Microsoft Azure

Practical Predictive Analytics

Scala and Spark for Big Data Analytics

Paradigm

My account