Have a personal or library account? Click to login
Building Data Streaming Applications with Apache Kafka Cover

Building Data Streaming Applications with Apache Kafka

Design, develop and streamline applications using Apache Kafka, Storm, Heron and Spark

Paid access
|Sep 2025
Product purchase options

Design and administer fast, reliable enterprise messaging systems with Apache Kafka

Key Features

  • Build efficient real-time streaming applications in Apache Kafka to process data streams of data
  • Master the core Kafka APIs to set up Apache Kafka clusters and start writing message producers and consumers
  • A comprehensive guide to help you get a solid grasp of the Apache Kafka concepts in Apache Kafka with pracitcalpractical examples

Book Description

Apache Kafka is a popular distributed streaming platform that acts as a messaging queue or an enterprise messaging system. It lets you publish and subscribe to a stream of records, and process them in a fault-tolerant way as they occur.

This book is a comprehensive guide to designing and architecting enterprise-grade streaming applications using Apache Kafka and other big data tools. It includes best practices for building such applications, and tackles some common challenges such as how to use Kafka efficiently and handle high data volumes with ease. This book first takes you through understanding the type messaging system and then provides a thorough introduction to Apache Kafka and its internal details. The second part of the book takes you through designing streaming application using various frameworks and tools such as Apache Spark, Apache Storm, and more. Once you grasp the basics, we will take you through more advanced concepts in Apache Kafka such as capacity planning and security.

By the end of this book, you will have all the information you need to be comfortable with using Apache Kafka, and to design efficient streaming data applications with it.

What you will learn

  • Learn the basics of Apache Kafka from scratch
  • Use the basic building blocks of a streaming application
  • Design effective streaming applications with Kafka using Spark, Storm &, and Heron
  • Understand the importance of a low -latency , high- throughput, and fault-tolerant messaging system
  • Make effective capacity planning while deploying your Kafka Application
  • Understand and implement the best security practices

Who this book is for

If you want to learn how to use Apache Kafka and the different tools in the Kafka ecosystem in the easiest possible manner, this book is for you. Some programming experience with Java is required to get the most out of this book

Table of Contents

  1. Introduction to Messaging System
  2. Introducing Kafka ? The Distributed Messaging Platform
  3. Deep Dive into Kafka Producers
  4. Deep Dive into Kafka Consumers
  5. Building Spark Streaming Applications with Kafka
  6. Building Storm Applications with Kafka
  7. Using Kafka with Confluent Platform
  8. Building ETL Pipelines Using Kafka
  9. Building Streaming Applications Using Kafka Streams
  10. Kafka Cluster Deployment
  11. Using Kafka in Big Data Applications
  12. Securing Kafka
  13. Streaming Applications Design Considerations
https://github.com/packtpublishing/building-data-streaming-applications-with-apache-kafka
PDF ISBN: 978-1-78728-763-1
Publisher: Packt Publishing Limited
Copyright owner: © 2017 Packt Publishing Limited
Publication date: 2025
Language: English
Pages: 278