Apache Flume: Distributed Log Collection for Hadoop - Second Edition

Key Features

Book Description

What you will learn

• Understand the Flume architecture, and also how to download and install open source Flume from Apache
• Follow along a detailed example of transporting weblogs in Near Real Time (NRT) to Kibana/Elasticsearch and archival in HDFS
• Learn tips and tricks for transporting logs and data in your production environment
• Understand and configure the Hadoop File System (HDFS) Sink
• Use a morphlinebacked Sink to feed data into Solr
• Create redundant data flows using sink groups
• Configure and use various sources to ingest data
• Inspect data records and move them between multiple destinations based on payload content
• Transform data enroute to Hadoop and monitor your data flows

Who this book is for