This book is useful for Hadoop administrators who need to learn how to monitor and diagnose their clusters. Also, the book will prove useful for new users of the technology, as the language used is simple and easy to grasp.
What you will learn
Install Nagios and Ganglia and understand logging at the operating system level
Create and configure Nagios nodes for monitoring with custom checks
Monitor Hadoop daemons such as NameNode, DataNode, JobTracker, and so on
Configure logs for various daemons and set up audits for the options done on the cluster
Track important parameters for the File System, MapReduce, and other counters
Set up Nagios master and client nodes with checks for the system and applications running on it
Configure the Hadoop metrics collection and visualize it for nontechnical users
Understand the communication between different daemons and protocols and the ports they use
Who this book is for
This book is useful for Hadoop administrators who need to learn how to monitor and diagnose their clusters. Also, the book will prove useful for new users of the technology, as the language used is simple and easy to grasp.
Table of Contents
Introduction to Monitoring
Hadoop daemons and Services
Hadoop Logging
Monitoring HDFS Checks
Monitoring MapReduce Checks
Visualizing Hadoop metrics using Ganglia
Monitoring for Hive, Hbase and other hadoop Components