I am trying to develop Chef cookbooks to Deploy and Manage Hadoop Cluster (specifically MapR).
As per my understanding Chef is a good tool to install hadoop cluster in an automated way. But I am not sure how Chef can help to manage/change configuration of Hadoop cluster after installation and can build cluster to the state where cluster goes down completely (in case of Disaster Recovery).
From my experience with Hadoop , Chef/Puppet/Ansible or any other configuration management tool is good for installing/deploying Hadoop Distribution (Cloudera, HDP or MapR) but it is best to manage Hadoop configuration using their CM tools (like Cloudera Manager for CDH distro , Ambari for HDP and MapR CM for Mapr)