hadoop-single-node-cluster

This will install a single node hadoop cluster on a machine with single command. This is intended as use for a dev setup or simple testing.

• This is part of NeverwinterDP the Data Pipeline for Hadoop

Help WANTED

• Looking for help adding Ubuntu Support

Installation

• Two Methods
  • Remote - One liner from Github
  • Local - From local copy of the repo

Remote - One liner

  curl -sSL https://raw.githubusercontent.com/DemandCube/hadoop-single-node-cluster/master/INSTALL-HADOOP | bash -s -- -r

Local - Run from local repo

git clone https://github.com/DemandCube/hadoop-single-node-cluster.git
cd hadoop-single-node-cluster
./INSTALL-HADOOP

NOTE: Meant to be run as root

Services

• HDFS
• Yarn
• MapReduce2
• Storm
• Hive
• Tez
• Oozie
• Ambari
• Pig
• HCat
• WebHCat
• Zookeeper
• Nagios
• Ganglia
• Sqoop
• Falcon

Compatibility

OS

• CentOS 6.5

Should be good on RED-HAT Family of Distros

ENVIRONMENTS (Been tested on)

• vagrant (centos 6.5 x86_64)
• ec2 (centos 6.5 x86_64)
• digitalocean (centos 6.5 x86_64)

Usage

---

INSTALL-HADOOP

Usage: INSTALL-HADOOP [-rf]
This will

    -r,                              (Optional) REMOTE - Pulls all templates as remote 
    -f,                              (Optional) FORCE  - Forces in install if less them 4 gigs of ram

---

Contributing

See the [NeverwinterDP Guide to Contributing] (https://github.com/DemandCube/NeverwinterDP#how-to-contribute)