操作系統(tǒng): CentOs6.4 虛擬機(jī)（4核 3G）
主機(jī)： cdh01(server & agent) + cdh02( agent )
CDH版本：cdh5.7.1
jdk8
準(zhǔn)備工作
關(guān)閉防火墻
在兩臺(tái)主機(jī)上都運(yùn)行一下命令
service iptables stop
設(shè)置主機(jī)名
vim /etc/sysconfig/network
將HOSTNAME 分別改成cdh01和cdh02：
NETWORKING=yes
HOSTNAME=cdh01
重啟生效
service network restart
修改/etc/hosts
vim /etc/hosts
加上如下兩行（兩臺(tái)主機(jī)同樣操作）：
192.168.132.140 cdh01
192.168.132.141 cdh02
設(shè)置ssh免密登陸
兩臺(tái)主機(jī)上均一下運(yùn)行留凭，出現(xiàn)提示一直回車(chē)即可
ssh-keygen
在cdh01主機(jī)上運(yùn)行:
ssh-copy-id cdh02
在cdh02主機(jī)上運(yùn)行:
ssh-copy-id cdh01
開(kāi)啟時(shí)間同步(每臺(tái))
service ntpd start
jdk安裝
[root@localhost opt]# rpm -ivh jdk-8u45-linux-x64.rpm
[root@localhost opt]# java -version
java version "1.8.0_45"
Java(TM) SE Runtime Environment (build 1.8.0_45-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.45-b02, mixed mode)
CM安裝
Server端安裝
創(chuàng)建目錄
mkdir /opt/cloudera-manager
解壓CM到/opt/cloudera-manager目錄
tar -zxvf cloudera-manager-el6-cm5.7.1_x86_64.tar.gz -C /opt/cloudera-manager
創(chuàng)建cloudera-scm用戶
useradd --system --home=/opt/cloudera-manager/cm-5.7.1/run/cloudera-scm-server/ --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm
創(chuàng)建本地元數(shù)據(jù)存放目錄
mkdir /var/cloudera-scm-server
修改文件夾所屬用戶
chown cloudera-scm:cloudera-scm /var/cloudera-scm-server/
chown cloudera-scm:cloudera-scm /opt/cloudera-manager/
修改配置文件瑰艘，設(shè)置CM server host
vim /opt/cloudera-manager/cm-5.7.1/etc/cloudera-scm-agent/config.ini
# Hostname of the CM server.
server_host=cdh01
創(chuàng)建parcel-repo倉(cāng)庫(kù)目錄
mkdir -p /opt/cloudera/parcel-repo
將
CDH-5.7.1-1.cdh5.7.1.p0.11-el6.parcel,
CDH-5.7.1-1.cdh5.7.1.p0.11-el6.parcel.sha,
manifest.json
三個(gè)文件拷到/opt/cloudera/parcel-repo下
創(chuàng)建parcels目錄并改變所屬用戶
mkdir -p /opt/cloudera/parcels
chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
mysql安裝及配置
安裝并啟動(dòng)mysql
yum -y install mysql mysql-server mysql-devel
service mysql start
登陸酸员、設(shè)置root密碼珊佣、開(kāi)放遠(yuǎn)程登陸權(quán)限
mysql -u root
mysql> use mysql;
mysql> update user set password='你的密碼' where user='root';
mysql> grant all privileges on *.* to 'root'@'%' identified by '你的密碼' with grant option;
mysql driver包
mysql-connector-java-5.1.35.jar放到/opt/cloudera-manager/cm-5.7.1/share/cmf/lib目錄下
初始化mysql
/opt/cloudera-manager/cm-5.7.1/share/cmf/schema/scm_prepare_database.sh mysql -hcdh02 -uroot -p你的密碼 --scm-host cdh02 scmdbn root 你的密碼
啟動(dòng)Server砸彬、Agent
/opt/cloudera-manager/cm-5.7.1/etc/init.d/cloudera-scm-server start
/opt/cloudera-manager/cm-5.7.1/etc/init.d/cloudera-scm-agent start
驗(yàn)證
訪問(wèn) http://ip:7180
Agent端安裝
創(chuàng)建目錄
mkdir /opt/cloudera-manager
解壓CM到/opt/cloudera-manager目錄
tar -zxvf cloudera-manager-el6-cm5.7.1_x86_64.tar.gz -C /opt/cloudera-manager
創(chuàng)建cloudera-scm用戶
useradd --system --home=/opt/cloudera-manager/cm-5.7.1/run/cloudera-scm-server/ --no-create-home --shell=/bin/false --comment "Cloudera SCM User" cloudera-scm
修改配置文件讼昆，設(shè)置CM server host
vim /opt/cloudera-manager/cm-5.7.1/etc/cloudera-scm-agent/config.ini
# Hostname of the CM server.
server_host=cdh01
創(chuàng)建parcels目錄并改變所屬用戶
mkdir -p /opt/cloudera/parcels
chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
Agent啟動(dòng)
/opt/cloudera-manager/cm-5.7.1/etc/init.d/cloudera-scm-agent start
掃碼關(guān)注微信公眾號(hào)"Kooola大數(shù)據(jù)"陡叠，聊人生|聊技術(shù)
