# cdh 6.3.2部署安裝
## 版本信息
| 節(jié)點(diǎn)? ? ? | ip地址? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? | mysql? ? | parcel文件離線源 | cm? ? | cdh? |
| ------- | --------------------------------------- | -------- | ----------- | ----- | ----- |
| hadoop1 | 172.31.66.128? ? ? ? ? ? 172.31.182.223 |? ? ? ? ? | parcel? ? ? | 6.3.1 | 6.3.2 |
| hadoop2 | 172.31.66.129? ? ? ? ? ? ? ? ? ? ? ? ? | mysql5.7 |? ? ? ? ? ? | 6.3.1 | 6.3.2 |
| hadoop3 | 172.31.66.130? ? ? ? ? ? ? ? ? ? ? ? ? |? ? ? ? ? |? ? ? ? ? ? | 6.3.1 | 6.3.2 |
## 下載地址
### cm 6.3.1
```
https://archive.cloudera.com/cm6/6.3.1/repo-as-tarball/cm6.3.1-redhat7.tar.gz
```
### cdh 6.3.2
```
https://archive.cloudera.com/cdh6/6.3.2/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel
https://archive.cloudera.com/cdh6/6.3.2/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel.sha1
https://archive.cloudera.com/cdh6/6.3.2/parcels/manifest.json
```
### jdk
```
https://www.oracle.com/technetwork/java/javase/downloads/java-archive-javase8-2177648.html
```
### mysql
```
https://dev.mysql.com/downloads/mysql/5.7.html#downloads
```
### mysql jdbc jar:
```
https://dev.mysql.com/downloads/connector/j/
```
## 環(huán)境部署
### 1 修改集群節(jié)點(diǎn)基本信息
```
修改集群節(jié)點(diǎn)hadoop1信息：
? 1 hostnamectl set-hostname hadoop1.example.com
? 2 設(shè)置所有節(jié)點(diǎn)的hosts文件
? 172.31.66.128 hadoop1.example.com hadoop1
? 172.31.66.129 hadoop2.example.com hadoop2
? 172.31.66.130 hadoop3.example.com hadoop3
? 3 關(guān)閉防火墻
? systemctl stop firewalld
? systemctl disable firewalld
? 4 修改selinux配置信息
? vim /etc/selinux/config
? ? 將selinux=enforcing改為disabled
? 5 設(shè)置集群各節(jié)點(diǎn)之間免秘鑰登錄
? ssh-keygen
? ssh-copy-id root@hadoop2
? ssh-copy-id root@hadoop3
集群節(jié)點(diǎn)hadoop2犯戏、hadoop3參照節(jié)點(diǎn)1的部署修改基本信息
```
### 2 設(shè)置集群時(shí)鐘同步
```
所有節(jié)點(diǎn)安裝ntp
yum install ntp
修改ntp服務(wù)器配置送火，將所有節(jié)點(diǎn)的ntp同步指向hadoop1
如下hadoop1服務(wù)器ntp配置文件：
driftfile /var/lib/ntp/drift
restrict default nomodify notrap nopeer noquery
restrict 127.0.0.1
restrict ::1
server 127.127.1.0? ? ? ? ? ? ? ? ? ? ? ? //該行如下面一行表示以本地時(shí)鐘為同步時(shí)鐘源
fudge 127.127.1.0 stratum 10
includefile /etc/ntp/crypto/pw
keys /etc/ntp/keys
disable monitor
You have new mail in /var/spool/mail/root
hadoop2、hadoop3服務(wù)器ntp配置文件如下：
driftfile /var/lib/ntp/drift
restrict default nomodify notrap nopeer noquery
restrict 127.0.0.1
restrict ::1
server 172.31.66.128? ? ? ? ? ? ? ? ? ? ? //服務(wù)器時(shí)鐘同步指向hadoop1
includefile /etc/ntp/crypto/pw
keys /etc/ntp/keys
disable monitor
```
### 3部署jdk
```
hadoop集群所有節(jié)點(diǎn)部署jdk
```
### 4 離線安裝部署mysql
```
創(chuàng)建cdh的元數(shù)據(jù)庫(kù)和用戶先匪、amon服務(wù)的數(shù)據(jù)庫(kù)
create database cmf default character utf8;
create database amon default character set utf8;
grant all on cmf.* to 'cmf'@'%' identified by 'admin123';
grant all on amon.* to 'amon'@'%' identified by 'admin123';
flush privileges;
```
### 5 hadoop1節(jié)點(diǎn)部署mysql jdbc jar
```
將下載的jar包安裝部署在/usr/share/java目錄下种吸，并將其重命名為mysql-connector-java.jar，否則在啟動(dòng)服務(wù)的時(shí)候會(huì)報(bào)錯(cuò)
```
### 6 hadoop1節(jié)點(diǎn)作為master節(jié)點(diǎn)呀非，安裝如下安裝包(不下載依賴包直接部署)
```
解壓下載的cm文件坚俗，安裝相應(yīng)的安裝包
rpm -ivh cloudera-manager-server-6.3.1-1466458.el7.x86_64.rpm --nodeps --force
rpm -ivh cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm --nodeps --force
rpm -ivh cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm --nodeps --force
安裝好相應(yīng)安裝包后修改hadoop1節(jié)點(diǎn)angent指向
sed -i "s/server_host=localhost/server_host=hadoop1/g" /etc/cloudera-scm-agent/config.ini
修改主節(jié)點(diǎn)server配置
com.cloudera.cmf.db.type=mysql
com.cloudera.cmf.db.host=hadoop2.example.com
com.cloudera.cmf.db.name=cmf
com.cloudera.cmf.db.user=cmf
com.cloudera.cmf.db.password=admin23
com.cloudera.cmf.db.setupType=EXTERNAL
```
### 7 集群中除去Hadoop1節(jié)點(diǎn)安裝如下安裝包
```
解壓下載的cm文件，安裝相應(yīng)的安裝包
rpm -ivh cloudera-manager-daemons-6.3.1-1466458.el7.x86_64.rpm --nodeps --force
rpm -ivh cloudera-manager-agent-6.3.1-1466458.el7.x86_64.rpm --nodeps --force
安裝好相應(yīng)安裝包后修改hadoop1節(jié)點(diǎn)angent指向
sed -i "s/server_host=localhost/server_host=hadoop1/g" /etc/cloudera-scm-agent/config.ini
```
### 8部署parcel源
```
采用hadoop1作為httpd服務(wù)地址
yum install httpd -y
將下載菜單cdh的安裝包解壓到/var/www/html下
[root@hadoop1 java]# ls /var/www/html/cdh6_parcel
CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel? CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel.sha（注意這個(gè)文件）? manifest.json
```
### 9啟動(dòng)server服務(wù)
```
systemctl start cloudera-scm-server
如果無(wú)法啟動(dòng)成功岸裙，查看日志進(jìn)行解決
tailf /var/log/cloudera-scm-server/cloudera-scm-server.log
```
### 10 所有節(jié)點(diǎn)啟動(dòng)agent服務(wù)
```
systemctl start cloudera-scm-agent
```
