系統(tǒng)環(huán)境centos6.8.5
jdk1.8
http://archive.cloudera.com/cm5/cm/5/cloudera-manager-el6-cm5.3.8_x86_64.tar.gz? ??
http://archive.cloudera.com/cdh5/parcels/latest/CDH-5.3.8-1.cdh5.3.8.p0.5-el6.parcel
http://archive.cloudera.com/cdh5/parcels/latest/CDH-5.3.8-1.cdh5.3.8.p0.5-el6.parcel.sha1
http://archive.cloudera.com/cdh5/parcels/5.3.8/manifest.json
cdh資源下載地址注意版本一定要相同??
3個(gè)節(jié)點(diǎn)集群hosts配置:
192.168.3.87 BJVPC3-87
192.168.3.88 BJVPC3-88
192.168.3.89 BJVPC3-89
Mysql5.6安裝 請(qǐng)參考:http://www.cnblogs.com/wangdaijun/p/6132632.html
安裝Cloudera Manager Server和Agent:
master3.87:/usr/local/src
tar zxvf cloudera-manager-el6-cm5.3.8_x86_64.tar.gz -C /opt/
vim /opt/cm-5.3.8/etc/cloudera-scm-agent/config.ini
下載 mysql 驅(qū)動(dòng)包:
cd?? /opt/cm-5.3.8/share/cmf/lib
wget http://maven.aliyun.com/nexus/service/local/repositories/hongkong-nexus/content/Mysql/mysql-connector-java/5.1.38/mysql-connector-java-5.1.38.jar
所有節(jié)點(diǎn)添加clouera-scm用戶:
useradd--system--home=/opt/cm-5.3.8/run/cloudera-scm-server/--no-create-home--shell=/bin/false--comment"Cloudera SCM User"cloudera-scm
準(zhǔn)備Parcels 安裝CDH5.38f
cd? /opt/cloudera/parcel-repo
將CHD5相關(guān)的parcel包放到所有節(jié)點(diǎn) /opt/cloudera/parcel-repo目錄
初始化數(shù)據(jù)庫:
cd /opt/cm-5.3.8/share/cmf/schema
./scm_prepare_database.sh mysql cm -h127.0.0.1 -uroot -phd123 --scm-hostBJVPC3-87 scm scm scm
成功后啟動(dòng)server和agent:
cd /opt/cm-5.3.8/etc/init.d
./cloudera-scm-agent start???? 所有節(jié)點(diǎn)都要執(zhí)行啟動(dòng)agent
./cloudera-scm-server start
登錄http://master:7180 管理界面 默認(rèn)用戶名密碼 admin:admin
此處如果出現(xiàn)以下警告韭寸,是一個(gè)默認(rèn)環(huán)境變量的問題马绝,Cloudera建議將/proc/sys/vm/swappiness設(shè)置為0,當(dāng)前設(shè)置為 60唐责。在所有節(jié)點(diǎn)執(zhí)行以下命令:?echo 0 > /proc/sys/vm/swappiness
保持默認(rèn) 安裝完成在添加其他節(jié)點(diǎn)
http://47.95.194.238:50070/dfshealth.html#tab-overview?? hdfs控制臺(tái)
參考連接:http://www.ymq.io/2017/09/24/Cloudera-Manager/
https://www.zybuluo.com/sasaki/note/242142
安裝opentsdb時(shí) 有一個(gè)注意的地方就是初始化hbase_home是如下這個(gè)
env COMPRESSION=NONE HBASE_HOME=/opt/cloudera/parcels/CDH-5.3.8-1.cdh5.3.8.p0.5/ ./src/create_table.sh