Ambari環(huán)境配置
(2016-08-30)
1.安裝環(huán)境說(shuō)明
安裝前先安裝好 Centos 7.2, jdk-8u91, mysql5.7.13
2.操作系統(tǒng)環(huán)境準(zhǔn)備
2.1 配置SSH免密碼登錄
主節(jié)點(diǎn)里root用戶登錄執(zhí)行如下步驟:
ssh-keygen
cd ~/.ssh/
cat id_rsa.pub >>authorized_keys
chmod 700 ~/.ssh
chmod 600 ~/.ssh/authorized_keys
先在從節(jié)點(diǎn)登錄root執(zhí)行命令:
mkdir ~/.ssh/
分發(fā)主節(jié)點(diǎn)里配置好的authorized_keys到各從節(jié)點(diǎn):
scp /root/.ssh/authorized_keys root@192.168.62.:/root/.ssh/authorized_keys
2.2 創(chuàng)建ambari系統(tǒng)用戶和用戶組
只在主節(jié)點(diǎn)操作
添加ambari安裝玖绿、運(yùn)行用戶和用戶組随抠,也可以不創(chuàng)建新用戶,直接使用root或者系統(tǒng)其他賬號(hào)
adduser ambari
passwd ambari
2.3 開啟NTP服務(wù)
所有集群上節(jié)點(diǎn)都需要操作
yum install ntp
systemctl is-enabled ntpd
systemctl enable ntpd
systemctl start ntpd
2.4 檢查DNS和NSCD
所有節(jié)點(diǎn)都要設(shè)置:
ambari在安裝時(shí)需要配置全域名戳表,所以需要檢查DNS忆矛。為了減輕DNS的負(fù)擔(dān), 建議在節(jié)點(diǎn)里用 Name Service Caching Daemon (NSCD)
vi /etc/hosts
192.168.62.181 master1 master1.hd
192.168.62.182 master1 master1.hd
192.168.62.183 master1 master1.hd
192.168.62.183 master1 master1.hd
每臺(tái)節(jié)點(diǎn)里配置FQDN答倡,如下以主節(jié)點(diǎn)為例
vi /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=SY-001.hadoop
2.5 關(guān)閉防火墻
所有節(jié)點(diǎn)都要設(shè)置
Centos 7 命令
systemctl disable firewalld
systemctl stop firewalld
2.6 關(guān)閉SELinux
所有節(jié)點(diǎn)都要設(shè)置
查看SELinux狀態(tài):
sestatus
如果SELinux status參數(shù)為enabled即為開啟狀態(tài)
SELinux status: enabled
臨時(shí)關(guān)閉董济,不用重啟機(jī)器:
setenforce 0
修改配置文件需要重啟機(jī)器:
vi /etc/sysconfig/selinux
SELINUX=disabled
3.制作本地源
制作本地源只需在主節(jié)點(diǎn)上進(jìn)行即可
3.1 相關(guān)準(zhǔn)備工作
3.1.1安裝 Apache HTTP 服務(wù)器
安裝HTTP 服務(wù)器踱阿,允許 http 服務(wù)通過(guò)防火墻(永久)
yum install httpd
firewall-cmd --add-service=http
firewall-cmd --permanent --add-service=http
添加 Apache 服務(wù)到系統(tǒng)層使其隨系統(tǒng)自動(dòng)啟動(dòng)
systemctl start httpd.service
systemctl enable httpd.service
3.1.2 安裝本地源制作相關(guān)工具
yum install yum-utils createrepo
3.2 下載安裝資源
Ambari 2.2.2 下載資源:
OS Format URL
CentOS 7 Base URL http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.2.2.0
CentOS 7 Repo File http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.2.2.0/ambari.repo
CentOS 7 Tarball md5 asc http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.2.2.0/ambari-2.2.2.0-centos7.tar.gz
下載上面列表的中的壓縮包泽疆,
需要下載的壓縮包如下:
Ambari 2.2.2
http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.4.0.0/HDP-2.4.0.0-centos7-rpm.tar.gz
HDP 2.4.2
http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.2.2.0/ambari-2.2.2.0-centos7.tar.gz
HDP-UTILS 1.1.0
http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.20/repos/centos7/HDP-UTILS-1.1.0.20-centos7.tar.gz
在httpd網(wǎng)站根目錄,默認(rèn)是即/var/www/html/户矢,創(chuàng)建目錄ambari, 并且將下載的壓縮包解壓到/var/www/html/ambari目錄:
cd /var/www/html/
mkdir ambari
cd /var/www/html/ambari/
tar -zxvf ambari-2.2.2.0-centos7.tar.gz
tar -zxvf HDP-2.4.2.0-centos7-rpm.tar.gz
tar -zxvf HDP-UTILS-1.1.0.20-centos7.tar.gz
3.3 配置ambari殉疼、HDP梯浪、HDP-UTILS的本地源
首先下載上面資源列表中的相應(yīng)repo文件,修改其中的URL為本地的地址瓢娜,相關(guān)配置如下:
ambari.repo:
#VERSION_NUMBER=2.2.2.0-460
[Updates-ambari-2.2.2.0]
name=ambari-2.2.2.0 - Updates
baseurl=http://172.31.83.171/ambari/AMBARI-2.2.2.0/centos7/2.2.2.0-460
gpgcheck=1
gpgkey=http://172.31.83.171/ambari/AMBARI-2.2.2.0/centos7/2.2.2.0-460/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
hdp.repo:
VERSION_NUMBER=2.4.2.0-258
[HDP-2.4.2.0]
name=HDP Version - HDP-2.4.2.0
baseurl=http://172.31.83.171/ambari/HDP/centos7/2.x/updates/2.4.2.0
gpgcheck=1
gpgkey=http://172.31.83.171/ambari/HDP/centos7/2.x/updates/2.4.2.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
[HDP-UTILS-1.1.0.20]
name=HDP Utils Version - HDP-UTILS-1.1.0.20
baseurl=http://172.31.83.171/ambari/HDP-UTILS-1.1.0.20/repos/centos7
gpgcheck=1
gpgkey=http://172.31.83.171/ambari/HDP/centos7/2.x/updates/2.4.2.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1
將上面的修改過(guò)的源放到/etc/yum.repos.d/下面:
yum clean all
yum list update
yum makecache
yum repolist
3.4 安裝Mysql數(shù)據(jù)庫(kù)(省略)
安裝完成后創(chuàng)建ambari數(shù)據(jù)庫(kù)及用戶挂洛,登錄root用戶執(zhí)行下面語(yǔ)句:
create database ambari character set utf8 ;
CREATE USER 'ambari'@'%'IDENTIFIED BY 'Ambari-123';
GRANT ALL PRIVILEGES ON . TO 'ambari'@'%';
FLUSH PRIVILEGES;
Hive數(shù)據(jù)庫(kù)和用戶 再執(zhí)行下面的語(yǔ)句:
create database hive character set utf8 ;
CREATE USER 'hive'@'%'IDENTIFIED BY 'Hive-123';
GRANT ALL PRIVILEGES ON . TO 'hive'@'%';
FLUSH PRIVILEGES;
安裝mysql jdbc 驅(qū)動(dòng):
yum install mysql-connector-java
3.5 安裝JDK
安裝解壓版JDK,先到官網(wǎng)下載jdk-8u91-linux-x64.tar.gz 眠砾,再執(zhí)行下面命令:
tar -zxvf jdk-8u91-linux-x64.tar.gz -C /opt/java/
vim /etc/profile
export JAVA_HOME=/opt/java/jdk1.8.0_91
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
PATH=$PATH:$HOME/bin:$JAVA_HOME/bin
source /etc/profile
4.進(jìn)行安裝Ambari
4.1 安裝Ambari2.2.2
4.1.1安裝Ambari
yum install ambari-server
4.1.2配置Ambari(省略)
ambari-server setup
配置完Ambari后虏劲,用Ambari用戶(上面設(shè)置的用戶)登錄mysql mysql -u ambari -p use ambari source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql
4.1.3啟動(dòng)Amabri
后續(xù)就是集群環(huán)境的具體配置(后續(xù)補(bǔ)充)
附錄
Centos 7.2 安裝 Mysql 5.7.13
- 下載mysql的repo源
wget http://repo.mysql.com/mysql57-community-release-el7-8.noarch.rpm - 安裝mysql57-community-release-el7-8.noarch.rpm包
rpm -ivh mysql57-community-release-el7-8.noarch.rpm --nodeps –force
3.安裝mysql
yum install mysql-server - 啟動(dòng)mysql服務(wù)
查看MySQL服務(wù)是否已啟動(dòng)
service mysqld status
啟動(dòng)服務(wù)
systemctl start mysqld - 重置root密碼
MySQL5.7會(huì)在安裝后為root用戶生成一個(gè)隨機(jī)密碼,而不是像以往版本的空密碼。
可以安全模式修改root登錄密碼或者用隨機(jī)密碼登錄修改密碼柒巫。下面用隨機(jī)密碼方式
MySQL為root用戶生成的隨機(jī)密碼通過(guò)mysqld.log文件可以查找到:
grep 'temporary password' /var/log/mysqld.log
修改root用戶密碼:(MySQL的密碼策略比較復(fù)雜励堡,過(guò)于簡(jiǎn)單的密碼會(huì)被拒絕)
mysql -u root -p
mysql> Enter password: (輸入剛才查詢到的隨機(jī)密碼)
mysql> SET PASSWORD FOR 'root'@'localhost'= "Root-123";
mysql> exit
用root新密碼登錄:mysql -u root –p - 開放3306端口
允許使用用戶名root密碼Root-123456從任何主機(jī)連接到mysql服務(wù)器
mysql>GRANT ALL PRIVILEGES ON . TO 'root'@'%' IDENTIFIED BY 'Root-123456' WITH GRANT OPTION;
mysql>FLUSH PRIVILEGES;
mysql>exit;