一堆生、Kylin簡介
Apache Kylin?是一個(gè)開源的分布式分析引擎，提供Hadoop/Spark之上的SQL查詢接口及多維分析（OLAP）能力以支持超大規(guī)模數(shù)據(jù)方咆，最初由eBay Inc. 開發(fā)并貢獻(xiàn)至開源社區(qū)穴亏。它能在亞秒內(nèi)查詢巨大的Hive表玫锋。
二挠乳、安裝前準(zhǔn)備
軟件版本：
1.apache-kylin-2.5.2-bin-cdh60.tar.gz
2.CDH6.0.0
3.JDK_1.8.0_141
安裝機(jī)器：
172.17.194.17 dev_cdh_001v all
172.17.194.18 dev_cdh_002v query
172.17.194.19 dev_cdh_003v query
三权薯、集群模式安裝
1.在dev_cdh_001v上解壓部署apache-kylin-2.5.2-bin-cdh60.tar.gz
tar zxvf apache-kylin-2.5.2-bin-cdh60.tar.gz
cp apache-kylin-2.5.2-bin-cdh60 /usr/local
2.在dev_cdh_001v修改配置
(1)配置環(huán)境變量
vi /etc/profile
#for Kylin
export KYLIN_HOME=/usr/local/apache-kylin-2.5.2-bin-cdh60
export HBASE_HOME=/opt/cloudera/parcels/CDH/lib/hbase
export HADOOP_HOME=/opt/cloudera/parcels/CDH
export HIVE_HOME=/opt/cloudera/parcels/CDH/lib/hive
export HADOOP_CMD=/opt/cloudera/parcels/CDH/lib/hadoop/bin/hadoop
export HCAT_HOME=/opt/cloudera/parcels/CDH/lib/hive-hcatalog
使配置生效
source /etc/profile
(2)配置kylin
vi $KYLIN_HOME/conf/kylin.properties
kylin.metadata.url= kylin_metadata@hbase
kylin.server.mode=all // 只能有一個(gè)節(jié)點(diǎn)是all姑躲，其他節(jié)點(diǎn)為query
kylin.server.cluster-servers=dev_cdh_001v:7070,dev_cdh_002v:7070,dev_cdh_003v:7070
(3)配置加載hbase common lib
vi /opt/cloudera/parcels/CDH/lib/hbase/bin/hbase
改
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar
成
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar:/opt/cloudera/parcels/CDH/lib/hbase/lib/*
3.將/usr/local/apache-kylin-2.5.2-bin-cdh60拷貝 dev_cdh_002v和 dev_cdh_003v
scp -r /usr/local/apache-kylin-2.5.2-bin-cdh60 root@dev_cdh_002v:/usr/local/
scp -r /usr/local/apache-kylin-2.5.2-bin-cdh60 root@dev_cdh_003v:/usr/local/
4.在dev_cdh_002v和dev_cdh_003v進(jìn)行以下操作
(1)修改 /opt/cloudera/parcels/CDH/lib/hbase/bin/hbase
vi /opt/cloudera/parcels/CDH/lib/hbase/bin/hbase
改
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar
成
CLASSPATH=${CLASSPATH}:$JAVA_HOME/lib/tools.jar:/opt/cloudera/parcels/CDH/lib/hbase/lib/*
(2)修改kylin的配置
vi $KYLIN_HOME/conf/kylin.properties
kylin.server.mode=query
5.在dev_cdh_001v上的nginx上添加一下配置
(1)upstream.conf
vi /usr/local/nginx/conf/upstream.conf
upstream kylin-cluster {
ip_hash;
server 172.17.194.17:7070 max_fails=2 fail_timeout=5s;
server 172.17.194.18:7070 max_fails=2 fail_timeout=5s;
server 172.17.194.19:7070 max_fails=2 fail_timeout=5s;
}
(2)nginx.conf
vi /usr/local/nginx/conf/nginx.conf
server {
listen 7001;
server_name 10.240.9.132;
default_type 'text/html';
charset utf-8;
access_log /data/logs/kylin/kylin_nginx.log main;
location ^~ / {
proxy_pass http://kylin-cluster;
proxy_connect_timeout 60s;
proxy_send_timeout 1800s;
proxy_read_timeout 1800s;
proxy_ignore_client_abort on;
}
}
(3)reload nginx
四、啟動kylin
1.檢查配置依賴是否正確
$KYLIN_HOME/bin/check-env.sh
root@dev_cdh_001v:/usr/local/nginx/conf
# $KYLIN_HOME/bin/check-env.sh
Retrieving hadoop conf dir...
KYLIN_HOME is set to /usr/local/apache-kylin-2.5.2-bin-cdh60
2.在dev_cdh_001v盟蚣，dev_cdh_002v和dev_cdh_003v啟動kylin
$KYLIN_HOME/bin/kylin.sh start
3.登錄kylin
http://dev_cdh_001v:7001/kylin
ADMIN/KYLIN(默認(rèn)賬號密碼)
image.png
