給kafka配一個web版的管理頁面或儀表盤贰谣,管理起來更加方便
- 源碼: https://github.com/smartloli/kafka-eagle/
- 官網(wǎng):https://www.kafka-eagle.org/
- 下載: http://download.kafka-eagle.org/
- 安裝文檔: https://docs.kafka-eagle.org/2.env-and-install
安裝過程記錄
解壓縮包重命名目錄
mkdir /opt/software
tar xf kafka-eagle-bin-1.3.8.tar.gz -C /opt/software/
cd /opt/software/kafka-eagle-bin-1.3.8
tar xf kafka-eagle-web-1.3.8-bin.tar.gz
mv kafka-eagle-web-1.3.8 kafka-eagle
配置環(huán)境變量
- 設(shè)置Kafka-Eagle目錄
vim /etc/profile
export KE_HOME= /opt/software/kafka-eagle
PATH=$PATH:$KE_HOME/bin
- 設(shè)置java目錄
vim /etc/profile
export JAVA_HOME= /usr/local/java/
更新環(huán)境變量
source /etc/profile
修改Kafka-Eagle配置文件
cd kafka-eagle/conf
vim system-config.properties
######################################
# multi zookeeper&kafka cluster list
# zookeeper和kafka集群配置
######################################
kafka.eagle.zk.cluster.alias=cluster1
cluster1.zk.list=10.0.0.200:2181,10.0.0.200:2182,10.0.0.200:2183
######################################
# kafka eagle webui port
# web頁面訪問端口號
######################################
kafka.eagle.webui.port=8048
######################################
# kafka jdbc driver address
# kafka默認使用sqlite數(shù)據(jù)庫娜搂,Centos自帶迁霎,注意配置下數(shù)據(jù)庫存放路徑就行
######################################
kafka.eagle.driver=org.sqlite.JDBC
kafka.eagle.url=jdbc:sqlite:/opt/software/kafka-eagle/db/ke.db
kafka.eagle.username=root
kafka.eagle.password=www.kafka-eagle.org
啟動kafka-eagle
cd ../bin/
chmod +x ke.sh
./ke.sh start
啟動成功打印日志如下;
*******************************************************************
* Kafka Eagle system monitor port successful...
*******************************************************************
[2020-02-07 17:05:57] INFO: Status Code[0]
[2020-02-07 17:05:57] INFO: [Job done!]
Welcome to
__ __ ___ ____ __ __ ___ ______ ___ ______ __ ______
/ //_/ / | / __/ / //_/ / | / ____/ / | / ____/ / / / ____/
/ ,< / /| | / /_ / ,< / /| | / __/ / /| | / / __ / / / __/
/ /| | / ___ | / __/ / /| | / ___ | / /___ / ___ |/ /_/ / / /___ / /___
/_/ |_| /_/ |_|/_/ /_/ |_| /_/ |_| /_____/ /_/ |_|\____/ /_____//_____/
Version 1.3.8
*******************************************************************
* Kafka Eagle Service has started success.
* Welcome, Now you can visit 'http://10.0.0.200:8048/ke'
* Account:admin ,Password:123456
*******************************************************************
* ke.sh [start|status|stop|restart|stats]
* https://www.kafka-eagle.org/
*******************************************************************
如果出現(xiàn)錯誤,請查看日志日志是否出問題
tailf ../log/log.log
如果沒問題百宇,則直接登錄
- http://host:8048/ke
- 默認用戶名:admin
- 默認密碼:12345
監(jiān)控趨勢圖
Kafka系統(tǒng)默認是沒有開啟JMX端口的考廉,所以Kafka Eagle的監(jiān)控趨勢圖默認采用不啟用的方式,即kafka.eagle.metrics.charts=false携御。如果需要查看監(jiān)控趨勢圖昌粤,需要開啟Kafka系統(tǒng)的JMX端口,設(shè)置該端口在$KAFKA_HOME/bin/kafka-server-start.sh腳本中啄刹,設(shè)置內(nèi)容如下:
vim /opt/software/kafka-eagle/conf/system-config.properties
######################################
# enable kafka metrics
######################################
kafka.eagle.metrics.charts=true
kafka.eagle.sql.fix.error=true
vi /opt/software/kafka/bin/kafka-server-start.sh
if [ "x$KAFKA_HEAP_OPTS" = "x" ]; then
export KAFKA_HEAP_OPTS="-server -Xms2G -Xmx2G -XX:PermSize=128m -XX:+UseG1GC -XX:MaxGCPauseMillis=200 -XX:ParallelGCThreads=8 -XX:ConcGCThreads=5 -XX:InitiatingHeapOccupancyPercent=70"
# 這里的端口不一定非要設(shè)置成9999涮坐,端口只要可用,均可誓军。
export JMX_PORT="9999"
#export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G"
fi
Kafka Eagle系統(tǒng)會自動獲取這個JMX端口袱讹,采集結(jié)果如下: