Kafka安裝和配置帖汞,依賴zookeeper
安裝和啟動zookeeper
(1)下載
http://mirrors.cnnic.cn/apache/zookeeper/zookeeper-3.4.6/zookeeper-3.4.6.tar.gz
(2)解壓
tar zxvf zookeeper-3.4.6.tar.gz
(3)配置
cd zookeeper-3.4.6
cp -rf conf/zoo_sample.cfg conf/zoo.cfg
vim zoo.cfg
將里邊的目錄配置成為:
dataDir=/Users/apple/Documents/soft/zookeeper_soft/zkdata #這個目錄是預(yù)先創(chuàng)建的
(4)啟動zookeeper
cd bin
sh zkServer.sh start
安裝和配置kafka
(1)下載
http://apache.fayea.com/kafka/0.8.2.1/kafka_2.10-0.8.2.1.tgz
(2)解壓
tar -zxf kafka_2.10-0.8.2.1.tgz
(3)配置config
vim server.properties
配置kafka的端口號
port=9092
配置ip地址
host.name=localhost
配置log路徑
log.dirs=~/changxiaohui/kafka-logs
# Zookeeper connection string (see zookeeper docs for details).
# This is a comma separated host:port pairs, each corresponding to a zk
# server. e.g. "127.0.0.1:3000,127.0.0.1:3001,127.0.0.1:3002".
# You can also append an optional chroot string to the urls to specify the
# root directory for all kafka znodes.
zookeeper.connect=localhost:2181 (配置zookeeper,這里可以寫的localhost或者IP地址,但是一定要與produce 寫消息的時候保持一致)
# Timeout in ms for connecting to zookeeper
zookeeper.connection.timeout.ms=6000
(4)在后臺啟動kafka服務(wù),只需要后邊加上&就可以了
sh bin/kafka-server-start.sh config/server.properties &
(5)創(chuàng)建topic
sh kafka-topics.sh --create --topic kafkatopic --replication-factor 1 --partitions 1 --zookeeper localhost:2181 &
(6)生產(chǎn)者寫東西
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic kafkatopic (這個命令中的locahost需要和server.properties中的host.name=localhost保持一致,是ip這里就要寫成ip)
操作命令如下:
MacBook-Air-2:kafka $ bin/kafka-console-producer.sh --broker-list localhost:9092 --topic kafkatopic
[2016-01-24 12:19:01,401] WARN Property topic is not valid (kafka.utils.VerifiableProperties)
測試
(7)消費(fèi)者讀東西劈彪,同一個topic
操作命令如下:
MacBook-Air-2:kafka $ bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic kafkatopic --from-beginning