基本信息
假定兩個(gè)節(jié)點(diǎn)
master:
172.31.0.51(內(nèi)網(wǎng)) ec2-54-169-200-228(外網(wǎng))
ssh -i ~/Desktop/waterwheel-test-key-pair-gdut.pem root@ec2-54-169-200-228.ap-southeast-1.compute.amazonaws.com
slave:
172.31.8.7(內(nèi)網(wǎng)) ec2-13-229-103-186(外網(wǎng))
ssh -i ~/Desktop/waterwheel-test-key-pair-gdut.pem root@ec2-13-229-103-186.ap-southeast-1.compute.amazonaws.com
附加步驟:
打包源碼發(fā)送之前,因?yàn)檫\(yùn)行的為cluster model港谊,所以topology中的pom.xml要把的注釋去掉
發(fā)送源碼topology和web UI:
mvn package -DskipTests
整個(gè)項(xiàng)目,把topology/target的topology-1.0-SNAPSHOT.jar改名為waterwheel-topology.jar,web/target的webapp.war改名為waterwheel.war,把兩者通過(guò)scp發(fā)送到master,
scp -i ~/Desktop/waterwheel-test-key-pair-gdut.pem -r /Users/billlin/Downloads/Waterwheel-master/topology/target/waterwheel-topology.jar -r /Users/billlin/Downloads/Waterwheel-master/web/target/waterwheel.war mm@ec2-54-169-200-228.ap-southeast-1.compute.amazonaws.com:~
(-i 密匙,-r 遞歸復(fù)制整個(gè)目錄朋凉,兩個(gè)一起發(fā))
(記得加目的地址如 :~态秧,可以直接發(fā)送到用戶mm/ss下)
- 同理,發(fā)送script到master和slave:
scp -i ~/Desktop/waterwheel-test-key-pair-gdut.pem -r /Users/billlin/Downloads/Waterwheel-master/scripts mm@ec2-54-169-200-228.ap-southeast-1.compute.amazonaws.com:~
在wget前介劫,先下載安裝wget:
sudo yum install wget -y安裝jdk后难咕,
source ~/.bashrc
來(lái)刷新path,echo $JAVA_HOME
查看是否成功每個(gè)步驟的MASTER_IP都是輸入master的內(nèi)網(wǎng)IP(外網(wǎng)可能會(huì)因?yàn)榉阑饓Φ仍驁?bào)錯(cuò))
如果web無(wú)法通過(guò)外網(wǎng)登錄
sudo iptables -F
關(guān)閉兩臺(tái)機(jī)器的防火墻最后,部署成功后店量,插入數(shù)據(jù):
進(jìn)入apache-storm-1.1.0/bin
執(zhí)行
./storm jar ~/scripts/waterwheel-topology.jar indexinopology/topology/kingbase/KingBaseTopology -m ingest -r 10000 --ingest-server-ip 172.31.0.51
(兩臺(tái)機(jī)器都可能作為spout)
如果打開(kāi)網(wǎng)頁(yè)報(bào)錯(cuò)時(shí),可能會(huì)是QueryCoordinator在其他ip上導(dǎo)致,將Tomcat部署到其他節(jié)點(diǎn)上
或者重新提交topology
舊數(shù)據(jù):
172.31.14.142(內(nèi)網(wǎng))(54-251-130-130)
172.31.10.190(內(nèi)網(wǎng)) (52-77-251-131)