Hadoop集群搭建

1寂嘉、準(zhǔn)備工作

準(zhǔn)備6臺(tái)虛擬機(jī)，內(nèi)存1G

虛擬機(jī)節(jié)點(diǎn)分配情況

序號(hào)	機(jī)器	分配
1	Park01	Zookeeper枫绅、NameNode(active)泉孩、ResourceManager(active)
2	Park02	Zookeeper、NameNode(standby)
3	Park03	Zookeeper并淋、ResourceManager(standby)
4	Park04	DataNode寓搬、NodeManager、JournalNode
5	Park05	DataNode县耽、NodeManager句喷、JournalNode
6	Park06	DataNode、NodeManager兔毙、JournalNode

關(guān)閉每臺(tái)虛擬機(jī)防火墻

更改每臺(tái)虛擬機(jī)主機(jī)名唾琼，例如CH0、CH1……參考

配置每臺(tái)機(jī)器的hosts
127.0.0.1 localhost
::1 localhost
192.168.6.20 CH0
192.168.6.21 CH1
……
192.168.6.25 CH5

配置免秘鑰登錄

安裝JDK并配置環(huán)境變量

2澎剥、Zookeeper

[root@CH0 soft]# mkdir -p /usr/lib/zookeeper
[root@CH0 soft]# tar -zxvf zookeeper-3.4.7.tar.gz -C /usr/lib/zookeeper

2.1 zoo.cfg配置

[root@CH0 soft]# cd /usr/lib/zookeeper/zookeeper-3.4.7/conf/
[root@CH0 conf]# cp zoo_sample.cfg zoo.cfg
[root@CH0 conf]# vim zoo.cfg 
<!--完整的zoo.cfg配置如下-->
# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial 
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between 
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
# do not use /tmp for storage, /tmp here is just 
# example sakes.
dataDir=/usr/lib/zookeeper/zookeeper-3.4.7/tmp
# the port at which the clients will connect
clientPort=2181
# the maximum number of client connections.
# increase this if you need to handle more clients
#maxClientCnxns=60
#
# Be sure to read the maintenance section of the 
# administrator guide before turning on autopurge.
#
# http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
#
# The number of snapshots to retain in dataDir
#autopurge.snapRetainCount=3
# Purge task interval in hours
# Set to "0" to disable auto purge feature
#autopurge.purgeInterval=1
server.1=192.168.6.20:2888:3888
server.2=192.168.6.21:2888:3888
server.3=192.168.6.22:2888:3888

2.2 tmp目錄配置

[root@CH0 conf]# cd ..
[root@CH0 zookeeper-3.4.7]# mkdir tmp
[root@CH0 zookeeper-3.4.7]# cd tmp/
[root@CH0 tmp]# vim myid
<!--內(nèi)容如下-->
1

2.3 其他兩臺(tái)虛擬機(jī)Zookeeper配置

<!-- Zookeeper目錄發(fā)送給CH1锡溯、CH2 -->
[root@CH0 tmp]# cd ../../
[root@CH0 zookeeper]# cd ../
[root@CH0 lib]# scp -r zookeeper CH1:/usr/lib/
[root@CH0 lib]# scp -r zookeeper CH2:/usr/lib/

[root@CH1 ~]# cd /usr/lib/zookeeper/zookeeper-3.4.7/tmp/
[root@CH1 tmp]# ls
myid
[root@CH1 tmp]# vim myid 
[root@CH1 tmp]# cat myid 
2

[root@CH2 ~]# cd /usr/lib/zookeeper/zookeeper-3.4.7/tmp/
[root@CH2 tmp]# ls
myid
[root@CH2 tmp]# vim myid 
[root@CH2 tmp]# cat myid 
3

3、Hadoop安裝配置

[root@CH0 soft]# mkdir -p /usr/lib/hadoop
[root@CH0 soft]# tar -zxvf hadoop-2.7.1.tar.gz -C /usr/lib/hadoop
[root@CH0 soft]# cd /usr/lib/hadoop/hadoop-2.7.1/etc/hadoop/

3.1肴裙、hadoop-env.sh配置

[root@CH0 hadoop]# vim hadoop-env.sh 
<!--配置如下-->
export JAVA_HOME=/usr/lib/jvm/jdk1.8.0_171
export HADOOP_CONF_DIR=/usr/lib/hadoop/hadoop-2.7.1/etc/hadoop

3.2趾唱、core-site.xml配置

[root@CH0 hadoop]# vim core-site.xml 
<!--配置如下-->
<configuration>
<property>
<name>fs.defaultFS</name>
<value>hdfs://ns</value>
</property>
<!-- 用來(lái)指定hadoop運(yùn)行時(shí)產(chǎn)生文件的存放位置 -->
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/lib/hadoop/hadoop-2.7.1/tmp</value>
</property>
<!-- 執(zhí)行zookeeper地址-->
<property>
<name>ha.zookeeper.quorum</name>
<value>CH0:2181,CH1:2181,CH2:2181</value>
</property>
</configuration>

3.3涌乳、hdfs-site.xml配置

[root@CH0 hadoop]# vim hdfs-site.xml 
<!--配置如下-->
<configuration>
<property>
<name>dfs.nameservices</name>
<value>ns</value>
</property>
<!-- ns下有兩臺(tái)namenode,分別是nn1蜻懦，nn2  -->
<property>
<name>dfs.ha.namenodes.ns</name>
<value>nn1,nn2</value>
</property>
<!-- nn1的RPC通信地址 -->
<property>
<name>dfs.namenode.rpc-address.ns.nn1</name>
<value>CH0:9000</value>
</property>
<!-- nn1的HTTP通信地址 -->
<property>
<name>dfs.namenode.http-address.ns.nn1</name>
<value>CH0:50070</value>
</property>
<!-- nn2的RPC通信地址 -->
<property>
<name>dfs.namenode.rpc-address.ns.nn2</name>
<value>CH1:9000</value>
</property>
<!-- nn2的HTTP通信地址 -->
<property>
<name>dfs.namenode.http-address.ns.nn2</name>
<value>CH1:50070</value>
</property>
<!-- 指定namenode的元數(shù)據(jù)在JournalNode上的存放位置，這樣夕晓，namenode2可以從集群jn
 里獲取最新的namenode的信息宛乃，可以達(dá)到熱備的效果 -->
<property>
<name>dfs.namenode.shared.edits.dir</name>
<value>qjournal://CH3:8485;CH4:8485;CH5:8485/ns</value>
</property>
<!-- 指定JournalNode的存放位置 -->
<property>
<name>dfs.journalnode.edits.dir</name>
<value>/usr/lib/hadoop/hadoop-2.7.1/journal</value>
</property>
<!-- 開(kāi)啟namenode故障時(shí)自動(dòng)切換 -->
<property>
<name>dfs.ha.automatic-failover.enabled</name>
<value>true</value>
</property>
<!-- 配置切換的實(shí)現(xiàn)方式 -->
<property>
<name>dfs.client.failover.proxy.provider.ns</name>
<value>org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider</value>
</property>
<!-- 配置隔離機(jī)制-->
<property>
<name>dfs.ha.fencing.methods</name>
<value>sshfence</value>
</property>
<!-- 配置隔離機(jī)制的SSH登錄秘鑰所在的位置 -->
<property>
<name>dfs.ha.fencing.ssh.private-key-files</name>
<value>/root/.ssh/id_rsa</value>
</property>
<!-- 配置namenode數(shù)據(jù)存放的位置，可以不配置蒸辆，如果不配置征炼，默認(rèn)使用的是
 core-site.xml里的hadoop.tmp.dir的路徑-->
<property>
<name>dfs.namenode.name.dir</name>
<value>file:///usr/lib/hadoop/hadoop-2.7.1/tmp/namenode</value>
</property>
<!-- 配置datanode數(shù)據(jù)存放的位置，可以不配置躬贡，如果不配置谆奥，默認(rèn)使用的是
      core-site.xml里的hadoop.tmp.dir的路徑-->
<property>
<name>dfs.datanode.data.dir</name>
<value>file:///usr/lib/hadoop/hadoop-2.7.1/tmp/datanode</value>
</property>
<!-- 配置block副本的數(shù)量-->
<property>
<name>dfs.replication</name>
<value>3</value>
</property>
<!-- 設(shè)置hdfs的操作權(quán)限，false表示任何用戶都可以在hdfs上操作文件 -->
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
</configuration>

3.4拂玻、mapred-site.xml配置

[root@CH0 hadoop]# cp mapred-site.xml.template mapred-site.xml
[root@CH0 hadoop]# vim mapred-site.xml
<!--配置如下-->
<configuration>
<!-- 指定mapreduce運(yùn)行在yarn上 -->
<property>
<name>mapreduce.framework.name</name>
<!-- yarn是資源協(xié)調(diào)工具 -->
<value>yarn</value>
</property>
</configuration>

3.5酸些、yarn-site.xml配置

[root@CH0 hadoop]# vim yarn-site.xml 
<!--配置如下-->
<configuration>
<property>
<name>yarn.resourcemanager.ha.enabled</name>
<value>true</value>
</property>

<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>
<!-- 配置rm1宰译，rm2的主機(jī) -->
<property>
<name>yarn.resourcemanager.hostname.rm1</name>
<value>CH0</value>
</property>

<property>
<name>yarn.resourcemanager.hostname.rm2</name>
<value>CH2</value>
</property>
<!-- 開(kāi)啟yarn恢復(fù)機(jī)制-->
<property>
<name>yarn.resourcemanager.recovery.enabled</name>
<value>true</value>
</property>
<!-- 執(zhí)行yarn恢復(fù)機(jī)制實(shí)現(xiàn)類(lèi)-->
<property>
<name>yarn.resourcemanager.store.class</name>
<value>org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore</value>
</property>
<!-- 配置zookeeper的地址-->
<property>
<name>yarn.resourcemanager.zk-address</name>
<value>CH0:2181,CH1:2181,CH2:2181</value>
<description>For multiple zk services,separate them with comm</description>
</property>
<!-- 指定yarn ha的名稱-->
<property>
<name>yarn.resourcemanager.cluster-id</name>
<value>yarn-ha</value>
</property>

<!-- 指定yarn的老大，resourcemanager的地址 -->
<property>
<name>yarn.resourcemanager.hostname</name>
<!-- CH0是主機(jī)名 -->
<value>CH0</value>
</property>
<!-- Site specific YARN configuration properties -->
<!-- nodemanager獲取數(shù)據(jù)的方式 -->
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
</configuration>

3.6魄懂、slaves配置

[root@CH0 hadoop]# vim slaves 
CH3
CH4
CH5

3.7沿侈、目錄創(chuàng)建

[root@CH0 hadoop]# cd ../..
[root@CH0 hadoop-2.7.1]# mkdir tmp
[root@CH0 hadoop-2.7.1]# mkdir journal
[root@CH0 hadoop-2.7.1]# cd tmp
[root@CH0 tmp]# mkdir namenode
[root@CH0 tmp]# mkdir datanode

3.8、發(fā)送給其他五臺(tái)虛擬機(jī)

[root@CH0 hadoop-2.7.1]# cd ../../
[root@CH0 lib]# scp -r hadoop CH1:/usr/lib/
[root@CH0 lib]# scp -r hadoop CH2:/usr/lib/
[root@CH0 lib]# scp -r hadoop CH3:/usr/lib/
[root@CH0 lib]# scp -r hadoop CH4:/usr/lib/
[root@CH0 lib]# scp -r hadoop CH5:/usr/lib/

4市栗、環(huán)境變量配置

[root@CH0 ~]# vim /etc/profile
#java env
JAVA_HOME=/usr/lib/jvm/jdk1.8.0_171
HADOOP_HOME=/usr/lib/hadoop/hadoop-2.7.1
CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JRE_HOME/lib/tools.jar
PATH=$JAVA_HOME/bin:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$PATH
export JAVA_HOME PATH CLASSPATH HADOOP_HOME

4.1缀拭、配置文件發(fā)送其他五臺(tái)虛擬機(jī)

[root@CH0 ~]# scp /etc/profile CH1:/etc/
[root@CH0 ~]# scp /etc/profile CH2:/etc/
[root@CH0 ~]# scp /etc/profile CH3:/etc/
[root@CH0 ~]# scp /etc/profile CH4:/etc/
[root@CH0 ~]# scp /etc/profile CH5:/etc/

<!-- 每臺(tái)執(zhí)行如下-->
[root@CH0 ~]# source /etc/profile

5、Hadoop分布式啟動(dòng)

5.1填帽、zookeeper啟動(dòng)

Park01啟動(dòng)

[root@CH0 ~]# cd /usr/lib/zookeeper/zookeeper-3.4.7/bin/
[root@CH0 bin]# sh zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/lib/zookeeper/zookeeper-3.4.7/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED

Park02啟動(dòng)

[root@CH1 ~]# cd /usr/lib/zookeeper/zookeeper-3.4.7/bin/
[root@CH1 bin]# sh zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/lib/zookeeper/zookeeper-3.4.7/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED

Park03啟動(dòng)

[root@CH2 ~]# cd /usr/lib/zookeeper/zookeeper-3.4.7/bin/
[root@CH2 bin]# sh zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /usr/lib/zookeeper/zookeeper-3.4.7/bin/../conf/zoo.cfg
Starting zookeeper ... STARTED

Park01啟動(dòng)狀態(tài)驗(yàn)證

[root@CH0 bin]# sh zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /usr/lib/zookeeper/zookeeper-3.4.7/bin/../conf/zoo.cfg
Mode: follower

Park02啟動(dòng)狀態(tài)驗(yàn)證

[root@CH1 bin]# sh zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /usr/lib/zookeeper/zookeeper-3.4.7/bin/../conf/zoo.cfg
Mode: leader

Park03啟動(dòng)狀態(tài)驗(yàn)證

[root@CH2 bin]# sh zkServer.sh status
ZooKeeper JMX enabled by default
Using config: /usr/lib/zookeeper/zookeeper-3.4.7/bin/../conf/zoo.cfg
Mode: follower

5.2蛛淋、format zkfc

[root@CH0 bin]# hdfs zkfc -formatZK
18/05/29 16:08:35 INFO ha.ActiveStandbyElector: Successfully created /hadoop-ha/ywty in ZK.
18/05/29 16:08:35 INFO zookeeper.ZooKeeper: Session: 0x263aae518180000 closed

[root@CH1 bin]# hdfs zkfc -formatZK
18/05/29 16:09:45 INFO ha.ActiveStandbyElector: Successfully created /hadoop-ha/ywty in ZK.
18/05/29 16:09:45 INFO zookeeper.ZooKeeper: Session: 0x263aae518180000 closed

5.3、JournalNode啟動(dòng)

[root@CH3 ~]# cd /usr/lib/hadoop/hadoop-2.7.1/sbin/
[root@CH3 sbin]# sh hadoop-daemon.sh start journalnode
[root@CH3 sbin]# jps
1464 JournalNode
1513 Jps

[root@CH4 sbin]# sh hadoop-daemon.sh start journalnode
[root@CH4 sbin]# jps
1445 JournalNode
1494 Jps

[root@CH5 sbin]# sh hadoop-daemon.sh start journalnode
[root@CH5 sbin]# jps
1449 JournalNode
1498 Jps

5.4篡腌、format NameNode

[root@CH0 bin]# hadoop namenode -format
18/05/29 16:21:00 INFO common.Storage: Storage directory /usr/lib/hadoop/hadoop-2.7.1/tmp/namenode has been successfully formatted.
18/05/29 16:21:00 INFO namenode.NNStorageRetentionManager: Going to retain 1 images with txid >= 0
18/05/29 16:21:00 INFO util.ExitUtil: Exiting with status 0
18/05/29 16:21:00 INFO namenode.NameNode: SHUTDOWN_MSG: 
/************************************************************/

[root@CH0 ~]# cd /usr/lib/hadoop/hadoop-2.7.1/sbin/
[root@CH0 sbin]# sh hadoop-daemon.sh start namenode
starting namenode, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/hadoop-root-namenode-CH0.out
[root@CH0 sbin]# jps
1604 NameNode
1676 Jps
1438 QuorumPeerMain

5.5铣鹏、bootstrapStandby NameNode

[root@CH1 bin]# hdfs namenode -bootstrapStandby
18/05/29 16:29:12 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
18/05/29 16:29:12 INFO namenode.NameNode: createNameNode [-bootstrapStandby]
=====================================================
About to bootstrap Standby ID yy2 from:
       Nameservice ID: ywty
    Other Namenode ID: yy1
  Other NN's HTTP address: http://CH0:50070
  Other NN's IPC  address: CH0/192.168.6.20:9000
         Namespace ID: 1549916029
        Block pool ID: BP-605564131-192.168.6.20-1527582060609
           Cluster ID: CID-a2fc36bc-6fc9-4d5f-8d95-b1c3da1557bd
       Layout version: -63
   isUpgradeFinalized: true
=====================================================
18/05/29 16:29:13 INFO common.Storage: Storage directory /usr/lib/hadoop/hadoop-2.7.1/tmp/namenode has been successfully formatted.
18/05/29 16:29:14 INFO namenode.TransferFsImage: Opening connection to http://CH0:50070/imagetransfer?getimage=1&txid=0&storageInfo=-63:1549916029:0:CID-a2fc36bc-6fc9-4d5f-8d95-b1c3da1557bd
18/05/29 16:29:14 INFO namenode.TransferFsImage: Image Transfer timeout configured to 60000 milliseconds
18/05/29 16:29:14 INFO namenode.TransferFsImage: Transfer took 0.00s at 0.00 KB/s
18/05/29 16:29:14 INFO namenode.TransferFsImage: Downloaded file fsimage.ckpt_0000000000000000000 size 351 bytes.
18/05/29 16:29:14 INFO util.ExitUtil: Exiting with status 0
18/05/29 16:29:14 INFO namenode.NameNode: SHUTDOWN_MSG:

5.6、NameNode start

[root@CH1 ~]# cd /usr/lib/hadoop/hadoop-2.7.1/sbin/
[root@CH1 sbin]# sh hadoop-daemon.sh start namenode
starting namenode, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/hadoop-root-namenode-CH1.out
[root@CH1 sbin]# jps
1572 NameNode
1644 Jps
1406 QuorumPeerMain

5.7哀蘑、DataNode start

[root@CH3 sbin]# sh hadoop-daemon.sh start datanode
starting datanode, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/hadoop-root-datanode-CH3.out
[root@CH3 sbin]# jps
1617 Jps
1543 DataNode
1464 JournalNode

[root@CH4 sbin]# sh hadoop-daemon.sh start datanode
starting datanode, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/hadoop-root-datanode-CH4.out
[root@CH4 sbin]# jps
1523 DataNode
1445 JournalNode
1597 Jps

[root@CH5 sbin]# sh hadoop-daemon.sh start datanode
starting datanode, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/hadoop-root-datanode-CH5.out
[root@CH5 sbin]# jps
1601 Jps
1527 DataNode
1449 JournalNode

5.8诚卸、ZKFC Start

[root@CH0 sbin]# sh hadoop-daemon.sh start zkfc
starting zkfc, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/hadoop-root-zkfc-CH0.out
[root@CH0 sbin]# jps
1987 Jps
1604 NameNode
1438 QuorumPeerMain
2240 DFSZKFailoverController

[root@CH1 sbin]# sh hadoop-daemon.sh start zkfc
starting zkfc, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/hadoop-root-zkfc-CH1.out
[root@CH1 sbin]# jps
1572 NameNode
1780 DFSZKFailoverController
1844 Jps
1406 QuorumPeerMain

5.9、Yarn Start

[root@CH0 sbin]# sh start-yarn.sh 
starting yarn daemons
starting resourcemanager, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/yarn-root-resourcemanager-CH0.out
CH5: starting nodemanager, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/yarn-root-nodemanager-CH5.out
CH4: starting nodemanager, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/yarn-root-nodemanager-CH4.out
CH3: starting nodemanager, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/yarn-root-nodemanager-CH3.out
[root@CH0 sbin]# jps
2240 DFSZKFailoverController
1604 NameNode
2356 ResourceManager
2621 Jps
1438 QuorumPeerMain

[root@CH2 sbin]# sh yarn-daemon.sh start resourcemanager
starting resourcemanager, logging to /usr/lib/hadoop/hadoop-2.7.1/logs/yarn-root-resourcemanager-CH2.out
[root@CH2 sbin]# jps
1604 ResourceManager
1643 Jps
1439 QuorumPeerMain

6绘迁、瀏覽器訪問(wèn)

CH0 50070

CH1 50070

最后編輯于：2018.06.01 13:44:07

?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請(qǐng)聯(lián)系作者

人面猴
序言：七十年代末合溺，一起剝皮案震驚了整個(gè)濱河市，隨后出現(xiàn)的幾起案子缀台，更是在濱河造成了極大的恐慌棠赛，老刑警劉巖，帶你破解...
沈念sama閱讀 218,546評(píng)論 6贊 507
死咒
序言：濱河連續(xù)發(fā)生了三起死亡事件膛腐，死亡現(xiàn)場(chǎng)離奇詭異睛约，居然都是意外死亡，警方通過(guò)查閱死者的電腦和手機(jī)哲身，發(fā)現(xiàn)死者居然都...
沈念sama閱讀 93,224評(píng)論 3贊 395
救了他兩次的神仙讓他今天三更去死
文/潘曉璐我一進(jìn)店門(mén)辩涝，熙熙樓的掌柜王于貴愁眉苦臉地迎上來(lái)，“玉大人勘天，你說(shuō)我怎么就攤上這事怔揩。” “怎么了脯丝？”我有些...
開(kāi)封第一講書(shū)人閱讀 164,911評(píng)論 0贊 354
道士緝兇錄：失蹤的賣(mài)姜人
文/不壞的土叔我叫張陵商膊，是天一觀的道長(zhǎng)。經(jīng)常有香客問(wèn)我宠进，道長(zhǎng)晕拆，這世上最難降的妖魔是什么？我笑而不...
開(kāi)封第一講書(shū)人閱讀 58,737評(píng)論 1贊 294
?港島之戀（遺憾婚禮）
正文為了忘掉前任材蹬，我火速辦了婚禮实幕，結(jié)果婚禮上阱高，老公的妹妹穿的比我還像新娘。我一直安慰自己茬缩，他們只是感情好赤惊，可當(dāng)我...
茶點(diǎn)故事閱讀 67,753評(píng)論 6贊 392
惡毒庶女頂嫁案：這布局不是一般人想出來(lái)的
文/花漫我一把揭開(kāi)白布。她就那樣靜靜地躺著凰锡，像睡著了一般未舟。火紅的嫁衣襯著肌膚如雪。梳的紋絲不亂的頭發(fā)上掂为，一...
開(kāi)封第一講書(shū)人閱讀 51,598評(píng)論 1贊 305
城市分裂傳說(shuō)
那天裕膀，我揣著相機(jī)與錄音，去河邊找鬼勇哗。笑死昼扛，一個(gè)胖子當(dāng)著我的面吹牛，可吹牛的內(nèi)容都是我干的欲诺。我是一名探鬼主播抄谐，決...
沈念sama閱讀 40,338評(píng)論 3贊 418
雙鴛鴦連環(huán)套：你想象不到人心有多黑
文/蒼蘭香墨我猛地睜開(kāi)眼，長(zhǎng)吁一口氣：“原來(lái)是場(chǎng)噩夢(mèng)啊……” “哼扰法！你這毒婦竟也來(lái)了蛹含？” 一聲冷哼從身側(cè)響起，我...
開(kāi)封第一講書(shū)人閱讀 39,249評(píng)論 0贊 276
萬(wàn)榮殺人案實(shí)錄
序言：老撾萬(wàn)榮一對(duì)情侶失蹤塞颁，失蹤者是張志新（化名）和其女友劉穎浦箱，沒(méi)想到半個(gè)月后，有當(dāng)?shù)厝嗽跇?shù)林里發(fā)現(xiàn)了一具尸體祠锣，經(jīng)...
沈念sama閱讀 45,696評(píng)論 1贊 314
?護(hù)林員之死
正文獨(dú)居荒郊野嶺守林人離奇死亡酷窥，尸身上長(zhǎng)有42處帶血的膿包…… 初始之章·張勛以下內(nèi)容為張勛視角年9月15日...
茶點(diǎn)故事閱讀 37,888評(píng)論 3贊 336
?白月光啟示錄
正文我和宋清朗相戀三年，在試婚紗的時(shí)候發(fā)現(xiàn)自己被綠了伴网。大學(xué)時(shí)的朋友給我發(fā)了我未婚夫和他白月光在一起吃飯的照片蓬推。...
茶點(diǎn)故事閱讀 40,013評(píng)論 1贊 348
活死人
序言：一個(gè)原本活蹦亂跳的男人離奇死亡，死狀恐怖是偷，靈堂內(nèi)的尸體忽然破棺而出拳氢，到底是詐尸還是另有隱情募逞，我是刑警寧澤蛋铆，帶...
沈念sama閱讀 35,731評(píng)論 5贊 346
?日本核電站爆炸內(nèi)幕
正文年R本政府宣布，位于F島的核電站放接，受9級(jí)特大地震影響刺啦，放射性物質(zhì)發(fā)生泄漏。R本人自食惡果不足惜纠脾，卻給世界環(huán)境...
茶點(diǎn)故事閱讀 41,348評(píng)論 3贊 330
男人毒藥：我在死后第九天來(lái)索命
文/蒙蒙一玛瘸、第九天我趴在偏房一處隱蔽的房頂上張望蜕青。院中可真熱鬧，春花似錦糊渊、人聲如沸右核。這莊子的主人今日做“春日...
開(kāi)封第一講書(shū)人閱讀 31,929評(píng)論 0贊 22
一樁弒父案渺绒，背后竟有這般陰謀
文/蒼蘭香墨我抬頭看了看天上的太陽(yáng)贺喝。三九已至，卻和暖如春宗兼，著一層夾襖步出監(jiān)牢的瞬間躏鱼，已是汗流浹背。一陣腳步聲響...
開(kāi)封第一講書(shū)人閱讀 33,048評(píng)論 1贊 270
情欲美人皮
我被黑心中介騙來(lái)泰國(guó)打工殷绍，沒(méi)想到剛下飛機(jī)就差點(diǎn)兒被人妖公主榨干…… 1. 我叫王不留染苛，地道東北人。一個(gè)月前我還...
沈念sama閱讀 48,203評(píng)論 3贊 370
代替公主和親
正文我出身青樓主到，卻偏偏與公主長(zhǎng)得像茶行，于是被迫代替她去往敵國(guó)和親。傳聞我的和親對(duì)象是個(gè)殘疾皇子登钥，可洞房花燭夜當(dāng)晚...
茶點(diǎn)故事閱讀 44,960評(píng)論 2贊 355

Hadoop集群搭建

1寂嘉、準(zhǔn)備工作

2澎剥、Zookeeper

2.1 zoo.cfg配置

2.2 tmp目錄配置

2.3 其他兩臺(tái)虛擬機(jī)Zookeeper配置

3、Hadoop安裝配置

3.1肴裙、hadoop-env.sh配置

3.2趾唱、core-site.xml配置

3.3涌乳、hdfs-site.xml配置

3.4拂玻、mapred-site.xml配置

3.5酸些、yarn-site.xml配置

3.6魄懂、slaves配置

3.7沿侈、目錄創(chuàng)建

3.8、發(fā)送給其他五臺(tái)虛擬機(jī)

4市栗、環(huán)境變量配置

4.1缀拭、配置文件發(fā)送其他五臺(tái)虛擬機(jī)

5、Hadoop分布式啟動(dòng)

5.1填帽、zookeeper啟動(dòng)

5.2蛛淋、format zkfc

5.3、JournalNode啟動(dòng)

5.4篡腌、format NameNode

5.5铣鹏、bootstrapStandby NameNode

5.6、NameNode start

5.7哀蘑、DataNode start

5.8诚卸、ZKFC Start

5.9、Yarn Start

6绘迁、瀏覽器訪問(wèn)

推薦閱讀更多精彩內(nèi)容