配置yarn需要修改兩個(gè)配置文件mapred-site.xml以及yarn-site.xml
進(jìn)入hadoop目錄
cd hadoop-3.1.3
cd etc
cd hadoop
mapred-site.xml
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
該配置項(xiàng)表示使用yarn框架來(lái)管理mapreduce程序
yarn-site.xml
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>resourcemanager.address</name>
<value>10.103.105.82:8032</value>
</property>
<property>
<name>resourcemanager.scheduler.address</name>
<value>10.103.105.82:8030</value>
</property>
<property>
<name>nodemanager.resource-tracker.address</name>
<value>10.103.105.82:8031</value>
</property>
<property>
<name>yarn.namemanager.resource.memory-mb</name>
<value>8GB</value>
</property>
<property>
<name>yarn.namemanager.cpu-vcores</name>
<value>4</value>
yarn.nodemanager.aux-services:聲明mapreduce模型
resourcemanager.scheduler.address:Resource Manager暴露給Client(客戶(hù)端)的地址
resourcemanager.scheduler.address:Resource Manager暴露給ApplicationMaster的地址
nodemanager.resource-tracker.address:Resource Manager暴露給NodeManager的地址
yarn.namemanager.resource.memory-mb:準(zhǔn)備分給yarn的內(nèi)存
yarn.namemanager.cpu-vcores:可使用的CPU個(gè)數(shù)
拷貝到從節(jié)點(diǎn)
scp mapred-site.xml user@IP:/home/user/hadoop-3.1.3/etc/hadoop/
scp yarn-site.xml user@IP:/home/user/hadoop-3.1.3/etc/hadoop/
user為用戶(hù)名,IP為從節(jié)點(diǎn)地址或主機(jī)名移怯,:后的存儲(chǔ)地址為兩個(gè)文件所在的位置
啟動(dòng)yarn
啟動(dòng)yarn之前要提前啟動(dòng)hadoop
$HADOOP_HOME/sbin/start-dfs.sh
$HADOOP_HOME/sbin/start-yarn.sh
查看監(jiān)控界面
http://主節(jié)點(diǎn)IP:8088
停止yarn
停止的命令與啟動(dòng)的剛好相反
$HADOOP_HOME/sbin/stop-yarn.sh
$HADOOP_HOME/sbin/stop-dfs.sh