hdfs是分布式文件系統(tǒng)，要想訪問hdfs上的文件终娃，可以用java api或者h(yuǎn)adoop shell等工具服傍，如果想操作hdfs文件系統(tǒng)就像操作本地文件系統(tǒng)一樣的便捷，可以將hdfs文件系統(tǒng)掛載到本地的一個目錄上节猿，可以通過nfs掛載--apache hadoop2.x以后的版本中自帶了一個nfs3的插件服務(wù)票从，下面將詳細(xì)講解nfs掛載的方式漫雕。

官方介紹

http://hadoop.apache.org/docs/r2.5.2/hadoop-project-dist/hadoop-hdfs/HdfsNfsGateway.html

配置core-site.xml

<property>
    <name>hadoop.proxyuser.nfsserver.groups</name>
    <value>*</value>
    <description>允許所有用戶組用戶代理</description>
</property>
<property>
    <name>hadoop.proxyuser.nfsserver.hosts</name>
    <value>localhost</value>
    <description>允許掛載的主機域名</description>
</property>
</property>

修改hdfs-site.xml

<property>
    <name>nfs.dump.dir</name>
    <value>/tmp/.hdfs-nfs</value>
</property>
<property>
    <name>nfs.rtmax</name>
    <value>1048576</value>
    <description>This is the maximum size in bytes of a READ request supported by the NFS gateway. If you change this, make sure you also update the nfs mount's rsize(add rsize= # of bytes to the mount directive).</description>
</property>
<property>
    <name>nfs.wtmax</name>
    <value>65536</value>
    <description>This is the maximum size in bytes of a WRITE request supported by the NFS gateway. If you change this, make sure you also update the nfs mount's wsize(add wsize= # of bytes to the mount directive).</description>
</property>
<property>
    <name>nfs.exports.allowed.hosts</name>
    <value>* rw</value>
    <description>允許所有主機對文件有rw權(quán)限</description>
</property>

重啟hadoop集群服務(wù)

關(guān)閉本機的nfs以及rpcbind服務(wù)

啟動hadoop portmap和nfs3,需要root權(quán)限

[root@master ~]# /home/hadoop/hadoop-2.7.3/sbin/hadoop-daemon.sh start portmap
[root@master ~]# /home/hadoop/hadoop-2.7.3/sbin/hadoop-daemon.sh start nfs3

查看本機掛載狀況

[root@master ~]# showmount -e localhost
Export list for localhost:
/ *

可以在其他未安裝HDFS的機器上通過nfs掛載hdfs目錄

# mount -t nfs -o vers=3,proto=tcp 10.10.18.229:/ /mnt
# ls /mnt/user
hadoop  hive  spark

測試速度
大概每秒40M，感覺不理想

[root@localhost brute_force]# time cp /mnt/shegong.txt .

real    6m23.823s
user    0m0.014s
sys 0m23.255s
[root@localhost brute_force]# du -msh /mnt/shegong.txt 
15G /mnt/shegong.txt
[root@localhost brute_force]# du -msh /mnt/shegong.txt ./shegong.txt 
15G /mnt/shegong.txt
15G ./shegong.txt