CentOS6.5中怎么通過Hadoop用戶實現HDFS偽分布式部署

這篇文章給大家介紹CentOS6.5中怎么通過Hadoop用戶實現HDFS偽分布式部署，內容非常詳細，感興趣的小伙伴們可以參考借鑒，希望對大家能有所幫助。

1、檢查hadoop用戶是否存在

• [root@hadoop001 hadoop]# pwd
  

• /opt/software/hadoop-2.8.1/etc/hadoop
  

• 
  

• [root@hadoop001 hadoop]# vim core-site.xml
  

• --添加<property>,localhost修改為IP
  

• <configuration>

•     <property>
  

•         <name>fs.defaultFS</name>
  

•         <value>hdfs://localhost:9000</value>    
  

•     </property>

• </configuration>

#修改DataNode數據節點訪問IP

1. [root@hadoop001 hadoop]# pwd
   

2. /opt/software/hadoop-2.8.1/etc/hadoop
   

3. 
   

4. [root@hadoop001 hadoop]# vim slaves
   

5. localhost --localhost修改為IP,多DN逗號分隔ip  

#修改SecondayNameNode數據節點訪問IP

1. [root@hadoop001 hadoop]# vim hdfs-site.xml
   

2. -- 添加<property>
   

3.     <configuration>
   

4.         <property>
   

5.                 <name>dfs.namenode.secondary.http-address</name>
   

6.                 <value>192.168.0.129:50090</value>
   

7.         </property>
   

8. 
   

9.         <property>
   

10.                 <name>dfs.namenode.secondary.https-address</name>
    

11.                  <value>192.168.0.129:50091</value>
    

12.         </property>
    

13.         <property>
    

14.                  <name>dfs.replication</name>
    

15.                   <value>1</value>
    

16.         </property>
    

17.     </configuration>

6、刪除root用戶的DFS文件及DFS磁盤格式化

1. [root@hadoop001 tmp]# rm -rf /tmp/hadoop-* /tmp/hsperfdata-*
   

2. [root@hadoop001 tmp]# su - hadoop
   

3. [hadoop@hadoop001 hadoop-2.8.1]$ hdfs namenode -format

7、hadoop用戶啟動

1. [hadoop@hadoop001 sbin]$ pwd
   

2. /opt/software/hadoop-2.8.1/sbin
   

3. [hadoop@hadoop001 sbin]$ ./start-dfs.sh       -- 第一次啟動輸入密碼
   

4. Starting namenodes on [hadoop001]
   

5. hadoop001: starting namenode, logging to /opt/software/hadoop-2.8.1/logs/hadoop-hadoop-namenode-hadoop001.out
   

6. 192.168.0.129: starting datanode, logging to /opt/software/hadoop-2.8.1/logs/hadoop-hadoop-datanode-hadoop001.out
   

7. Starting secondary namenodes [hadoop001]
   

8. hadoop001: starting secondarynamenode, logging to /opt/software/hadoop-2.8.1/logs/hadoop-hadoop-secondarynamenode-hadoop001.out

關于CentOS6.5中怎么通過Hadoop用戶實現HDFS偽分布式部署就分享到這里了，希望以上內容可以對大家有一定的幫助，可以學到更多知識。如果覺得文章不錯，可以把它分享出去讓更多的人看到。