Hadoop之Yarn的配置（详细步骤）_configuration property yarn.resourcemanager.addres

配置

先进入hadoop-2.7.6/etc/hadoop

 cd /home/ZQ/hadoop-2.7.6/etc/hadoop/

配置 mapred-site.xml

 vim mapred-site.xml

增加如下内容

<configuration>
 
  <property>
 
       <name>mapreduce.framework.name</name>
 
       <value>yarn</value>
 
  </property>
 
</configuration>

配置 yarn-site.xml 

vim yarn-site.xml 

增加如下内容

<configuration>
 
  <property>
 
        <name>yarn.nodemanager.aux-services</name>
 
        <value>mapreduce_shuffle</value>
 
  </property>
 
 <property>
 
       <name>yarn.resourcemanager.address</name>
 
        <value>westgisB062:8032</value>
 
</property>
 
<property>
 
<name>yarn.resourcemanager.scheduler.address</name>
 
        <value>westgisB062:8030</value>
 
  </property>
 
 <property>
 
        <name>yarn.resourcemanager.resource-tracker.address</name>
        <value>westgisB062:8031</value>
 
  </property>
 
<property>
 
        <name>yarn.nodemanager.memory-mb</name>
 
        <value>8GB</value>
 
</property>
 
<property>
 
        <name>yarn.nodemanager.cpu-vcores</name>
 
        <value>4</value>
 
</property>
 
</configuration>
 

将配置文件拷贝到其他节点

以其中一个节点为例，其他节点同理（拷贝到所有节点）

scp -r /home/ZQ/hadoop-2.7.6/etc/hadoop/mapred-site.xml ZQ@10.103.105.59:/home/ZQ/hadoop-2.7.6/etc/hadoop

scp -r /home/ZQ/hadoop-2.7.6/etc/hadoop/yarn-site.xml ZQ@10.103.105.59:/home/ZQ/hadoop-2.7.6/etc/hadoop

集群的操作和查看

 启动集群

$HADOOP_HOME/sbin/start-dfs.sh

start-dfs.sh

$HADOOP_HOME/sbin/start-yarn.sh

start-yarn.sh

 查看集群

jps

   

HDFS

http://10.103.105.62:50070

/*10.103.105.62为NameNode所在节点的机器名*/

YARN

http://10.103.105.62:8088

/*10.103.105.62为ResourceManager所在节点的机器名*/

 停止集群

$HADOOP_HOME/sbin/stop-yarn.sh

stop-yarn.sh

$HADOOP_HOME/sbin/stop-dfs.sh

stop-dfs.sh