高可用HA环境搭建参考20190711步骤
在以上环境进行简单配置即可
登录node1节点修改mapred-site.xml、yarn-site.xml
1.mapred-site.xml
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
2.yarn-site.xml
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.resourcemanager.ha.enabled</name>
<value>true</value>
</property>
<property>
<name>yarn.resourcemanager.cluster-id</name>
<value>cluster1</value>
</property>
<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm1</name>
<value>node3</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm2</name>
<value>node4</value>
</property>
<property>
<name>yarn.resourcemanager.zk-address</name>
<value>node2:2181,node3:2181,node4:2181</value>
</property>
3. 将上述两个配置文件同步到node2、node3、node4节点
在node1节点先启动 start-dfs.sh (等同start-dfs.sh || start-yarn.sh)
然后在node1节点启动 yarn-daemons.sh start resourcemanager
在node3、node4节点之行jps查看
[hadoop@node3 current]$ jps
20113 NodeManager
20289 ResourceManager
10341 QuorumPeerMain
20373 Jps
19870 DataNode
19983 JournalNode
注意：之行以上命令前要确保zk服务已启动
zookeeper配置在 node2、node3、node4三个节点上
zkServer.sh status ［查看zk服务］
zkServer.sh start ［启动zk服务］
resourcemanager服务需要手动停止或启动,start-all.sh不包含rm服务
yarn-daemons.sh start resource manager ［启动］
yarn-daemons.sh stop resource manager ［停止］
4. 启动浏览器查看 resourceManager服务
登录node3或node4 浏览器输入node04:8088
