Hadoop问题

version: 2.7.3

Kill a hadoop job:

yarn application -kill $ApplicationId

You can get a list of all ApplicationId's doing:

yarn application -list

MapReduce jobs get stuck in Accepted state:

A job stuck in accepted state on YARN is usually because of free resources are not enough. You can check it at http://resourcemanager:port/cluster/scheduler:

if Memory Used + Memory Reserved >= Memory Total, memory is not enough
if VCores Used + VCores Reserved >= VCores Total, VCores is not enough

It may also be limited by parameters such as maxAMShare.
See more: http://stackoverflow.com/questions/20200636/mapreduce-jobs-get-stuck-in-accepted-state

查看scheduler发现Memory Total为0,htop发现内存已被chrome几乎用尽,关闭chrome,重启了yarn,完美运行job

最后编辑于
©著作权归作者所有,转载或内容合作请联系作者
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

推荐阅读更多精彩内容