kylin报错

[2018-10-18 19:40:27.332]Exception from container-launch.
Container id: container_1539853922352_0003_01_000002
Exit code: 1

[2018-10-18 19:40:27.340]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :

[2018-10-18 19:40:27.356]Container exited with a non-zero exit code 1. Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :

解决方案:
在mapred-site.xml文件中添加mapreduce所需要用到的classpath。

<property>
   <name>mapreduce.application.classpath</name>
   <value><hadoop跟目录>/share/hadoop/mapreduce/*, <hadoop跟目录>/share/hadoop/mapreduce/lib/*</value>
</property>

报错:

org.apache.kylin.engine.mr.exception.MapReduceException: Exception: java.net.ConnectException: Call From kylin2/172.26.76.124 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
java.net.ConnectException: Call From kylin2/172.26.76.124 to 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
    at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:234)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
    at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
    at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
    at org.apache.kylin.job.impl.threadpool.DistributedScheduler$JobRunner.run(DistributedScheduler.java:234)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
![image.png](https://upload-images.jianshu.io/upload_images/18022395-40ed4527a24f0f21.png?imageMogr2/auto-orient/strip%7CimageView2/2/w/1240)

解决方案
(老版本)在mapred-site.xml文件中添加

<property>
   <name>mapreduce.jobhistory.address</name>
   <value>kylin1:10020</value>
</property>
<property>
   <name>mapreduce.jobhistory.webapp.address</name>
   <value>kylin1:19888</value>
</property>

(新版本) yarn-site.xml 中添加

</property>
<!--新版本指定文件-->
    <property>
        <name>yarn.resourcemanager.webapp.address.rm1</name>
        <value>kylin1</value>
    </property>
    <property>
        <name>yarn.resourcemanager.scheduler.address.rm2</name>
        <value>kylin2</value>
    </property>
<property>

报错:
Container [pid=8794,containerID=container_1552484587522_0002_01_000005] is running 431118848B beyond the 'VIRTUAL' memory limit. Current usage: 51.4 MB of 1 GB physical memory used; 2.5 GB of 2.1 GB virtual memory used. Killing container.

解决方案:
hadoop 配置文件 yarn-site.xml 中添加

<property>
  <name>yarn.nodemanager.vmem-check-enabled</name>
  <value>false</value>
</property>

文献:
https://blog.csdn.net/chenyaoo/article/details/83152235

©著作权归作者所有,转载或内容合作请联系作者
【社区内容提示】社区部分内容疑似由AI辅助生成,浏览时请结合常识与多方信息审慎甄别。
平台声明:文章内容(如有图片或视频亦包括在内)由作者上传并发布,文章内容仅代表作者本人观点,简书系信息发布平台,仅提供信息存储服务。

相关阅读更多精彩内容

友情链接更多精彩内容