You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by kylin_liu <al...@163.com> on 2017/03/28 09:53:32 UTC
KYLIN 测试 sample 的时候碰到这个坑，请教
执行到这步的时候出现异常，请问这个是怎么回事呢？是MR 问题，还是HBASE 或者 KYLIN 问题
2017-03-28 17:36:58 GMT+8
#17 Step Name: Convert Cuboid Data to HFile
<http://apache-kylin.74782.x6.nabble.com/file/n7532/kylin.bmp>
Application application_1490688738589_0017 failed 2 times due to AM
Container for appattempt_1490688738589_0017_000002 exited with exitCode: 1
For more detailed output, check application tracking
page:http://SND-VN-1846:8088/cluster/app/application_1490688738589_0017Then,
click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1490688738589_0017_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)
at org.apache.hadoop.util.Shell.run(Shell.java:479)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/KYLIN-sample-tp7532.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: KYLIN 测试 sample 的时候碰到这个坑，请教
Posted by kylin_liu <al...@163.com>.
谢谢你的关注和说明。
我hive 版本是 2.1 而且是自己根据源码编译的，是否是版本问题？
错误日志如下:
Container: container_e05_1490775930310_0016_01_000001 on SND-0081_54270
=========================================================================
LogType:stderr
Log Upload Time:Wed Mar 29 03:43:15 -0500 2017
LogLength:760
Log Contents:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/hadoop-2.7.3/mapred/nm-local-dir/usercache/root/filecache/34/hive-jdbc-2.1.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
End of LogType:stderr
LogType:stdout
Log Upload Time:Wed Mar 29 03:43:15 -0500 2017
LogLength:0
Log Contents:
End of LogType:stdout
LogType:syslog
Log Upload Time:Wed Mar 29 03:43:15 -0500 2017
LogLength:1499
Log Contents:
2017-03-29 03:43:10,000 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for
application appattempt_1490775930310_0016_000001
2017-03-29 03:43:10,621 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2017-03-29 03:43:10,894 ERROR [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.util.ServiceConfigurationError:
org.apache.hadoop.security.token.TokenIdentifier: Provider
org.apache.hadoop.hive.llap.security.LlapTokenIdentifier not found
at java.util.ServiceLoader.fail(ServiceLoader.java:231)
at java.util.ServiceLoader.access$300(ServiceLoader.java:181)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:365)
at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
at
org.apache.hadoop.security.token.Token.getClassForIdentifier(Token.java:114)
at org.apache.hadoop.security.token.Token.decodeIdentifier(Token.java:135)
at
org.apache.hadoop.security.token.Token.identifierToString(Token.java:317)
at org.apache.hadoop.security.token.Token.toString(Token.java:337)
at java.lang.String.valueOf(String.java:2847)
at
org.apache.commons.logging.impl.SLF4JLocationAwareLog.info(SLF4JLocationAwareLog.java:155)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1532)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1481)
2017-03-29 03:43:10,899 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting
with status 1
End of LogType:syslog
Container: container_e05_1490775930310_0016_02_000001 on SND-0189_39199
=========================================================================
LogType:stderr
Log Upload Time:Wed Mar 29 03:43:16 -0500 2017
LogLength:761
Log Contents:
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/hadoop-2.7.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/hadoop-2.7.3/mapred/nm-local-dir/usercache/root/filecache/223/hive-jdbc-2.1.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger
(org.apache.hadoop.mapreduce.v2.app.MRAppMaster).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
End of LogType:stderr
LogType:stdout
Log Upload Time:Wed Mar 29 03:43:16 -0500 2017
LogLength:0
Log Contents:
End of LogType:stdout
LogType:syslog
Log Upload Time:Wed Mar 29 03:43:16 -0500 2017
LogLength:1499
Log Contents:
2017-03-29 03:43:14,121 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for
application appattempt_1490775930310_0016_000002
2017-03-29 03:43:14,752 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:
2017-03-29 03:43:15,073 ERROR [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.util.ServiceConfigurationError:
org.apache.hadoop.security.token.TokenIdentifier: Provider
org.apache.hadoop.hive.llap.security.LlapTokenIdentifier not found
at java.util.ServiceLoader.fail(ServiceLoader.java:231)
at java.util.ServiceLoader.access$300(ServiceLoader.java:181)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:365)
at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
at
org.apache.hadoop.security.token.Token.getClassForIdentifier(Token.java:114)
at org.apache.hadoop.security.token.Token.decodeIdentifier(Token.java:135)
at
org.apache.hadoop.security.token.Token.identifierToString(Token.java:317)
at org.apache.hadoop.security.token.Token.toString(Token.java:337)
at java.lang.String.valueOf(String.java:2847)
at
org.apache.commons.logging.impl.SLF4JLocationAwareLog.info(SLF4JLocationAwareLog.java:155)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1532)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1481)
2017-03-29 03:43:15,077 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting
with status 1
End of LogType:syslog
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/KYLIN-sample-tp7532p7545.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: KYLIN 测试 sample 的时候碰到这个坑，请教
Posted by "13802880779@139.com" <13...@139.com>.
mr job failed， get more detail in your mr job history
中国移动广东有限公司 网管中心 梁猛
13802880779@139.com
发件人： kylin_liu
发送时间： 2017-03-28 17:53
收件人： dev
主题： KYLIN 测试 sample 的时候碰到这个坑，请教
执行到这步的时候出现异常，请问这个是怎么回事呢？是MR 问题，还是HBASE 或者 KYLIN 问题
2017-03-28 17:36:58 GMT+8
#17 Step Name: Convert Cuboid Data to HFile
<http://apache-kylin.74782.x6.nabble.com/file/n7532/kylin.bmp>
Application application_1490688738589_0017 failed 2 times due to AM
Container for appattempt_1490688738589_0017_000002 exited with exitCode: 1
For more detailed output, check application tracking
page:http://SND-VN-1846:8088/cluster/app/application_1490688738589_0017Then,
click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1490688738589_0017_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:582)
at org.apache.hadoop.util.Shell.run(Shell.java:479)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:773)
at
org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/KYLIN-sample-tp7532.html
Sent from the Apache Kylin mailing list archive at Nabble.com.