You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "liyang (JIRA)" <ji...@apache.org> on 2017/10/21 01:17:00 UTC
[jira] [Updated] (KYLIN-2943) 关于kylin设置queuename遇到的问题
[ https://issues.apache.org/jira/browse/KYLIN-2943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liyang updated KYLIN-2943:
--------------------------
Labels: scope (was: )
> 关于kylin设置queuename遇到的问题
> -----------------------
>
> Key: KYLIN-2943
> URL: https://issues.apache.org/jira/browse/KYLIN-2943
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v2.1.0
> Environment: CDH5.7
> Reporter: wang20170707
> Assignee: Dong Li
> Labels: scope
>
> 在CDH5.7环境下新搭建kylin2.1环境
> 1.需要修改队列名称，具体操作如下
> 在kylin.properties文件配置队列参数如下：
> kylin.source.kylin.client=beeline
> kylin.engine.mr.config-override.mapreduce.job.queuename=cbasQueue
> kylin.source.hive.config-override.mapreduce.job.queuename=cbasQueue
> 在kylin_hive_conf.xml里面配
> mapred.job.queue.name
> 在
> kylin_job_conf_inmem.xml
> kylin_job_conf.xml文件里配
> mapreduce.job.queuename=cbasQueue
> 2.修改好配置后重启kylin，在load hive table时，运行的mr任务报错，详情如下：
> User: bdcbas1234
> Name: Kylin Hive Column Cardinality Job table=CBAS_DB.S_WEB_APP_PAGE output=hdfs://zhcbdpII/bdcbasApp/kylin/bdcbasApp-kylin_metadata/cardinality/5ae93815-0f53-412e-bb53-07c194c873d7/CBAS_DB.S_WEB_APP_PAGE
> Application Type: MAPREDUCE
> Application Tags:
> State: FAILED
> FinalStatus: FAILED
> Started: 星期二 十月 17 16:25:47 +0800 2017
> Elapsed: 8sec
> Tracking URL: History
> Diagnostics:
> Application application_1507516583223_4851 failed 2 times due to AM Container for appattempt_1507516583223_4851_000002 exited with exitCode: 1 due to: Exception from container-launch.
> Container id: container_1507516583223_4851_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:290)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Shell output: main : command provided 1
> main : user is bdcbas1234
> main : requested yarn user is bdcbas1234
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
> 3.在BULID CUBE时，在第2步失败：
> #1 Step Name: Create Intermediate Flat Hive Table
> 执行成功，mr任务使用的queue为配置后的cbasQueue
> #2 Step Name: Redistribute Flat Hive Table
> 执行失败，mr任务select count(*) from ...6d_9935_49f0c9600e38(Stage-1)使用的queue为配置前的default
> 4.将kylin.properties文件里的参数
> kylin.source.kylin.client修改为cli
> 执行load hive table错误与beeline相同
> 5.在BULID CUBE时,在第3步失败
> #1 Step Name: Create Intermediate Flat Hive Table
> 执行成功，与beeline相同
> #2 Step Name: Redistribute Flat Hive Table
> 执行成功，后台没有运行mr任务，kylin日志打印如下
> Row count is 0, no need to redistribute
> #3 Step Name: Extract Fact Table Distinct Columns
> 执行失败，日志如下：
> User: bdcbas1234
> Name: Kylin_Fact_Distinct_Columns_w_cub_source_Step
> Application Type: MAPREDUCE
> Application Tags:
> State: FAILED
> FinalStatus: FAILED
> Started: 星期二 十月 17 13:52:40 +0800 2017
> Elapsed: 26sec
> Tracking URL: History
> Diagnostics:
> Application application_1507516583223_4639 failed 2 times due to AM Container for appattempt_1507516583223_4639_000002 exited with exitCode: 1 due to: Exception from container-launch.
> Container id: container_1507516583223_4639_02_000001
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
> at org.apache.hadoop.util.Shell.run(Shell.java:455)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
> at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:290)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Shell output: main : command provided 1
> main : user is bdcbas1234
> main : requested yarn user is bdcbas1234
> Container exited with a non-zero exit code 1
> .Failing this attempt.. Failing the application.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)