Exception during Redistribute Flat Hive Table

[arun chandy thomas <ar...@gmail.com>]

Hi,

I am getting the below exception in Redistribute Flat Hive Table step after
moving from hive cli to beeline. Does anyone know about this problem?


org.apache.kylin.job.exception.ExecuteException:
org.apache.kylin.job.exception.ExecuteException: java.sql.SQLException:
Error while processing statement: FAILED: Execution Error, return code 1
from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:181)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.kylin.job.exception.ExecuteException:
java.sql.SQLException: Error while processing statement: FAILED: Execution
Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:181)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:166)
... 4 more
Caused by: java.sql.SQLException: Error while processing statement: FAILED:
Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.mr.MapRedTask
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:294)
at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:395)
at
org.apache.kylin.source.hive.BeelineHiveClient.getHiveTableRows(BeelineHiveClient.java:116)
at
org.apache.kylin.source.hive.RedistributeFlatHiveTableStep.computeRowCount(RedistributeFlatHiveTableStep.java:41)
at
org.apache.kylin.source.hive.RedistributeFlatHiveTableStep.doWork(RedistributeFlatHiveTableStep.java:91)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:166)
... 6 more

Re: Exception during Redistribute Flat Hive Table

[ShaoFeng Shi <sh...@apache.org>]

Hi Arun,

I have no idea. Maybe need to check the YARN logs to see what's wrong in
the server side. Here is a post about such error, but not sure whether it
is related:
https://stackoverflow.com/questions/46439306/failed-execution-error-return-code-1-from-org-apache-hadoop-hive-ql-exec-mr-ma/50578689

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: shaofengshi@apache.org

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: user-subscribe@kylin.apache.org
Join Kylin dev mail group: dev-subscribe@kylin.apache.org




arun chandy thomas <ar...@gmail.com> 于2019年5月24日周五 上午11:30写道：

> Hi,
>
> I am getting the below exception in Redistribute Flat Hive Table step
> after moving from hive cli to beeline. Does anyone know about this problem?
>
>
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException: java.sql.SQLException:
> Error while processing statement: FAILED: Execution Error, return code 1
> from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:181)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.kylin.job.exception.ExecuteException:
> java.sql.SQLException: Error while processing statement: FAILED: Execution
> Error, return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:181)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:166)
> ... 4 more
> Caused by: java.sql.SQLException: Error while processing statement:
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.mr.MapRedTask
> at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:294)
> at org.apache.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:395)
> at
> org.apache.kylin.source.hive.BeelineHiveClient.getHiveTableRows(BeelineHiveClient.java:116)
> at
> org.apache.kylin.source.hive.RedistributeFlatHiveTableStep.computeRowCount(RedistributeFlatHiveTableStep.java:41)
> at
> org.apache.kylin.source.hive.RedistributeFlatHiveTableStep.doWork(RedistributeFlatHiveTableStep.java:91)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:166)
> ... 6 more
>