You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Jie Zhang <ji...@gmail.com> on 2017/05/15 17:44:12 UTC

operation log is missing when using hive.execution.engine=mr

Hi,

My team just upgrade Hive from 0.14.0 to 2.1.1. The operation log is
missing when running the query, no query progress is printed. The only log
printed in operation log is
"WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in
the future versions. Consider using a different execution engine (i.e.
spark, tez) or using Hive 1.x release. "

So far, we are still using MR execution engine. And the hive server 2 log
still prints MR job progress, but not in operation log. May I know whether
operation log is disabled for MR? or any property needs to be set in order
to get MR job progress routed to operation log? Thanks!

Jessica

Re: operation log is missing when using hive.execution.engine=mr

Posted by Jie Zhang <ji...@gmail.com>.
Hi, Peter,

Exactly! By setting hive.async.log.enabled=false and restart hive server 2,
the MR job progress is printed in the operation log. Thanks very much for
your help!

Jessica

On Mon, May 15, 2017 at 10:56 AM, Peter Vary <pv...@cloudera.com> wrote:

> Hi Jessica,
>
> Is it possible that you are effected by this?
> https://issues.apache.org/jira/browse/HIVE-16061
>
> Thanks,
> Peter
>
>
>
>
>
> 2017. máj. 15. 19:44 ezt írta ("Jie Zhang" <ji...@gmail.com>):
>
> Hi,
>
> My team just upgrade Hive from 0.14.0 to 2.1.1. The operation log is
> missing when running the query, no query progress is printed. The only log
> printed in operation log is
> "WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in
> the future versions. Consider using a different execution engine (i.e.
> spark, tez) or using Hive 1.x release. "
>
> So far, we are still using MR execution engine. And the hive server 2 log
> still prints MR job progress, but not in operation log. May I know whether
> operation log is disabled for MR? or any property needs to be set in order
> to get MR job progress routed to operation log? Thanks!
>
> Jessica
>
>
>
>
>
>
>
>

Re: operation log is missing when using hive.execution.engine=mr

Posted by Peter Vary <pv...@cloudera.com>.
Hi Jessica,

Is it possible that you are effected by this?
https://issues.apache.org/jira/browse/HIVE-16061

Thanks,
Peter




2017. máj. 15. 19:44 ezt írta ("Jie Zhang" <ji...@gmail.com>):

Hi,

My team just upgrade Hive from 0.14.0 to 2.1.1. The operation log is
missing when running the query, no query progress is printed. The only log
printed in operation log is
"WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in
the future versions. Consider using a different execution engine (i.e.
spark, tez) or using Hive 1.x release. "

So far, we are still using MR execution engine. And the hive server 2 log
still prints MR job progress, but not in operation log. May I know whether
operation log is disabled for MR? or any property needs to be set in order
to get MR job progress routed to operation log? Thanks!

Jessica