You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Christoph Körner (JIRA)" <ji...@apache.org> on 2017/01/13 12:45:26 UTC
[jira] [Updated] (OOZIE-2772) Oozie job with Hive 2 action finishes
with SUCCEEDED despite beeline error
[ https://issues.apache.org/jira/browse/OOZIE-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christoph Körner updated OOZIE-2772:
------------------------------------
Affects Version/s: 4.3.0
Component/s: action
> Oozie job with Hive 2 action finishes with SUCCEEDED despite beeline error
> --------------------------------------------------------------------------
>
> Key: OOZIE-2772
> URL: https://issues.apache.org/jira/browse/OOZIE-2772
> Project: Oozie
> Issue Type: Bug
> Components: action
> Affects Versions: 4.2.0, 4.3.0
> Environment: HDP 2.4, Beeline version 1.2.1000.2.4.0.0-169
> Reporter: Christoph Körner
>
> Running a simple Oozie Job with a Hive 2 action and a missing init script will cause an error in beeline. However, the Oozie job is not picking up the error and reporting status SUCCEEDED in the web UI. Interestingly the launcher MR job creates a log file in the local appcache directory; however this error log is not visible in the yarn logs neither and gets deleted with the appcache automatically.
> I tested it with the following statement (the complete workflow can be found on Github: https://github.com/chaosmail/oozie-bugs/tree/master/simple-hive-init/simple-hive-init-wf).
> Init Script:
> {code:title=init.hive|borderStyle=solid}
> CREATE TEMPORARY MACRO ADD_NUMBERS(a INT, b INT) a + b;
> {code}
> Query Script:
> {code:title=query.hive|borderStyle=solid}
> SELECT ADD_NUMBERS(1,2) FROM tbl LIMIT 1;
> {code}
> The hive error log in the local appcache directory.
> {code:borderStyle=solid}
> $ more appcache/application_1480609892100_0276/container_e55_1480609892100_0276_01_000002/hive2-oozie-job_1480609892100_0276.log
> Connecting to jdbc:hive2://localhost:10000/default
> Connected to: Apache Hive (version 1.2.1000.2.4.0.0-169)
> Driver: Hive JDBC (version 1.2.1000.2.4.0.0-169)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> Running init script init.hive
> init.hive (No such file or directory)
> Closing: 0: jdbc:hive2://localhost:10000/default
> {code}
> Oozie reports job succedded.
> {code:borderStyle=solid}
> $ oozie job -oozie http://localhost:11000/oozie -info 0000039-170111125800146-oozie-oozi-W
> Job ID : 0000039-170111125800146-oozie-oozi-W
> ------------------------------------------------------------------------------------------------------------------------------------
> Workflow Name : test-wf
> App Path : /user/koernerc/apps/simple-hive-init-wf
> Status : SUCCEEDED
> Run : 0
> User : root
> Group : -
> Created : 2017-01-13 09:56 GMT
> Started : 2017-01-13 09:56 GMT
> Last Modified : 2017-01-13 09:56 GMT
> Ended : 2017-01-13 09:56 GMT
> CoordAction ID: -
> Actions
> ------------------------------------------------------------------------------------------------------------------------------------
> ID Status Ext ID Ext Status Err Code
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000039-170111125800146-oozie-oozi-W@:start: OK - OK -
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000039-170111125800146-oozie-oozi-W@test-action OK job_1480609892100_0276 SUCCEEDED -
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000039-170111125800146-oozie-oozi-W@end OK - OK -
> ------------------------------------------------------------------------------------------------------------------------------------
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)