You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Shubham (JIRA)" <ji...@apache.org> on 2019/02/21 08:38:00 UTC
[jira] [Updated] (OOZIE-3439) Hive2 action is not parsing
application ID for TEZ from log file properly
[ https://issues.apache.org/jira/browse/OOZIE-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shubham updated OOZIE-3439:
---------------------------
Description:
Oozie workflow does not populate ChildJobUrl for Hive2 Action while Hive1 is able to find child job ids.
I looked at the code and found that pattern is not correct for hive2 action logs generated in usercache.
{code:java}
static final Pattern[] HIVE2_JOB_IDS_PATTERNS = {
Pattern.compile("Ended Job = (job_\\S*)"),
Pattern.compile("Submitted application (application[0-9_]*)"),
Pattern.compile("Running with YARN Application = (application[0-9_]*)")
}
{code}
Adding below pattern should help in getting Hive 2 action Tez application id
{code:java}
Pattern.compile("Executing on YARN cluster with App id (application[0-9_]*)"),
{code}
was:
Oozie workflow does not populate ChildJobUrl for Hive2 Action while Hive1 is able to find child job ids.
I looked at the code and found that pattern is not correct for hive2 action logs generated in usercache.
{code}static final Pattern[] HIVE2_JOB_IDS_PATTERNS = {
Pattern.compile("Ended Job = (job_\\S*)"),
Pattern.compile("Submitted application (application[0-9_]*)"),
Pattern.compile("Running with YARN Application = (application[0-9_]*)")
}
{code}
Adding below pattern should help in getting Hive 2 action Tez application id
{code}
Pattern.compile("Executing on YARN cluster with App id (application[0-9_]*)"),
{code}
> Hive2 action is not parsing application ID for TEZ from log file properly
> -------------------------------------------------------------------------
>
> Key: OOZIE-3439
> URL: https://issues.apache.org/jira/browse/OOZIE-3439
> Project: Oozie
> Issue Type: Bug
> Components: action
> Affects Versions: trunk
> Reporter: Shubham
> Priority: Major
>
> Oozie workflow does not populate ChildJobUrl for Hive2 Action while Hive1 is able to find child job ids.
> I looked at the code and found that pattern is not correct for hive2 action logs generated in usercache.
> {code:java}
> static final Pattern[] HIVE2_JOB_IDS_PATTERNS = {
> Pattern.compile("Ended Job = (job_\\S*)"),
> Pattern.compile("Submitted application (application[0-9_]*)"),
> Pattern.compile("Running with YARN Application = (application[0-9_]*)")
> }
> {code}
> Adding below pattern should help in getting Hive 2 action Tez application id
> {code:java}
> Pattern.compile("Executing on YARN cluster with App id (application[0-9_]*)"),
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)