[jira] [Resolved] (KYLIN-4163) CreateFlatHiveTableStep has not yarn app url when hive job running

["nichunen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KYLIN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

nichunen resolved KYLIN-4163.
-----------------------------
    Resolution: Fixed

> CreateFlatHiveTableStep has not yarn app url when hive job running
> ------------------------------------------------------------------
>
>                 Key: KYLIN-4163
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4163
>             Project: Kylin
>          Issue Type: Improvement
>          Components: Job Engine, Web 
>    Affects Versions: v3.0.0-alpha
>            Reporter: chuxiao
>            Priority: Minor
>             Fix For: v3.0.0
>
>         Attachments: KYLIN-4163.master.001.patch, flathivetablerunning图.jpg
>
>
> CreateFlatHiveTableStep has yarn app url on the monitor web page only when job finished, but SparkExecutable has yarn app url when job running.
> this is because of SparkExecutable`s logger has logger listener:
> {code:java}
> final PatternedLogger patternedLogger = new PatternedLogger(logger, new PatternedLogger.ILogListener() {
>  @Override
>  public void onLogEvent(String infoKey, Map<String, String> info) {
>  // only care three properties here
>  if (ExecutableConstants.SPARK_JOB_ID.equals(infoKey)
>  || ExecutableConstants.YARN_APP_ID.equals(infoKey)
>  || ExecutableConstants.YARN_APP_URL.equals(infoKey)) {
>  getManager().addJobInfo(getId(), info);
>  }
>  }
>  });{code}
> sometimes creating flat hive table hangs, so user wants to have yarn app url when hive job running  like attachment.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)