[jira] [Created] (KYLIN-4163) CreateFlatHiveTableStep has not yarn app url when hive job running

["chuxiao (Jira)" <ji...@apache.org>]

chuxiao created KYLIN-4163:
------------------------------

             Summary: CreateFlatHiveTableStep has not yarn app url when hive job running
                 Key: KYLIN-4163
                 URL: https://issues.apache.org/jira/browse/KYLIN-4163
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
    Affects Versions: v3.0.0-alpha
            Reporter: chuxiao
         Attachments: flathivetablerunning图.jpg

CreateFlatHiveTableStep has yarn app url on the monitor web page only when job finished, but SparkExecutable has yarn app url when job running.
this is because of SparkExecutable`s logger has logger listener:
{code:java}
final PatternedLogger patternedLogger = new PatternedLogger(logger, new PatternedLogger.ILogListener() {
 @Override
 public void onLogEvent(String infoKey, Map<String, String> info) {
 // only care three properties here
 if (ExecutableConstants.SPARK_JOB_ID.equals(infoKey)
 || ExecutableConstants.YARN_APP_ID.equals(infoKey)
 || ExecutableConstants.YARN_APP_URL.equals(infoKey)) {
 getManager().addJobInfo(getId(), info);
 }
 }
 });{code}

sometimes creating flat hive table hangs, so user wants to have yarn app url when hive job running  like attachment.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)