You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "nichunen (Jira)" <ji...@apache.org> on 2019/10/28 11:05:00 UTC
[jira] [Updated] (KYLIN-4163) CreateFlatHiveTableStep has not yarn
app url when hive job running
[ https://issues.apache.org/jira/browse/KYLIN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
nichunen updated KYLIN-4163:
----------------------------
Fix Version/s: v3.0.0
> CreateFlatHiveTableStep has not yarn app url when hive job running
> ------------------------------------------------------------------
>
> Key: KYLIN-4163
> URL: https://issues.apache.org/jira/browse/KYLIN-4163
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine, Web
> Affects Versions: v3.0.0-alpha
> Reporter: chuxiao
> Priority: Minor
> Fix For: v3.0.0
>
> Attachments: KYLIN-4163.master.001.patch, flathivetablerunning图.jpg
>
>
> CreateFlatHiveTableStep has yarn app url on the monitor web page only when job finished, but SparkExecutable has yarn app url when job running.
> this is because of SparkExecutable`s logger has logger listener:
> {code:java}
> final PatternedLogger patternedLogger = new PatternedLogger(logger, new PatternedLogger.ILogListener() {
> @Override
> public void onLogEvent(String infoKey, Map<String, String> info) {
> // only care three properties here
> if (ExecutableConstants.SPARK_JOB_ID.equals(infoKey)
> || ExecutableConstants.YARN_APP_ID.equals(infoKey)
> || ExecutableConstants.YARN_APP_URL.equals(infoKey)) {
> getManager().addJobInfo(getId(), info);
> }
> }
> });{code}
> sometimes creating flat hive table hangs, so user wants to have yarn app url when hive job running like attachment.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)