You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "Yaqian Zhang (Jira)" <ji...@apache.org> on 2019/09/23 09:51:00 UTC
[jira] [Commented] (KYLIN-4163) CreateFlatHiveTableStep has not
yarn app url when hive job running
[ https://issues.apache.org/jira/browse/KYLIN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935700#comment-16935700 ]
Yaqian Zhang commented on KYLIN-4163:
-------------------------------------
Hi chuxiao:
Thank you for your report.
I have verified your patch and I'll put it up for you as the author.
Best Regards!
> CreateFlatHiveTableStep has not yarn app url when hive job running
> ------------------------------------------------------------------
>
> Key: KYLIN-4163
> URL: https://issues.apache.org/jira/browse/KYLIN-4163
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine, Web
> Affects Versions: v3.0.0-alpha
> Reporter: chuxiao
> Priority: Minor
> Attachments: KYLIN-4163.master.001.patch, flathivetablerunning图.jpg
>
>
> CreateFlatHiveTableStep has yarn app url on the monitor web page only when job finished, but SparkExecutable has yarn app url when job running.
> this is because of SparkExecutable`s logger has logger listener:
> {code:java}
> final PatternedLogger patternedLogger = new PatternedLogger(logger, new PatternedLogger.ILogListener() {
> @Override
> public void onLogEvent(String infoKey, Map<String, String> info) {
> // only care three properties here
> if (ExecutableConstants.SPARK_JOB_ID.equals(infoKey)
> || ExecutableConstants.YARN_APP_ID.equals(infoKey)
> || ExecutableConstants.YARN_APP_URL.equals(infoKey)) {
> getManager().addJobInfo(getId(), info);
> }
> }
> });{code}
> sometimes creating flat hive table hangs, so user wants to have yarn app url when hive job running like attachment.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)