You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@knox.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/08/25 17:27:00 UTC
[jira] [Work logged] (KNOX-2647) [Spark History UI Service]
Executor logs (stdout/stderr) links are broken with JobHostory Service
[ https://issues.apache.org/jira/browse/KNOX-2647?focusedWorklogId=641846&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-641846 ]
ASF GitHub Bot logged work on KNOX-2647:
----------------------------------------
Author: ASF GitHub Bot
Created on: 25/Aug/21 17:26
Start Date: 25/Aug/21 17:26
Worklog Time Spent: 10m
Work Description: xyu opened a new pull request #485:
URL: https://github.com/apache/knox/pull/485
## What changes were proposed in this pull request?
Add a rewrite rule to fix the executor log links here:
When MR JobHistory Server is also running.
## How was this patch tested?
I have applied this patch on our internal cluster and can see that the links now go through Knox instead of pointing directly at the JobHistory Server Web UI endpoint.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@knox.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 641846)
Remaining Estimate: 0h
Time Spent: 10m
> [Spark History UI Service] Executor logs (stdout/stderr) links are broken with JobHostory Service
> --------------------------------------------------------------------------------------------------
>
> Key: KNOX-2647
> URL: https://issues.apache.org/jira/browse/KNOX-2647
> Project: Apache Knox
> Issue Type: Bug
> Affects Versions: 1.5.0
> Reporter: Xiao Yu
> Priority: Minor
> Attachments: KNOX-2647.patch, spark-history-ui.png
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently with Knox 1.5.0 on a cluster with both Spark History Server and MR JobHistory Server running the stdout and stderr links target the MR JobHistory Server Web UI directly. For us this breaks them because we require Knox fronted proxy access to the MR JobHistory Server on our production cluster.
> !spark-history-ui.png|width=899,height=493!
> A similar issue was raised in:
> - KNOX-1744
> - KNOX-1988
> However in this case the links are going to the MR JobHistory Server not YARN RM so the targets are different and the previous rewrites do not apply.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)