You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "dzcxzl (Jira)" <ji...@apache.org> on 2021/07/06 13:17:00 UTC
[jira] [Comment Edited] (SPARK-32467) Avoid encoding URL twice on
https redirect
[ https://issues.apache.org/jira/browse/SPARK-32467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368005#comment-17368005 ]
dzcxzl edited comment on SPARK-32467 at 7/6/21, 1:16 PM:
---------------------------------------------------------
YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params.
If the Yarn cluster does not use the YARN-3217 YARN-3239 patch, the running spark job still encounters the NPE problem when accessing the task page.
Does spark need to do URL decode twice to avoid NPE?
was (Author: dzcxzl):
YARN-3239. WebAppProxy does not support a final tracking url which has query fragments and params.
If the Yarn cluster does not use the YARN-3239 patch, the running spark job still encounters the NPE problem when accessing the task page.
Does spark need to do URL decode twice to avoid NPE?
> Avoid encoding URL twice on https redirect
> ------------------------------------------
>
> Key: SPARK-32467
> URL: https://issues.apache.org/jira/browse/SPARK-32467
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 3.0.1, 3.1.0
> Reporter: Gengliang Wang
> Assignee: Gengliang Wang
> Priority: Major
>
> Currently, on https redirect, the original URL is encoded as an HTTPS URL. However, the original URL could be encoded already, so that the return result of method
> UriInfo.getQueryParameters will contain encoded keys and values. For example, a parameter
> order[0][dir] will become order%255B0%255D%255Bcolumn%255D after encoded twice, and the decoded
> key in the result of UriInfo.getQueryParameters will be order%5B0%5D%5Bcolumn%5D.
> To fix the problem, we try decoding the query parameters before encoding it. This is to make sure we encode the URL exactly once.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org