You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/03/31 09:48:41 UTC

[jira] [Assigned] (SPARK-20172) Event log without read permission should be filtered out before actually reading it

     [ https://issues.apache.org/jira/browse/SPARK-20172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-20172:
------------------------------------

    Assignee:     (was: Apache Spark)

> Event log without read permission should be filtered out before actually reading it
> -----------------------------------------------------------------------------------
>
>                 Key: SPARK-20172
>                 URL: https://issues.apache.org/jira/browse/SPARK-20172
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Core
>    Affects Versions: 2.2.0
>            Reporter: Saisai Shao
>            Priority: Minor
>
> In the current Spark's HistoryServer, we expected to check file permission when listing all the files, and filter out this files with no read permission. That was not worked because we actually doesn't check the access permission, so we defer this permission check until reading files, that is not necessary and the exception is printed out in every 10 seconds by default.
> So to avoid this problem we should add a access check logic in listing files.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org