You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ewan Higgs (JIRA)" <ji...@apache.org> on 2017/08/23 11:51:02 UTC
[jira] [Commented] (SPARK-21817) Pass FSPermissions to
LocatedFileStatus from InMemoryFileIndex
[ https://issues.apache.org/jira/browse/SPARK-21817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16138253#comment-16138253 ]
Ewan Higgs commented on SPARK-21817:
------------------------------------
{quote}Can this be accomplished with a change that's still compatible with 2.6?{quote}
Yes I believe it should just work. The argument exists in the function call; {{InMemoryFileIndex}} is just passing {{null}} currently.
> Pass FSPermissions to LocatedFileStatus from InMemoryFileIndex
> --------------------------------------------------------------
>
> Key: SPARK-21817
> URL: https://issues.apache.org/jira/browse/SPARK-21817
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: Ewan Higgs
> Priority: Minor
> Attachments: SPARK-21817.001.patch
>
>
> The implementation of HDFS-6984 now uses the passed in {{FSPermission}} to pull out the ACL and other information. Therefore passing in a {{null}} is no longer adequate and hence causes a NPE when listing files.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org