You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "holdenk (Jira)" <ji...@apache.org> on 2019/08/28 22:03:00 UTC

[jira] [Created] (SPARK-28905) PVs mounted into Spark may not be writable by Spark

holdenk created SPARK-28905:
-------------------------------

             Summary: PVs mounted into Spark may not be writable by Spark
                 Key: SPARK-28905
                 URL: https://issues.apache.org/jira/browse/SPARK-28905
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 3.0.0
            Reporter: holdenk
            Assignee: holdenk


Right now, for Spark to have write access to the PVs we provide it, they need to be created with UID 185. This _may_ be a feature, but if we wanted to make this more flexible we could set a FsGroup in our security context when setting up the volumes. This would give Spark access provided the PV supports fsgroup (which on minikube does not appear to be the case - [https://github.com/kubernetes/minikube/issues/1990] )

 

If we did want to do this we could add the securitygroup in MountVolumesFeatureStep but I don't know if we want to do this or if the current behaviour is desired.

I ran into this while getting the integration tests to work w/minikube 1.3.1 on OSX. See https://issues.apache.org/jira/browse/SPARK-28904 for details.

 

cc [~ifilonenko] for thoughts



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org