[GitHub] [spark] bharatviswa504 edited a comment on pull request #29030: [SPARK-32093][BUILD] Add hadoop-ozone-filesystem jar.

[GitBox <gi...@apache.org>]

bharatviswa504 edited a comment on pull request #29030:
URL: https://github.com/apache/spark/pull/29030#issuecomment-655802947


   > Does it work if a user app just includes it?
   
   Yes, and also it requires configuration required to connect to the ozone cluster. They can be included in core-site or in a new file ozone-site.xml.
   
   > Can it go in hadoop-cloud if it must be packaged with Spark in some contexts -- why a new profile?
   
   Initially, I have thought of a new profile, later used the existing Hadoop profile only.
   I have updated the PR description to reflect the same.
   
   > but what is Ozone, a file system from the Hadoop project, and who / how many people would need this?
   
   Right now it is a sub-project of Hadoop.
   Ozone is a scalable, redundant, and distributed object store for Hadoop, and also it provides Hadoop compatible FileSystem where spark/hive applications can run on it.
   
   Link to Ozone website
   https://hadoop.apache.org/ozone/
   
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org