[GitHub] [spark] AngersZhuuuu commented on issue #25197: [SPARK-21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem(FS) e…

[GitBox <gi...@apache.org>]

AngersZhuuuu commented on issue #25197: [SPARK-21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem(FS) e…
URL: https://github.com/apache/spark/pull/25197#issuecomment-517208837
 
 
   > > trigger this when start SparkSQLEnv, then HiveClientImple's sessionState's Hdfs Encryption's FS won't be under session's UGI. Good ideal. Seems your method is more simpler compared to my method.
   > > But not enough for version higher than v2.2.0
   > 
   > I didn't get "not enough for version higher than v2.2.0". Would you pls explain more?
   
   Version higher then v2.2.0, it will generate Hdfs Encryption for each path's filesystem, if we have different path with different FileSystem for moveFile's src & dest, it won't work  well for all situation

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org