You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@livy.apache.org by GitBox <gi...@apache.org> on 2020/01/06 07:36:25 UTC

[GitHub] [incubator-livy] Jassy1994 commented on issue #269: support using hadoop native methods in local file system

Jassy1994 commented on issue #269: support using hadoop native methods in local file system
URL: https://github.com/apache/incubator-livy/pull/269#issuecomment-571036668
 
 
   > > using native methods prevent to create new process
   > 
   > @Jassy1994 would you please explain more about this? I was thinking should it be the behavior of Hadoop, not Livy, why do we need to be aware of this in Livy side?
   
   @jerryshao 
   I find Livy FileSystemStateStore use RawLocalFileSystem when store recoveryMetadata in local. RawLocalFileSystem default use deprecated file status which won't call hadoop native libs, so we need call this static method explicitly to forbid using deprecated file status. of course this issue has relation about hadoop and hadoop native libs should be supplied and can be quoted by livy server.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services