You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/01/29 03:18:41 UTC

[GitHub] [arrow-datafusion] yahoNanJing commented on issue #349: Ballista context should get file metadata from scheduler, not from local disk

yahoNanJing commented on issue #349:
URL: https://github.com/apache/arrow-datafusion/issues/349#issuecomment-1024820528


   Hi @andygrove, we have integrated ballista with HDFS support. Our workaround is to make the file path self described. For example, a local file path should be file://tmp/..., a hdfs file path should hdfs://localhost:xxx:/tmp/...
   
   To make it work, we also changed the object store api a bit. Later I'll create a PR for this. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org