You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@gluten.apache.org by "wForget (via GitHub)" <gi...@apache.org> on 2025/10/15 12:49:50 UTC
[I] [VL] feat: Support extra schemes for hdfs filesystem [incubator-gluten]
wForget opened a new issue, #10895:
URL: https://github.com/apache/incubator-gluten/issues/10895
### Description
Currently we have supported jvm-based libhdfs, which means we can access any file system that implements hadoop FileSystem through its java client, like: `s3:// `, `rbf://`, `customFs://`, etc.
### Gluten version
main branch
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] feat: Support extra schemes for hdfs filesystem [incubator-gluten]
Posted by "wForget (via GitHub)" <gi...@apache.org>.
wForget commented on issue #10895:
URL: https://github.com/apache/incubator-gluten/issues/10895#issuecomment-3406276252
Depends on https://github.com/facebookincubator/velox/pull/15170
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org
Re: [I] [VL] feat: Support extra schemes for hdfs filesystem [incubator-gluten]
Posted by "zhouyuan (via GitHub)" <gi...@apache.org>.
zhouyuan commented on issue #10895:
URL: https://github.com/apache/incubator-gluten/issues/10895#issuecomment-3421414349
@wForget This is interesting idea. The JVM HDFS client is introduced for supporting the HDFS kerberos related and `viewfs` feature. I think it should also cover for the Hadoop compatible filesystem also.
Maybe a more general way for us is to support OpenDAL as it supports lots of filesystems already:
https://github.com/apache/opendal
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@gluten.apache.org
For additional commands, e-mail: commits-help@gluten.apache.org