You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "frankliee (via GitHub)" <gi...@apache.org> on 2023/09/20 01:55:39 UTC

[GitHub] [iceberg] frankliee opened a new pull request, #8596: Python: Create HadoopFileSystem from netloc (merge request !1060)

frankliee opened a new pull request, #8596:
URL: https://github.com/apache/iceberg/pull/8596

   The current pyarrow module creates FS from hdfs.host and hdfs.port from the catalog configuration.
   ```
   catalog:
     iceberg_catalog:
       hdfs.host: xxxx
       hdfs.port: xxx
   ```
   
   However, when the real hdfs path is anther netloc, it will throw Wrong FS execption. 
   ```
   java.lang.IllegalArgumentException:
           Wrong FS: hdfs://xxxx expected: hdfs://yyyy
   ```
   
   This PR makes two changes:
   
   1) Create FS from uri when netloc is not empty.
   2) Cache FS by the key of <scheme, netloc>
    


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org

[GitHub] [iceberg] Fokko merged pull request #8596: Python: Create HadoopFileSystem from netloc

Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko merged PR #8596:
URL: https://github.com/apache/iceberg/pull/8596


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org