You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "saidixith002 (via GitHub)" <gi...@apache.org> on 2023/11/08 17:29:50 UTC
[I] using pyiceberg with kerberized hive metastore [iceberg-python]
saidixith002 opened a new issue, #135:
URL: https://github.com/apache/iceberg-python/issues/135
### Question
Hi,
Can anyone share examples of using pyiceberg with a kerberized hive metastore?
```
raise TTransportException(type=TTransportException.END_OF_FILE,
thrift.transport.TTransport.TTransportException: TSocket read 0 bytes
```
same question posted here - https://github.com/apache/iceberg/issues/6229
Thanks!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-3448916586
its difficult to setup and test a kerberize HMS. Would love to get the community's help on this :)
I think https://py.iceberg.apache.org/configuration/#hive-catalog would be a good place to document this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "dsully (via GitHub)" <gi...@apache.org>.
dsully commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-3424168027
+1 - the documentation here is severely lacking.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "awdavidson (via GitHub)" <gi...@apache.org>.
awdavidson commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-2117766048
It also looks like the hive catalogs configuration does not support HA HMS.
This configuration `uri: thrift://master1.url:9083,thrift://master2.url:9083` throws a ValueError
```
ValueError: Port could not be cast to integer value as '9083,thrift:'
```
pyiceberg version is `0.6.1`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "Fokko (via GitHub)" <gi...@apache.org>.
Fokko commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-1803417762
Hey @saidixith002 this is currently not supported, but can be added. I see some Kerberos references in `ThriftHiveMetastore.py`, such as `get_delegation_token` and `send_get_delegation_token`. Are you interested in contributing Kerberos support?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu closed issue #135: using pyiceberg with kerberized hive metastore
URL: https://github.com/apache/iceberg-python/issues/135
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "dev-sajal (via GitHub)" <gi...@apache.org>.
dev-sajal commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-2849330465
Hey, just checking if someone was able to use it still? I am unable to access metastore yet, facing the same issue as the initial thread.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "kevinjqliu (via GitHub)" <gi...@apache.org>.
kevinjqliu commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-2654706545
hey folks, #1634 added supports for kerberize hive metastore. Please check it out and let us know if there's any issues
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "wuxiaocheng0506 (via GitHub)" <gi...@apache.org>.
wuxiaocheng0506 commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-1953690548
Hello, any update?
We also need kerberos support.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
Re: [I] using pyiceberg with kerberized hive metastore [iceberg-python]
Posted by "Ohadkaiser (via GitHub)" <gi...@apache.org>.
Ohadkaiser commented on issue #135:
URL: https://github.com/apache/iceberg-python/issues/135#issuecomment-1900508161
Hi!
Was there any changes to this issue in the last months?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org