You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2020/09/24 13:15:30 UTC

[GitHub] [iceberg] zhangjun0x01 commented on issue #1437: FlinkCatalog will need to load hive's configuration files.

zhangjun0x01 commented on issue #1437:
URL: https://github.com/apache/iceberg/issues/1437#issuecomment-698336718


    I have meet the same issue, for the modification of this issue, I have a few thoughts:
    1. Specify the hive conf dir like flink, and then construct HiveConf through the hive-site.xml in this dir, but in this case, if flink is started in application mode, the cluster will can not load the  hive configuration on the jobmanager of flink, There is maybe no hive-site.xml file on yarn cluster
    2. We construct a HiveConf by the user's parameters. What I tested is that at least two parameters are required to construct HiveConf, hive metastore uri and warehouse,
    However, if the user's hive metastore configuration is more complicated, such as authorization verification, etc., then the construction of HiveConf will become very complicated. We need to provide parameters for the user to accept information such as user permissions.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org