[GitHub] [iceberg] zhangjun0x01 commented on pull request #1558: load hive-site.xml for flink catalog

[GitBox <gi...@apache.org>]

zhangjun0x01 commented on pull request #1558:
URL: https://github.com/apache/iceberg/pull/1558#issuecomment-705916509


   > @zhangjun0x01, @JingsongLi, how does Flink normally handle hive-site.xml files? This seems strange to me, so I'd like to understand if this is something that Flink would normally do.
   
   hi,@rdblue:
      As far as I know, flink provides a hiveConfDir to get hive-site.xml, it is indeed no problem before flink 1.11, but flink 1.11 provides an application mode to submit flink  job, in this case, the user jar is parsed  in the jobmanager node of flink, but this jobmanager node is very likely to have no hive-site.xml file. If we provide a local path to get hive-site.xml, the program will not find it in application mode , so I thought of a way to be compatible with flink's various submission modes . We provide a local or hdfs path to get hive-site.xml.I described possible problems in the https://github.com/apache/iceberg/issues/1437
   
    I think this should also be a issue with flink. What do you think?@JingsongLi


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org