You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "jackylau (Jira)" <ji...@apache.org> on 2019/09/27 08:31:00 UTC

[jira] [Created] (FLINK-14243) flink hiveudf need some check whether it is using cache

jackylau created FLINK-14243:
--------------------------------

             Summary: flink hiveudf need some check whether it is using cache
                 Key: FLINK-14243
                 URL: https://issues.apache.org/jira/browse/FLINK-14243
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Hive
    Affects Versions: 1.9.0
            Reporter: jackylau
             Fix For: 1.10.0


Flink1.9 bring in hive connector, but it will have some problem when the original hive udf using cache. We konw that hive is  processed level parallel based on jvm, while flink/spark is task level parallel. If flink just calls the hive udf, it wll exists thread-safe problem when using cache.

So it may need check the hive udf code and if it is not thread-fase, and set the flink parallize=1



--
This message was sent by Atlassian Jira
(v8.3.4#803005)