You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "ann (Jira)" <ji...@apache.org> on 2021/02/02 11:11:00 UTC

[jira] [Created] (HUDI-1573) Spark Sql Writer support Multi preCmp Field

ann created HUDI-1573:
-------------------------

             Summary: Spark Sql Writer support Multi preCmp Field
                 Key: HUDI-1573
                 URL: https://issues.apache.org/jira/browse/HUDI-1573
             Project: Apache Hudi
          Issue Type: Improvement
          Components: Common Core
            Reporter: ann


HoodieSparkSqlWriter has a param PRECOMBINE_FIELD_OPT_KEY , which specify a nested field.

Now, support getMultiNestedFieldVal process. If PRECOMBINE_FIELD_OPT_KEY has seperator ',' ,  thus multi nested fields to be compared , to solve duplicated input records before tag.

Example : `timestamp`, `gtid` in  binlog source .



--
This message was sent by Atlassian Jira
(v8.3.4#803005)