You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Ruguo Yu (Jira)" <ji...@apache.org> on 2022/04/22 16:29:00 UTC

[jira] [Updated] (HUDI-3946) Validate option path in flink hudi sink

     [ https://issues.apache.org/jira/browse/HUDI-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ruguo Yu updated HUDI-3946:
---------------------------
    Summary: Validate option path in flink hudi sink  (was: Validate option path in hudi sink)

> Validate option path in flink hudi sink
> ---------------------------------------
>
>                 Key: HUDI-3946
>                 URL: https://issues.apache.org/jira/browse/HUDI-3946
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: flink
>            Reporter: Ruguo Yu
>            Priority: Minor
>             Fix For: 0.11.0, 0.11.1
>
>
> We should do a non-null check on option 'path' in hudi sink so that flink can expose the 'path' problem as early as possible, instead of throwing the following at runtime.
> {code:java}
> CREATE TABLE t1(
>   uuid VARCHAR(20) PRIMARY KEY NOT ENFORCED,
>   name VARCHAR(10),
>   age INT,
>   ts TIMESTAMP(3),
>   `partition` VARCHAR(20)
> )
> PARTITIONED BY (`partition`)
> WITH (
>   'connector' = 'hudi',
>   'path' = '${path}'
> );
> INSERT INTO t1 VALUES
>   ('id1','Danny',23,TIMESTAMP '1970-01-01 00:00:01','par1'),
>   ('id2','Stephen',33,TIMESTAMP '1970-01-01 00:00:02','par1'),
>   ('id3','Julian',53,TIMESTAMP '1970-01-01 00:00:03','par2'),
>   ('id4','Fabian',31,TIMESTAMP '1970-01-01 00:00:04','par2'),
>   ('id5','Sophia',18,TIMESTAMP '1970-01-01 00:00:05','par3'),
>   ('id6','Emma',20,TIMESTAMP '1970-01-01 00:00:06','par3'),
>   ('id7','Bob',44,TIMESTAMP '1970-01-01 00:00:07','par4'),
>   ('id8','Han',56,TIMESTAMP '1970-01-01 00:00:08','par4'); {code}
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)