You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/04/26 03:01:33 UTC

[GitHub] [hudi] YuangZhang opened a new issue, #5431: [SUPPORT] Flink Date type as partition field

YuangZhang opened a new issue, #5431:
URL: https://github.com/apache/hudi/issues/5431

   flink sql can't use date as partition field 
   `create TABLE hudi_sink(
       role_id string,
       log_id string,
       origin_json string,
       origin_log string,
       ts timestamp(3),
       ds date
    )PARTITIONED BY (ds)
    with (
      'connector' = 'hudi'
       ...
   `
   throw org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for partition field: java.time.LocalDate


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 commented on issue #5431: [SUPPORT] Flink Date type as partition field

Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5431:
URL: https://github.com/apache/hudi/issues/5431#issuecomment-1110468886

   Already created a PR here: https://github.com/apache/hudi/pull/5432


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] onlywangyh commented on issue #5431: [SUPPORT] Flink Date type as partition field

Posted by GitBox <gi...@apache.org>.
onlywangyh commented on issue #5431:
URL: https://github.com/apache/hudi/issues/5431#issuecomment-1110445452

   You need use the [TimestampBasedKeyGenerator](https://github.com/apache/hudi/blob/master/hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/TimestampBasedKeyGenerator.java). This key generator relies on timestamps for the partition field. The field values are interpreted as timestamps and not just converted to string while generating partition path value for records


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] YuangZhang commented on issue #5431: [SUPPORT] Flink Date type as partition field

Posted by GitBox <gi...@apache.org>.
YuangZhang commented on issue #5431:
URL: https://github.com/apache/hudi/issues/5431#issuecomment-1111785202

   > @YuangZhang could you provide the steps with the environment for reproducing the issue, e.g., which Hudi and Flink versions are used, which file system is used for the target Hudi table, etc.?
   
   hudi version 0.11.0 build from release-0.11.0 
   flink version 1.13.5
   the file system is hdfs


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua commented on issue #5431: [SUPPORT] Flink Date type as partition field

Posted by GitBox <gi...@apache.org>.
yihua commented on issue #5431:
URL: https://github.com/apache/hudi/issues/5431#issuecomment-1110206270

   @YuangZhang could you provide the steps with the environment for reproducing the issue, e.g., which Flink version is used, which file system is used for the target Hudi table, etc.?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] yihua commented on issue #5431: [SUPPORT] Flink Date type as partition field

Posted by GitBox <gi...@apache.org>.
yihua commented on issue #5431:
URL: https://github.com/apache/hudi/issues/5431#issuecomment-1110204336

   @danny0405 could you help triage the issue?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] danny0405 closed issue #5431: [SUPPORT] Flink Date type as partition field

Posted by GitBox <gi...@apache.org>.
danny0405 closed issue #5431: [SUPPORT] Flink Date type as partition field
URL: https://github.com/apache/hudi/issues/5431


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org