[jira] [Comment Edited] (FLINK-27384) In the Hive dimension table, when the data is changed on the original partition, the create_time configuration does not take effect

["Leonard Xu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-27384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17572727#comment-17572727 ] 

Leonard Xu edited comment on FLINK-27384 at 10/12/22 8:40 AM:
--------------------------------------------------------------

Fixed in 
master(1.16): d97b94d4b723aaa403f5849ceaa76f59f4dd3b5a
release-1.15: bcff5af0b5fa8a4e21913329ad8e182bedf228ad
release-1.14: 824d341255a4b6f26d6ca55566710bceb248a14b


was (Author: leonard xu):
Fixed in 
master(1.16): d97b94d4b723aaa403f5849ceaa76f59f4dd3b5a
release-1.15:TODO
release-1.14:TODO

> In the Hive dimension table, when the data is changed on the original partition, the create_time configuration does not take effect
> -----------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-27384
>                 URL: https://issues.apache.org/jira/browse/FLINK-27384
>             Project: Flink
>          Issue Type: Bug
>          Components: Connectors / Hive
>    Affects Versions: 1.14.4, 1.15.1
>            Reporter: 陈磊
>            Assignee: 陈磊
>            Priority: Major
>              Labels: pull-request-available, stale-assigned
>         Attachments: image-2022-04-25-15-46-01-833.png, image-2022-04-25-15-47-54-213.png
>
>
> In the Hive dimension table, when the data is changed on the original partition, the create_time configuration does not take effect.
> !image-2022-04-25-15-46-01-833.png!
> The current table structure directory is as follows:
> !image-2022-04-25-15-47-54-213.png!
> From the above figure, we can know that when hive is a dimension table, it will load the data of dt=2021-04-22, hr=27.
> If a new partition arrives now, the data of the latest partition can be read smoothly. However, if the data is modified on the original partition, theoretically, the data of the modified partition is read, because of the create_time and latest configuration, but this is not the case in practice. The data that was originally loaded is still read.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)