Re: [I] [Bug] doris默认值列存在时间差问题 [doris-flink-connector]

["YS0mind (via GitHub)" <gi...@apache.org>]

YS0mind commented on issue #191:
URL: https://github.com/apache/doris-flink-connector/issues/191#issuecomment-1905753329

   I also find this problem when I load data into Doris.
   
   1. Create table in doris to test like this:
   ```sql
   create table data_province
   (
       `run_date`         date           not null comment '日期',
       data_type_id       int            not null comment '数据类型',
       data               decimal(24, 8) not null comment '数据值',
       create_time        datetime       not null default current_timestamp comment '创建时间'
   )
       engine = olap unique key(`run_date`,`data_type_id`)
       comment "分日数据表"
       partition by range(`run_date`) ( )
       distributed by hash(`data_type_id`) buckets 10
       properties (
           "storage_format" = "V2",
           "enable_unique_key_merge_on_write" = "true",
           "dynamic_partition.enable" = "true",
           "dynamic_partition.time_unit" = "month",
           "dynamic_partition.create_history_partition" = "true",
           "dynamic_partition.history_partition_num" = "10",
           "dynamic_partition.start" = "-6",
           "dynamic_partition.end" = "3",
           "dynamic_partition.prefix" = "p",
           "dynamic_partition.replication_num" = "1",
           "dynamic_partition.buckets" = "10"
       );
   ```
   
   2. Insert data by stream load like this,and you can find that field "create_time" is the time you create table,however,when I try insert data by  insert-into method,everything is ok,the field "create_time" is the time I insert record.
   ```shell
   # stream load导入 默认的时间固定为建表时间,insert into方式则会是正常的插入记录的时间
   # vim /tmp/test.csv
   # 2024-01-01,1,67200.00000000
   curl --location-trusted -u root \
   -H "partial_columns:true" \
   -H "column_separator:," \
   -H "columns:run_date,data_type_id,data" \
   -H "two_phase_commit:false" \
   -H "label:stream_load_test01" \
   -T /tmp/test.csv http://127.0.0.1:8030/api/iotest/data_province/_stream_load
   ```
   
   3. If I import by specifying  `-H "columns: current_timestamp()"`,the field "create_time" is the time I insert record,but when I insert new record with the same key field,this filed will change.I just want to save the time I create this record.
   ```shell
   # 部分列导入可以生成正确的默认时间，但每一次相同key的记录导入会把
   # create_time也覆盖成最新的时间
   curl --location-trusted -u root \
   -H "partial_columns:true" \
   -H "column_separator:," \
   -H "columns:run_date,data_type_id,data,create_time=current_timestamp()" \
   -H "two_phase_commit:false" \
   -H "label:stream_load_test02" \
   -T /tmp/test.csv http://127.0.0.1:8030/api/iotest/dwd_rd_data_province/_stream_load
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org