You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/12/21 07:19:16 UTC
[GitHub] [hudi] kingkongpoon edited a comment on issue #2345: the option PRECOMBINE_FIELD_OPT_KEY is useless
kingkongpoon edited a comment on issue #2345:
URL: https://github.com/apache/hudi/issues/2345#issuecomment-748735726
@bvaradar : Thanks .When I change my data in 2.csv ,that a single batch records are all uuid = 1, ts and value are different.
+----+-------------+---+----+----+
|uuid|partitionpath| ts| _c3| _c4|
+----+-------------+---+----+----+
| 1| 2| 2|tttt|tttt|
| 1| 2| 3| aa| aa|
| 1| 2| 4| bb| bb|
| 1| 2| 10| dd| dd|
+----+-------------+---+----+----+
Then the result become
+-------------------+--------------------+------------------+----------------------+--------------------+----+-------------+---+---+---+
|_hoodie_commit_time|_hoodie_commit_seqno|_hoodie_record_key|_hoodie_partition_path| _hoodie_file_name|uuid|partitionpath| ts|_c3|_c4|
+-------------------+--------------------+------------------+----------------------+--------------------+----+-------------+---+---+---+
| 20201218181256| 20201218181256_1_2| 2| 2|12dbad9a-a443-45c...| 2| 2| 1| c| c|
| 20201218181256| 20201218181256_2_3| 4| 5|825dbdc3-1ea6-4d8...| 4| 5| 1|bab|bab|
| 20201218181256| 20201218181256_3_4| 7| 8|77be93a5-3ee5-43a...| 7| 8| 1|bab|bab|
| 20201221095641| 20201221095641_0_1| 1| 2|8d8a6498-116f-4f7...| 1| 2| 4| bb| bb|
+-------------------+--------------------+------------------+----------------------+--------------------+----+-------------+---+---+---+
the data which uuid = 1 and ts = 4, I think that if two record compare with it's timestamp , the record which _hoodie_commit_seqno = 20201221095641_0_1 , maybe is | 1| 2| 10| dd| dd| ,but now is | 1| 2| 4| bb| bb|
if compare the data by it's timestamp ,the Object.compareTo(..) maybe can compare by their numberic class
And my hudi table class is MOR_TABLE_TYPE_OPT_VAL , I think it work like hbase , which timestamp is bigger, then I can read that record ???
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org