You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Jonathan Vexler (Jira)" <ji...@apache.org> on 2025/07/18 17:16:00 UTC
[jira] [Created] (HUDI-9603) Flink 1.18 array values incorrect in fg reader test
Jonathan Vexler created HUDI-9603:
-------------------------------------
Summary: Flink 1.18 array values incorrect in fg reader test
Key: HUDI-9603
URL: https://issues.apache.org/jira/browse/HUDI-9603
Project: Apache Hudi
Issue Type: Bug
Components: flink, reader-core
Affects Versions: 1.0.2
Reporter: Jonathan Vexler
{code:java}
<{"timestamp": 0, "_row_key": "30f916be-06d6-4ef3-a9fb-9dddc40e8abd", "partition_path": "any_partition", "trip_type": "BLACK", "rider": "rider-001", "driver": "driver-001", "begin_lat": 0.7585664392201925, "begin_lon": 0.37789349980839115, "end_lat": 0.7757098794857531, "end_lon": 0.1730947142293684, "distance_in_meters": 1356260410, "seconds_since_epoch": -9002173267385180332, "weight": 0.9950906, "nation": "Canada", "current_date": 13, "current_ts": 1182257224, "height": [0, 0, 11, 121, -97], "city_to_state": {"LA": "CA"}, "fare": {"amount": 89.22144149794701, "currency": "USD"}, "tip_history": [{"amount": 78.67847272460095, "currency": "USD"}], "customField0": 1299566198, "customField1": 5724776041695989483, "customField2": 0.7481167, "customField3": 0.2553663812411848, "customField4": "25db73af-fdf9-4e04-b47d-ce44882bf362", "customField5": "877c2613-f2a1-4afd-af4a-863814dec38b", "_hoodie_is_deleted": false}> <{"timestamp": 0, "_row_key": "30f916be-06d6-4ef3-a9fb-9dddc40e8abd", "partition_path": "any_partition", "trip_type": "BLACK", "rider": "rider-001", "driver": "driver-001", "begin_lat": 0.7585664392201925, "begin_lon": 0.37789349980839115, "end_lat": 0.7757098794857531, "end_lon": 0.1730947142293684, "distance_in_meters": 1356260410, "seconds_since_epoch": -9002173267385180332, "weight": 0.9950906, "nation": "Canada", "current_date": 13, "current_ts": 1182257224, "height": [0, 0, 11, 121, -97], "city_to_state": {"LA": "CA"}, "fare": {"amount": 89.22144149794701, "currency": "USD"}, "tip_history": [{"amount": 4.5791476348245315, "currency": "USD"}], "customField0": 1299566198, "customField1": 5724776041695989483, "customField2": 0.7481167, "customField3": 0.2553663812411848, "customField4": "25db73af-fdf9-4e04-b47d-ce44882bf362", "customField5": "877c2613-f2a1-4afd-af4a-863814dec38b", "_hoodie_is_deleted": false}>
{code}
every field is the same except for the tip_history. This only happens on Flink 1.18 and not 1.20. I added a config to HoodieTestDataGenerator.SchemaEvolutionConfigs that can be enabled to expose this issue. I have marked it as a TODO in the code
--
This message was sent by Atlassian Jira
(v8.20.10#820010)