[jira] [Created] (HUDI-3887) Spark query can not read the data changes which written by flink after the spark query connection created

["chacha.tang (Jira)" <ji...@apache.org>]

chacha.tang created HUDI-3887:
---------------------------------

             Summary: Spark query can not read the data changes which written by flink after the spark query connection created
                 Key: HUDI-3887
                 URL: https://issues.apache.org/jira/browse/HUDI-3887
             Project: Apache Hudi
          Issue Type: Bug
          Components: spark
            Reporter: chacha.tang


Enviroment:

hudi version: 0.10.1

flink version: 13.2

spark version: 3.1.2

 

Spark query can not read the data changes which written by flink after the spark query connection created。

For example:

step1: use flink hudi job write table

INSERT INTO t1 VALUES ('id1','Danny',20,TIMESTAMP '1970-01-01 00:00:01','par1');

step2: create the spark jdbc connection to query the data，in this time data can be query correctly

step3: change the age property to write the data again。

INSERT INTO t1 VALUES ('id1','Danny',27,TIMESTAMP '1970-01-01 00:00:01','par1');

step4: use the spark jdbc connection which created in step2 to query data，and found there is no change happened。

step5:create a new spark jdbc connection to query the data, then the result is correct



--
This message was sent by Atlassian Jira
(v8.20.1#820001)