[GitHub] [hudi] mincwang edited a comment on pull request #3703: [HUDI-2480] FileSlice after pending compaction-requested instant-time…

[GitBox <gi...@apache.org>]

mincwang edited a comment on pull request #3703:
URL: https://github.com/apache/hudi/pull/3703#issuecomment-971599052


   > > Hi，everyone，I have used this patch, i used flink sql execute batch query and the results were as expected , but spark-sql still lost data when querying rt table. I want it can as release blocker.
   > 
   > Hi @mincwang , is that possible to reproduce the data lost in a unit test? Are you using hive rt view or Spark MOR relation?
   
   Thanks for @garyli1019  reply，I used the Spark MOR query, the Spark query loses data when the Flink streaming writes to HUDi and the compression scheduler is executed but the compression plan is not executed。
   ```sql
   -- FLINK SQL  with clause DDL
     'compaction.schedule.enabled' = 'true',
      'compaction.async.enabled' = 'false',                    
   --    'compaction.trigger.strategy' = 'time_elapsed',
   --   'compaction.delta_seconds' = '3600'  
   ```
   
   Hi @danny0405 ，Can you give we a more professional reply?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org