[I] [Bug] Batch increment query has empty result when overwrite [incubator-paimon]

["Pandas886 (via GitHub)" <gi...@apache.org>]

Pandas886 opened a new issue, #2803:
URL: https://github.com/apache/incubator-paimon/issues/2803

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.
   
   
   ### Paimon version
   
   0.7
   
   ### Compute Engine
   
   flink1.17
   
   ### Minimal reproduce step
   
   when i batch insert overwrite paimon table , i can not use  Batch increment query for any result.
   
   ```
   CREATE TABLE  if not EXISTS use_be_hours_2 (
       user_id BIGINT,
       item_id BIGINT,
       behavior STRING,
       dt STRING,
       hh STRING,
       PRIMARY KEY (user_id) NOT ENFORCED
   ) 
   with (
     'manifest.format'='orc',
     'changelog-producer' = 'input'
   );
   
   
   INSERT INTO use_be_hours_2
   VALUES
       (1, 1, 'watch', '2022-01-01', '10'),
       (2, 2, 'like', '2022-01-01', '10');
   
   
   INSERT OVERWRITE use_be_hours_2
   VALUES
       (1, 100, 'watch', '2022-01-01', '10'),
       (3, 100, 'like', '2022-01-01', '10');
   
   INSERT OVERWRITE use_be_hours_2
   VALUES
       (1, 200, 'watch', '2022-01-01', '10'),
       (3, 200, 'like', '2022-01-01', '10'),
       (4, 200, 'like', '2022-01-01', '10')
       ;
   ```
   my query:
   ```
     SELECT * FROM use_be_hours_2 /*+ OPTIONS('incremental-between' = '1,3') */;
   
   SELECT * FROM use_be_hours_2$audit_log  /*+ OPTIONS('incremental-between' = '1,3')  */;
   ```
   
   the result above both are empty , is it normal ?
   
   ### What doesn't meet your expectations?
   
   the result above both are empty , is it normal ?
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Bug] Batch increment query has empty result when overwrite [incubator-paimon]

["BeiWeiDeDengDai (via GitHub)" <gi...@apache.org>]

BeiWeiDeDengDai commented on issue #2803:
URL: https://github.com/apache/incubator-paimon/issues/2803#issuecomment-1968612340

   The above issue does indeed have this situation, as it was judged as overwrite and returned empty splits directly. There is no problem with Flink real-time insertion and batch insert into select xx insertion.Insert into values is suitable for test learning, which does not affect the production environment


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org