[GitHub] [hudi] nsivabalan edited a comment on issue #3603: [SUPPORT] delta streamer Failed to archive commits

[GitBox <gi...@apache.org>]

nsivabalan edited a comment on issue #3603:
URL: https://github.com/apache/hudi/issues/3603#issuecomment-931267143


   I do see from [code](https://github.com/apache/hudi/blob/47ed91799943271f219419cf209793a98b3f09b5/hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/DeltaSync.java#L506) that we do add entry to extra metadata as below
   ```
   HashMap<String, String> checkpointCommitMetadata = new HashMap<>();
         checkpointCommitMetadata.put(CHECKPOINT_KEY, checkpointStr);
         if (cfg.checkpoint != null) {
           checkpointCommitMetadata.put(CHECKPOINT_RESET_KEY, cfg.checkpoint);
         }
   ```
   
   So, entire map is not null for sure. Can you enable logs and see whats the checkpointStr after reading from source. may be its null w/ SqlSource in this case. 
   Also, have you set --commit-on-errors config in deltastreamer by any chance? 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org