You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/04/28 15:01:07 UTC

[GitHub] [incubator-hudi] pratyakshsharma commented on pull request #1566: [HUDI-603]: DeltaStreamer can now fetch schema before every run in continuous mode

pratyakshsharma commented on pull request #1566:
URL: https://github.com/apache/incubator-hudi/pull/1566#issuecomment-620661941


   > I think it is not enough. Example: when consuming from kafka, schema might change midway. Example: we are reading 10000 messages, schema will be fetched on start. Starting from 9000 message new column is added, but we will not see it. As a result we just lost data.
   
   Yeah true. that was not the purpose of this PR but I guess I should include it as well :)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org