You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/04/28 05:48:14 UTC

[GitHub] [incubator-hudi] afilipchik commented on pull request #1566: [HUDI-603]: DeltaStreamer can now fetch schema before every run in continuous mode

afilipchik commented on pull request #1566:
URL: https://github.com/apache/incubator-hudi/pull/1566#issuecomment-620394679


   I think it is not enough. Example: when consuming from kafka, schema might change midway. Example: we are reading 10000 messages, schema will be fetched on start. Starting from 9000 message new column is added, but we will not see it. As a result we just lost data. 
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org