You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/23 17:44:47 UTC

[GitHub] [hudi] guanziyue edited a comment on issue #2648: [SUPPORT] a NPE error when reading MOR table in spark datasource

guanziyue edited a comment on issue #2648:
URL: https://github.com/apache/hudi/issues/2648#issuecomment-846419072


   @nsivabalan @n3nash  Actually this problem is not totally equivalent to the issue 2633. Just like I mentioned before, the method buildFileIndex in MergeOnReadSnapshotRelation assume all file group must have a base file. Even though issue 2633 is fixed, an index with canLogIndexFile will still generate file group w/o base file. I think the logic in MergeOnReadSnapshotRelation may have a small fix. Method groupLogsByBaseFile of HoodieRealtimeInputFormatUtils may group logs by fileID rather than Base file. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org