You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/05/24 07:45:29 UTC

[GitHub] [hudi] rmpifer commented on pull request #2190: [HUDI-892] RealtimeParquetInputFormat skip adding projection columns if there are no log files

rmpifer commented on pull request #2190:
URL: https://github.com/apache/hudi/pull/2190#issuecomment-846843202


   Can we re-open this and potentially revert or find another way to accomplish? This change is causing frequent failures in Hive real time queries. Let me give scenario:
   1. First split being read by worker contains no delta log files so no Hudi projection columns needed are set and `HOODIE_READ_COLUMNS_PROP` is set so no further changes to job configuration by Hudi.
   2. Any subsequent split read by same worker which DOES contain log files will cause query failure as required projection columns never get set


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org