[GitHub] [iceberg] pvary commented on pull request #1417: Hive: Add column projection

[GitBox <gi...@apache.org>]

pvary commented on pull request #1417:
URL: https://github.com/apache/iceberg/pull/1417#issuecomment-696382951


   > Hey @guilload, have you had any luck with solutions for problems with the SerDe? Also pinging @pvary to ask if you have any suggestions for a fix for the problem raised [here](https://github.com/apache/iceberg/pull/1417#issuecomment-686830961)?
   
   I have checked the TestInputOutputFormat.testInOutFormat test case in Hive, where we test the ORC column projection:
   https://github.com/apache/hive/blob/f9d6e84143261c55442ef723197f5b55efb80633/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java#L1890
   
   Basically ORC returns the full record structure. The fields which are not requested are null:
   ```
   OrctStruct {1, null}
   ```
   
   Based on this I would assume that we should wrap the row returned by Iceberg to a Record which has the original full schema and returns the values for the columns we have value, and returns null for non-projected columns.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org