[GitHub] [iceberg] omarsmak commented on issue #3041: Issue on Hive orc vectorisation

[GitBox <gi...@apache.org>]

omarsmak commented on issue #3041:
URL: https://github.com/apache/iceberg/issues/3041#issuecomment-921917532


   I also spent sometime on this issue trying to find a good solution for it, as @tprelle mentioned, the issue is that compiled class `HiveVectorizedReader` refers to the shaded `org.apache.iceberg.shaded.org.apache.orc.OrcTail` instead of `org.apache.orc.OrcTail` which triggers the above error. Some ways I thought about going around this issue?
   
   - From Gradle, after relocating `org.apache.orc` to `org.apache.iceberg.shaded.org.apache.orc.OrcTail`, modify the class `HiveVectorizedReader` to let it point back to `org.apache.orc.OrcTail` instead of `org.apache.iceberg.shaded.org.apache.orc.OrcTail`.
   - Copy the `OrcSplit` class from Hive source code and in gradle, relocate it to the shaded folder in order to avoid any conflicts with Hive libraries. This should work but I am not convinced to copy things as it may give maintenance overhead.  
   - Shade the whole `org.apache.hadoop.hive.ql.io.orc` under `org.apache.iceberg.shaded.org.apache.hadoop.hive.ql.io.orc`.
   
   Any other ideas @szlta as as I can see you were the original author of this PR: https://github.com/apache/iceberg/pull/2613 ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org