You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/04/21 09:46:00 UTC
[jira] [Work logged] (HIVE-26161) Use Hive's ORC dependency version when producing file footer for Iceberg
[ https://issues.apache.org/jira/browse/HIVE-26161?focusedWorklogId=759897&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-759897 ]
ASF GitHub Bot logged work on HIVE-26161:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 21/Apr/22 09:45
Start Date: 21/Apr/22 09:45
Worklog Time Spent: 10m
Work Description: szlta opened a new pull request, #3230:
URL: https://github.com/apache/hive/pull/3230
For schema evolution and projection purposes we produce an ORC file footer byte buffer in VectorizedReadUtils.
Currently Iceberg's bundled/shaded ORC is used to produce these file footer bytes when dealing with Iceberg/ORC tables. This version of ORC is newer (1.7.3) than what Hive uses (1.6.9).
Later on we could face compatibility issues when trying to reconstruct an OrcTail object with a 1.6.9 reader from the bytes that the 1.7.3 reader serialized. We need to invert the direction as we can rely more on backward compatibility than on forward compatibility of ORC.
Issue Time Tracking
-------------------
Worklog Id: (was: 759897)
Remaining Estimate: 0h
Time Spent: 10m
> Use Hive's ORC dependency version when producing file footer for Iceberg
> ------------------------------------------------------------------------
>
> Key: HIVE-26161
> URL: https://issues.apache.org/jira/browse/HIVE-26161
> Project: Hive
> Issue Type: Bug
> Reporter: Ádám Szita
> Assignee: Ádám Szita
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> For schema evolution and projection purposes we produce an ORC file footer byte buffer in VectorizedReadUtils.
> Currently Iceberg's bundled/shaded ORC is used to produce these file footer bytes when dealing with Iceberg/ORC tables. This version of ORC is newer (1.7.3) than what Hive uses (1.6.9).
> Later on we could face compatibility issues when trying to reconstruct an OrcTail object with a 1.6.9 reader from the bytes that the 1.7.3 reader serialized. We need to invert the direction as we can rely more on backward compatibility than on forward compatibility of ORC.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)