You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Marton Bod (Jira)" <ji...@apache.org> on 2022/04/21 07:34:00 UTC

[jira] [Commented] (HIVE-26156) Iceberg delete writer should handle deleting from old partition specs

    [ https://issues.apache.org/jira/browse/HIVE-26156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525478#comment-17525478 ] 

Marton Bod commented on HIVE-26156:
-----------------------------------

Pushed to master. Thanks [~szita] for the review!

> Iceberg delete writer should handle deleting from old partition specs
> ---------------------------------------------------------------------
>
>                 Key: HIVE-26156
>                 URL: https://issues.apache.org/jira/browse/HIVE-26156
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> While {{HiveIcebergRecordWriter}} always writes data out according to the latest spec, the {{HiveIcebergDeleteWriter}} might have to write delete files into partitions that correspond to a variety of specs, both old and new. Therefore we should pass the {{{}table.specs(){}}}map into the {{HiveIcebergWriter}} so that the delete writer can choose the appropriate spec on a per-record basis.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)