You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iceberg.apache.org by Kyle B <kj...@gmail.com> on 2021/08/02 04:30:58 UTC

Re: Orc deletes

Hi Peter,

I have been slowly getting somewhat more involved in the ORC + Iceberg integration.

Can we make an issue to track what we know is missing or needs to be done?

I’d be happy to help with any tasks I can as it seems important to keep up compatibility.

- Kyle Bendickson, @kbendick

> On Jul 25, 2021, at 9:59 PM, Peter Vary <pv...@cloudera.com.invalid> wrote:
> 
> 
> Hi Team,
> 
> I see plenty of ongoing work for Parquet and Avro deletes. Is there a particular reason why the ORC deletes are left out?
> We just miss the resources to work on it as well, or there are some known roadblocks we have already identified and have to remove them from the ORC side first?
> 
> Thanks, Peter

Re: Orc deletes

Posted by Peter Vary <pv...@cloudera.com.INVALID>.
May I get review for this first step: 
https://github.com/apache/iceberg/pull/2935 <https://github.com/apache/iceberg/pull/2935>

Thanks,
Peter

> On Aug 2, 2021, at 12:42, Peter Vary <pv...@cloudera.com> wrote:
> 
> Created https://github.com/apache/iceberg/issues/2914 <https://github.com/apache/iceberg/issues/2914> so we can track the missing parts.
> Tried to collect the things I have seen, but any help would be good.
> 
> Thanks,
> Peter
> 
>> On Aug 2, 2021, at 07:28, Anton Okolnychyi <aokolnychyi@apple.com.INVALID <ma...@apple.com.INVALID>> wrote:
>> 
>> No blockers I am aware of.
>> 
>> - Anton
>> 
>>> On 1 Aug 2021, at 21:30, Kyle B <kjbendickson@gmail.com <ma...@gmail.com>> wrote:
>>> 
>>> Hi Peter,
>>> 
>>> I have been slowly getting somewhat more involved in the ORC + Iceberg integration.
>>> 
>>> Can we make an issue to track what we know is missing or needs to be done?
>>> 
>>> I’d be happy to help with any tasks I can as it seems important to keep up compatibility.
>>> 
>>> - Kyle Bendickson, @kbendick
>>> 
>>>> On Jul 25, 2021, at 9:59 PM, Peter Vary <pvary@cloudera.com.invalid <ma...@cloudera.com.invalid>> wrote:
>>>> 
>>>> 
>>>> Hi Team,
>>>> 
>>>> I see plenty of ongoing work for Parquet and Avro deletes. Is there a particular reason why the ORC deletes are left out?
>>>> We just miss the resources to work on it as well, or there are some known roadblocks we have already identified and have to remove them from the ORC side first?
>>>> 
>>>> Thanks, Peter 
>> 
>

Re: Orc deletes

Posted by Peter Vary <pv...@cloudera.com.INVALID>.
Created https://github.com/apache/iceberg/issues/2914 <https://github.com/apache/iceberg/issues/2914> so we can track the missing parts.
Tried to collect the things I have seen, but any help would be good.

Thanks,
Peter

> On Aug 2, 2021, at 07:28, Anton Okolnychyi <ao...@apple.com.INVALID> wrote:
> 
> No blockers I am aware of.
> 
> - Anton
> 
>> On 1 Aug 2021, at 21:30, Kyle B <kj...@gmail.com> wrote:
>> 
>> Hi Peter,
>> 
>> I have been slowly getting somewhat more involved in the ORC + Iceberg integration.
>> 
>> Can we make an issue to track what we know is missing or needs to be done?
>> 
>> I’d be happy to help with any tasks I can as it seems important to keep up compatibility.
>> 
>> - Kyle Bendickson, @kbendick
>> 
>>> On Jul 25, 2021, at 9:59 PM, Peter Vary <pv...@cloudera.com.invalid> wrote:
>>> 
>>> 
>>> Hi Team,
>>> 
>>> I see plenty of ongoing work for Parquet and Avro deletes. Is there a particular reason why the ORC deletes are left out?
>>> We just miss the resources to work on it as well, or there are some known roadblocks we have already identified and have to remove them from the ORC side first?
>>> 
>>> Thanks, Peter 
>

Re: Orc deletes

Posted by Anton Okolnychyi <ao...@apple.com.INVALID>.
No blockers I am aware of.

- Anton

> On 1 Aug 2021, at 21:30, Kyle B <kj...@gmail.com> wrote:
> 
> Hi Peter,
> 
> I have been slowly getting somewhat more involved in the ORC + Iceberg integration.
> 
> Can we make an issue to track what we know is missing or needs to be done?
> 
> I’d be happy to help with any tasks I can as it seems important to keep up compatibility.
> 
> - Kyle Bendickson, @kbendick
> 
>> On Jul 25, 2021, at 9:59 PM, Peter Vary <pv...@cloudera.com.invalid> wrote:
>> 
>> 
>> Hi Team,
>> 
>> I see plenty of ongoing work for Parquet and Avro deletes. Is there a particular reason why the ORC deletes are left out?
>> We just miss the resources to work on it as well, or there are some known roadblocks we have already identified and have to remove them from the ORC side first?
>> 
>> Thanks, Peter