You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by László Bodor <bo...@gmail.com> on 2024/06/28 07:55:30 UTC
[DISCUSS] Tez 0.10.4 Release Planning
Hi Everyone!
(I included the Hive dev list for visibility.)
Even though only a few months have passed since the last Tez release, it's
already time for a new one.
1. tez client changes that are needed for hive:
TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for Hive
iceberg stability HIVE-28165
<https://issues.apache.org/jira/browse/HIVE-28165>)
TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
Hive query history HIVE-28095
<https://issues.apache.org/jira/browse/HIVE-28095>)
TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
Hive query history HIVE-28095
<https://issues.apache.org/jira/browse/HIVE-28095>)
2. CVE fixes:
TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
3. miscellaneous fixes
TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
package usability
Let me know if you're aware of any Tez fixes in the finish line that should
make it to 0.10.4.
Regards,
Laszlo Bodor
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by Denys Kuzmenko <dk...@apache.org>.
Thanks, Laszlo!
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by László Bodor <bo...@gmail.com>.
Hi Team!
Given that Hive 4.0.1 needs a Tez release, I will prepare a 0.10.4 release
candidate soon. Updates are coming in a corresponding [VOTE] thread.
Regards,
Laszlo Bodor
László Bodor <bo...@gmail.com> ezt írta (időpont: 2024. jún. 29.,
Szo, 9:24):
> Thanks, Jonathan, I just commented on TEZ-4570
> <https://issues.apache.org/jira/browse/TEZ-4570>.
>
> Jonathan Eagles <je...@gmail.com> ezt írta (időpont: 2024. jún. 28., P,
> 17:18):
>
>> Data-via-events for ordered fetch
>> https://issues.apache.org/jira/browse/TEZ-4570
>>
>> This actually represents a very significant bug as Pig fetches unordered
>> output using ordered fetch. Now that data-via-events is now the default, it
>> means that Pig fails with Tez out of the box.
>>
>> Jonathan
>>
>> On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
>> wrote:
>>
>>> Hi Everyone!
>>>
>>> (I included the Hive dev list for visibility.)
>>> Even though only a few months have passed since the last Tez release,
>>> it's already time for a new one.
>>>
>>> 1. tez client changes that are needed for hive:
>>> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
>>> Hive iceberg stability HIVE-28165
>>> <https://issues.apache.org/jira/browse/HIVE-28165>)
>>> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
>>> Hive query history HIVE-28095
>>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
>>> Hive query history HIVE-28095
>>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>>
>>> 2. CVE fixes:
>>> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
>>> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
>>> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>>>
>>> 3. miscellaneous fixes
>>> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
>>> package usability
>>>
>>> Let me know if you're aware of any Tez fixes in the finish line that
>>> should make it to 0.10.4.
>>>
>>> Regards,
>>> Laszlo Bodor
>>>
>>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by László Bodor <bo...@gmail.com>.
Hi Team!
Given that Hive 4.0.1 needs a Tez release, I will prepare a 0.10.4 release
candidate soon. Updates are coming in a corresponding [VOTE] thread.
Regards,
Laszlo Bodor
László Bodor <bo...@gmail.com> ezt írta (időpont: 2024. jún. 29.,
Szo, 9:24):
> Thanks, Jonathan, I just commented on TEZ-4570
> <https://issues.apache.org/jira/browse/TEZ-4570>.
>
> Jonathan Eagles <je...@gmail.com> ezt írta (időpont: 2024. jún. 28., P,
> 17:18):
>
>> Data-via-events for ordered fetch
>> https://issues.apache.org/jira/browse/TEZ-4570
>>
>> This actually represents a very significant bug as Pig fetches unordered
>> output using ordered fetch. Now that data-via-events is now the default, it
>> means that Pig fails with Tez out of the box.
>>
>> Jonathan
>>
>> On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
>> wrote:
>>
>>> Hi Everyone!
>>>
>>> (I included the Hive dev list for visibility.)
>>> Even though only a few months have passed since the last Tez release,
>>> it's already time for a new one.
>>>
>>> 1. tez client changes that are needed for hive:
>>> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
>>> Hive iceberg stability HIVE-28165
>>> <https://issues.apache.org/jira/browse/HIVE-28165>)
>>> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
>>> Hive query history HIVE-28095
>>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
>>> Hive query history HIVE-28095
>>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>>
>>> 2. CVE fixes:
>>> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
>>> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
>>> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>>>
>>> 3. miscellaneous fixes
>>> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
>>> package usability
>>>
>>> Let me know if you're aware of any Tez fixes in the finish line that
>>> should make it to 0.10.4.
>>>
>>> Regards,
>>> Laszlo Bodor
>>>
>>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by László Bodor <bo...@gmail.com>.
Hi Team!
Given that Hive 4.0.1 needs a Tez release, I will prepare a 0.10.4 release
candidate soon. Updates are coming in a corresponding [VOTE] thread.
Regards,
Laszlo Bodor
László Bodor <bo...@gmail.com> ezt írta (időpont: 2024. jún. 29.,
Szo, 9:24):
> Thanks, Jonathan, I just commented on TEZ-4570
> <https://issues.apache.org/jira/browse/TEZ-4570>.
>
> Jonathan Eagles <je...@gmail.com> ezt írta (időpont: 2024. jún. 28., P,
> 17:18):
>
>> Data-via-events for ordered fetch
>> https://issues.apache.org/jira/browse/TEZ-4570
>>
>> This actually represents a very significant bug as Pig fetches unordered
>> output using ordered fetch. Now that data-via-events is now the default, it
>> means that Pig fails with Tez out of the box.
>>
>> Jonathan
>>
>> On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
>> wrote:
>>
>>> Hi Everyone!
>>>
>>> (I included the Hive dev list for visibility.)
>>> Even though only a few months have passed since the last Tez release,
>>> it's already time for a new one.
>>>
>>> 1. tez client changes that are needed for hive:
>>> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
>>> Hive iceberg stability HIVE-28165
>>> <https://issues.apache.org/jira/browse/HIVE-28165>)
>>> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
>>> Hive query history HIVE-28095
>>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
>>> Hive query history HIVE-28095
>>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>>
>>> 2. CVE fixes:
>>> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
>>> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
>>> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>>>
>>> 3. miscellaneous fixes
>>> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
>>> package usability
>>>
>>> Let me know if you're aware of any Tez fixes in the finish line that
>>> should make it to 0.10.4.
>>>
>>> Regards,
>>> Laszlo Bodor
>>>
>>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by László Bodor <bo...@gmail.com>.
Thanks, Jonathan, I just commented on TEZ-4570
<https://issues.apache.org/jira/browse/TEZ-4570>.
Jonathan Eagles <je...@gmail.com> ezt írta (időpont: 2024. jún. 28., P,
17:18):
> Data-via-events for ordered fetch
> https://issues.apache.org/jira/browse/TEZ-4570
>
> This actually represents a very significant bug as Pig fetches unordered
> output using ordered fetch. Now that data-via-events is now the default, it
> means that Pig fails with Tez out of the box.
>
> Jonathan
>
> On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
> wrote:
>
>> Hi Everyone!
>>
>> (I included the Hive dev list for visibility.)
>> Even though only a few months have passed since the last Tez release,
>> it's already time for a new one.
>>
>> 1. tez client changes that are needed for hive:
>> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
>> Hive iceberg stability HIVE-28165
>> <https://issues.apache.org/jira/browse/HIVE-28165>)
>> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
>> Hive query history HIVE-28095
>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
>> Hive query history HIVE-28095
>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>
>> 2. CVE fixes:
>> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
>> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
>> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>>
>> 3. miscellaneous fixes
>> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
>> package usability
>>
>> Let me know if you're aware of any Tez fixes in the finish line that
>> should make it to 0.10.4.
>>
>> Regards,
>> Laszlo Bodor
>>
>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by László Bodor <bo...@gmail.com>.
Thanks, Jonathan, I just commented on TEZ-4570
<https://issues.apache.org/jira/browse/TEZ-4570>.
Jonathan Eagles <je...@gmail.com> ezt írta (időpont: 2024. jún. 28., P,
17:18):
> Data-via-events for ordered fetch
> https://issues.apache.org/jira/browse/TEZ-4570
>
> This actually represents a very significant bug as Pig fetches unordered
> output using ordered fetch. Now that data-via-events is now the default, it
> means that Pig fails with Tez out of the box.
>
> Jonathan
>
> On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
> wrote:
>
>> Hi Everyone!
>>
>> (I included the Hive dev list for visibility.)
>> Even though only a few months have passed since the last Tez release,
>> it's already time for a new one.
>>
>> 1. tez client changes that are needed for hive:
>> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
>> Hive iceberg stability HIVE-28165
>> <https://issues.apache.org/jira/browse/HIVE-28165>)
>> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
>> Hive query history HIVE-28095
>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
>> Hive query history HIVE-28095
>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>
>> 2. CVE fixes:
>> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
>> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
>> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>>
>> 3. miscellaneous fixes
>> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
>> package usability
>>
>> Let me know if you're aware of any Tez fixes in the finish line that
>> should make it to 0.10.4.
>>
>> Regards,
>> Laszlo Bodor
>>
>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by László Bodor <bo...@gmail.com>.
Thanks, Jonathan, I just commented on TEZ-4570
<https://issues.apache.org/jira/browse/TEZ-4570>.
Jonathan Eagles <je...@gmail.com> ezt írta (időpont: 2024. jún. 28., P,
17:18):
> Data-via-events for ordered fetch
> https://issues.apache.org/jira/browse/TEZ-4570
>
> This actually represents a very significant bug as Pig fetches unordered
> output using ordered fetch. Now that data-via-events is now the default, it
> means that Pig fails with Tez out of the box.
>
> Jonathan
>
> On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
> wrote:
>
>> Hi Everyone!
>>
>> (I included the Hive dev list for visibility.)
>> Even though only a few months have passed since the last Tez release,
>> it's already time for a new one.
>>
>> 1. tez client changes that are needed for hive:
>> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
>> Hive iceberg stability HIVE-28165
>> <https://issues.apache.org/jira/browse/HIVE-28165>)
>> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
>> Hive query history HIVE-28095
>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
>> Hive query history HIVE-28095
>> <https://issues.apache.org/jira/browse/HIVE-28095>)
>>
>> 2. CVE fixes:
>> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
>> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
>> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>>
>> 3. miscellaneous fixes
>> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
>> package usability
>>
>> Let me know if you're aware of any Tez fixes in the finish line that
>> should make it to 0.10.4.
>>
>> Regards,
>> Laszlo Bodor
>>
>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by Jonathan Eagles <je...@gmail.com>.
Data-via-events for ordered fetch
https://issues.apache.org/jira/browse/TEZ-4570
This actually represents a very significant bug as Pig fetches unordered
output using ordered fetch. Now that data-via-events is now the default, it
means that Pig fails with Tez out of the box.
Jonathan
On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
wrote:
> Hi Everyone!
>
> (I included the Hive dev list for visibility.)
> Even though only a few months have passed since the last Tez release, it's
> already time for a new one.
>
> 1. tez client changes that are needed for hive:
> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
> Hive iceberg stability HIVE-28165
> <https://issues.apache.org/jira/browse/HIVE-28165>)
> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
> Hive query history HIVE-28095
> <https://issues.apache.org/jira/browse/HIVE-28095>)
> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
> Hive query history HIVE-28095
> <https://issues.apache.org/jira/browse/HIVE-28095>)
>
> 2. CVE fixes:
> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>
> 3. miscellaneous fixes
> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
> package usability
>
> Let me know if you're aware of any Tez fixes in the finish line that
> should make it to 0.10.4.
>
> Regards,
> Laszlo Bodor
>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by Jonathan Eagles <je...@gmail.com>.
Data-via-events for ordered fetch
https://issues.apache.org/jira/browse/TEZ-4570
This actually represents a very significant bug as Pig fetches unordered
output using ordered fetch. Now that data-via-events is now the default, it
means that Pig fails with Tez out of the box.
Jonathan
On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
wrote:
> Hi Everyone!
>
> (I included the Hive dev list for visibility.)
> Even though only a few months have passed since the last Tez release, it's
> already time for a new one.
>
> 1. tez client changes that are needed for hive:
> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
> Hive iceberg stability HIVE-28165
> <https://issues.apache.org/jira/browse/HIVE-28165>)
> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
> Hive query history HIVE-28095
> <https://issues.apache.org/jira/browse/HIVE-28095>)
> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
> Hive query history HIVE-28095
> <https://issues.apache.org/jira/browse/HIVE-28095>)
>
> 2. CVE fixes:
> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>
> 3. miscellaneous fixes
> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
> package usability
>
> Let me know if you're aware of any Tez fixes in the finish line that
> should make it to 0.10.4.
>
> Regards,
> Laszlo Bodor
>
Re: [DISCUSS] Tez 0.10.4 Release Planning
Posted by Jonathan Eagles <je...@gmail.com>.
Data-via-events for ordered fetch
https://issues.apache.org/jira/browse/TEZ-4570
This actually represents a very significant bug as Pig fetches unordered
output using ordered fetch. Now that data-via-events is now the default, it
means that Pig fails with Tez out of the box.
Jonathan
On Fri, Jun 28, 2024 at 2:56 AM László Bodor <bo...@gmail.com>
wrote:
> Hi Everyone!
>
> (I included the Hive dev list for visibility.)
> Even though only a few months have passed since the last Tez release, it's
> already time for a new one.
>
> 1. tez client changes that are needed for hive:
> TEZ-4548 <https://issues.apache.org/jira/browse/TEZ-4548> (needed for
> Hive iceberg stability HIVE-28165
> <https://issues.apache.org/jira/browse/HIVE-28165>)
> TEZ-4564 <https://issues.apache.org/jira/browse/TEZ-4564> (needed for
> Hive query history HIVE-28095
> <https://issues.apache.org/jira/browse/HIVE-28095>)
> TEZ-4554 <https://issues.apache.org/jira/browse/TEZ-4554> (needed for
> Hive query history HIVE-28095
> <https://issues.apache.org/jira/browse/HIVE-28095>)
>
> 2. CVE fixes:
> TEZ-4551 <https://issues.apache.org/jira/browse/TEZ-4551>
> TEZ-4552 <https://issues.apache.org/jira/browse/TEZ-4552>
> TEZ-4538 <https://issues.apache.org/jira/browse/TEZ-4538>
>
> 3. miscellaneous fixes
> TEZ-4557 <https://issues.apache.org/jira/browse/TEZ-4557>: tez.tar.gz
> package usability
>
> Let me know if you're aware of any Tez fixes in the finish line that
> should make it to 0.10.4.
>
> Regards,
> Laszlo Bodor
>