You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by Prasanth Jayachandran <pj...@hortonworks.com> on 2015/11/25 01:38:06 UTC
0.7.1 Release
Hello Everyone
We are planning to backport some patches for hive from hive master to branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The backport patch especially need https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497 which few test failures. The test failures need https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only available in 0.8.x. Are there any plans to release 0.7.1? Since we are not running precommit tests on branch-1 we are apprehensive to use 0.8.x version for branch-1.
Thanks
Prasanth
Re: 0.7.1 Release
Posted by Prasanth Jayachandran <pj...@hortonworks.com>.
We don’t have a timeline yet. The upcoming release (2.0) will be from master and no plans as of now for release from branch-1. I was trying to backport some patches and this particular one required tez upgrade on branch-1. So started off the discussion.
Thanks
Prasanth
> On Nov 24, 2015, at 8:07 PM, Hitesh Shah <hi...@apache.org> wrote:
>
> @Prashant, you are right - the fix will only be available when we release 0.7.1.
>
> Do you have any timelines on when you would like to do you next branch-1 release and we can aim to try and get a release put together before then.
>
> thanks
> — Hitesh
>
>
> On Nov 24, 2015, at 5:58 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
>
>> I tried running auto_sortmerge_join_5.q on branch-1 now with 0.7.0 and I am getting the same exception as in TEZ-2568.
>>
>> org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_INPUT_DATA_INFORMATION at INITED
>> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
>> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
>> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
>> at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
>> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
>> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
>> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
>> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
>> at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
>> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Thanks
>> Prasanth
>>
>>> On Nov 24, 2015, at 7:13 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
>>>
>>> Hi Jeff
>>>
>>> I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152
>>>
>>> I will use 0.7.0 version in branch-1 and see if I get more information.
>>>
>>> Thanks
>>> Prasanth
>>>
>>>> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
>>>>
>>>>
>>>> Hi Prasanth,
>>>>
>>>> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
>>>> might be due to some other issues.
>>>>
>>>> And regarding the release of 0.7.1, it is on our plan. Will start a thread
>>>> to discuss in the dev mail list.
>>>>
>>>>
>>>>
>>>>
>>>> Best Regard,
>>>> Jeff Zhang
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
>>>> <pj...@hortonworks.com> wrote:
>>>>
>>>>> Hello Everyone
>>>>>
>>>>> We are planning to backport some patches for hive from hive master to
>>>>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>>>>> backport patch especially need
>>>>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>>>>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>>>>> which few test failures. The test failures need
>>>>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>>>>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>>>>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>>>>> version for branch-1.
>>>>>
>>>>> Thanks
>>>>> Prasanth
>>>>
>>>>
>>>
>>
>
>
Re: 0.7.1 Release
Posted by Hitesh Shah <hi...@apache.org>.
@Prashant, you are right - the fix will only be available when we release 0.7.1.
Do you have any timelines on when you would like to do you next branch-1 release and we can aim to try and get a release put together before then.
thanks
— Hitesh
On Nov 24, 2015, at 5:58 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
> I tried running auto_sortmerge_join_5.q on branch-1 now with 0.7.0 and I am getting the same exception as in TEZ-2568.
>
> org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_INPUT_DATA_INFORMATION at INITED
> at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
> at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
> at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
> at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
> at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
> at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
> at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
> at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
> at java.lang.Thread.run(Thread.java:745)
>
> Thanks
> Prasanth
>
>> On Nov 24, 2015, at 7:13 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
>>
>> Hi Jeff
>>
>> I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152
>>
>> I will use 0.7.0 version in branch-1 and see if I get more information.
>>
>> Thanks
>> Prasanth
>>
>>> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
>>>
>>>
>>> Hi Prasanth,
>>>
>>> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
>>> might be due to some other issues.
>>>
>>> And regarding the release of 0.7.1, it is on our plan. Will start a thread
>>> to discuss in the dev mail list.
>>>
>>>
>>>
>>>
>>> Best Regard,
>>> Jeff Zhang
>>>
>>>
>>>
>>>
>>>
>>> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
>>> <pj...@hortonworks.com> wrote:
>>>
>>>> Hello Everyone
>>>>
>>>> We are planning to backport some patches for hive from hive master to
>>>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>>>> backport patch especially need
>>>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>>>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>>>> which few test failures. The test failures need
>>>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>>>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>>>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>>>> version for branch-1.
>>>>
>>>> Thanks
>>>> Prasanth
>>>
>>>
>>
>
Re: 0.7.1 Release
Posted by Prasanth Jayachandran <pj...@hortonworks.com>.
I tried running auto_sortmerge_join_5.q on branch-1 now with 0.7.0 and I am getting the same exception as in TEZ-2568.
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_INPUT_DATA_INFORMATION at INITED
at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
at java.lang.Thread.run(Thread.java:745)
Thanks
Prasanth
> On Nov 24, 2015, at 7:13 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
>
> Hi Jeff
>
> I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152
>
> I will use 0.7.0 version in branch-1 and see if I get more information.
>
> Thanks
> Prasanth
>
>> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
>>
>>
>> Hi Prasanth,
>>
>> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
>> might be due to some other issues.
>>
>> And regarding the release of 0.7.1, it is on our plan. Will start a thread
>> to discuss in the dev mail list.
>>
>>
>>
>>
>> Best Regard,
>> Jeff Zhang
>>
>>
>>
>>
>>
>> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
>> <pj...@hortonworks.com> wrote:
>>
>>> Hello Everyone
>>>
>>> We are planning to backport some patches for hive from hive master to
>>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>>> backport patch especially need
>>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>>> which few test failures. The test failures need
>>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>>> version for branch-1.
>>>
>>> Thanks
>>> Prasanth
>>
>>
>
Re: 0.7.1 Release
Posted by Prasanth Jayachandran <pj...@hortonworks.com>.
Hi Jeff
I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152
I will use 0.7.0 version in branch-1 and see if I get more information.
Thanks
Prasanth
> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
>
>
> Hi Prasanth,
>
> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
> might be due to some other issues.
>
> And regarding the release of 0.7.1, it is on our plan. Will start a thread
> to discuss in the dev mail list.
>
>
>
>
> Best Regard,
> Jeff Zhang
>
>
>
>
>
> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
> <pj...@hortonworks.com> wrote:
>
>> Hello Everyone
>>
>> We are planning to backport some patches for hive from hive master to
>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>> backport patch especially need
>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>> which few test failures. The test failures need
>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>> version for branch-1.
>>
>> Thanks
>> Prasanth
>
>
Re: 0.7.1 Release
Posted by "Jianfeng (Jeff) Zhang" <jz...@hortonworks.com>.
Hi Prasanth,
TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
might be due to some other issues.
And regarding the release of 0.7.1, it is on our plan. Will start a thread
to discuss in the dev mail list.
Best Regard,
Jeff Zhang
On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
<pj...@hortonworks.com> wrote:
>Hello Everyone
>
>We are planning to backport some patches for hive from hive master to
>branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>backport patch especially need
>https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>which few test failures. The test failures need
>https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>version for branch-1.
>
>Thanks
>Prasanth