You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by Prasanth Jayachandran <pj...@hortonworks.com> on 2015/11/25 01:38:06 UTC

0.7.1 Release

Hello Everyone

We are planning to backport some patches for hive from hive master to branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The backport patch especially need https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497 which few test failures. The test failures need https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only available in 0.8.x. Are there any plans to release 0.7.1? Since we are not running precommit tests on branch-1 we are apprehensive to use 0.8.x version for branch-1.

Thanks
Prasanth

Re: 0.7.1 Release

Posted by Prasanth Jayachandran <pj...@hortonworks.com>.
We don’t have a timeline yet. The upcoming release (2.0) will be from master and no plans as of now for release from branch-1. I was trying to backport some patches and this particular one required tez upgrade on branch-1. So started off the discussion.

Thanks
Prasanth

> On Nov 24, 2015, at 8:07 PM, Hitesh Shah <hi...@apache.org> wrote:
> 
> @Prashant, you are right - the fix will only be available when we release 0.7.1. 
> 
> Do you have any timelines on when you would like to do you next branch-1 release and we can aim to try and get a release put together before then.
> 
> thanks
> — Hitesh
> 
> 
> On Nov 24, 2015, at 5:58 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
> 
>> I tried running auto_sortmerge_join_5.q on branch-1 now with 0.7.0 and I am getting the same exception as in TEZ-2568.
>> 
>> org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_INPUT_DATA_INFORMATION at INITED
>>       at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
>>       at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
>>       at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
>>       at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
>>       at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
>>       at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
>>       at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
>>       at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
>>       at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
>>       at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
>>       at java.lang.Thread.run(Thread.java:745)
>> 
>> Thanks
>> Prasanth
>> 
>>> On Nov 24, 2015, at 7:13 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
>>> 
>>> Hi Jeff
>>> 
>>> I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152
>>> 
>>> I will use 0.7.0 version in branch-1 and see if I get more information.
>>> 
>>> Thanks
>>> Prasanth
>>> 
>>>> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
>>>> 
>>>> 
>>>> Hi Prasanth,
>>>> 
>>>> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
>>>> might be due to some other issues.
>>>> 
>>>> And regarding the release of 0.7.1, it is on our plan. Will start a thread
>>>> to discuss in the dev mail list.
>>>> 
>>>> 
>>>> 
>>>> 
>>>> Best Regard,
>>>> Jeff Zhang
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
>>>> <pj...@hortonworks.com> wrote:
>>>> 
>>>>> Hello Everyone
>>>>> 
>>>>> We are planning to backport some patches for hive from hive master to
>>>>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>>>>> backport patch especially need
>>>>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>>>>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>>>>> which few test failures. The test failures need
>>>>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>>>>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>>>>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>>>>> version for branch-1.
>>>>> 
>>>>> Thanks
>>>>> Prasanth
>>>> 
>>>> 
>>> 
>> 
> 
> 


Re: 0.7.1 Release

Posted by Hitesh Shah <hi...@apache.org>.
@Prashant, you are right - the fix will only be available when we release 0.7.1. 

Do you have any timelines on when you would like to do you next branch-1 release and we can aim to try and get a release put together before then.

thanks
— Hitesh


On Nov 24, 2015, at 5:58 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:

> I tried running auto_sortmerge_join_5.q on branch-1 now with 0.7.0 and I am getting the same exception as in TEZ-2568.
> 
> org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_INPUT_DATA_INFORMATION at INITED
>        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
>        at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
>        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
>        at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
>        at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
>        at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
>        at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
>        at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
>        at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
>        at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
>        at java.lang.Thread.run(Thread.java:745)
> 
> Thanks
> Prasanth
> 
>> On Nov 24, 2015, at 7:13 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
>> 
>> Hi Jeff
>> 
>> I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152
>> 
>> I will use 0.7.0 version in branch-1 and see if I get more information.
>> 
>> Thanks
>> Prasanth
>> 
>>> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
>>> 
>>> 
>>> Hi Prasanth,
>>> 
>>> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
>>> might be due to some other issues.
>>> 
>>> And regarding the release of 0.7.1, it is on our plan. Will start a thread
>>> to discuss in the dev mail list.
>>> 
>>> 
>>> 
>>> 
>>> Best Regard,
>>> Jeff Zhang
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
>>> <pj...@hortonworks.com> wrote:
>>> 
>>>> Hello Everyone
>>>> 
>>>> We are planning to backport some patches for hive from hive master to
>>>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>>>> backport patch especially need
>>>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>>>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>>>> which few test failures. The test failures need
>>>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>>>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>>>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>>>> version for branch-1.
>>>> 
>>>> Thanks
>>>> Prasanth
>>> 
>>> 
>> 
> 


Re: 0.7.1 Release

Posted by Prasanth Jayachandran <pj...@hortonworks.com>.
I tried running auto_sortmerge_join_5.q on branch-1 now with 0.7.0 and I am getting the same exception as in TEZ-2568.

org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_INPUT_DATA_INFORMATION at INITED
        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
        at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
        at org.apache.tez.state.StateMachineTez.doTransition(StateMachineTez.java:57)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1812)
        at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:198)
        at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1943)
        at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1929)
        at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
        at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
        at java.lang.Thread.run(Thread.java:745)

Thanks
Prasanth

> On Nov 24, 2015, at 7:13 PM, Prasanth Jayachandran <pj...@hortonworks.com> wrote:
> 
> Hi Jeff
> 
> I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152
> 
> I will use 0.7.0 version in branch-1 and see if I get more information.
> 
> Thanks
> Prasanth
> 
>> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
>> 
>> 
>> Hi Prasanth,
>> 
>> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
>> might be due to some other issues.
>> 
>> And regarding the release of 0.7.1, it is on our plan. Will start a thread
>> to discuss in the dev mail list.
>> 
>> 
>> 
>> 
>> Best Regard,
>> Jeff Zhang
>> 
>> 
>> 
>> 
>> 
>> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
>> <pj...@hortonworks.com> wrote:
>> 
>>> Hello Everyone
>>> 
>>> We are planning to backport some patches for hive from hive master to
>>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>>> backport patch especially need
>>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>>> which few test failures. The test failures need
>>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>>> version for branch-1.
>>> 
>>> Thanks
>>> Prasanth
>> 
>> 
> 


Re: 0.7.1 Release

Posted by Prasanth Jayachandran <pj...@hortonworks.com>.
Hi Jeff

I don’t have the exact exception/stacktrace. From this comment its auto_sortmerge_join_5.q https://issues.apache.org/jira/browse/HIVE-10497?focusedCommentId=14702152&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14702152

I will use 0.7.0 version in branch-1 and see if I get more information.

Thanks
Prasanth

> On Nov 24, 2015, at 7:06 PM, Jianfeng (Jeff) Zhang <jz...@hortonworks.com> wrote:
> 
> 
> Hi Prasanth,
> 
> TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
> might be due to some other issues.
> 
> And regarding the release of 0.7.1, it is on our plan. Will start a thread
> to discuss in the dev mail list.
> 
> 
> 
> 
> Best Regard,
> Jeff Zhang
> 
> 
> 
> 
> 
> On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
> <pj...@hortonworks.com> wrote:
> 
>> Hello Everyone
>> 
>> We are planning to backport some patches for hive from hive master to
>> branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>> backport patch especially need
>> https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>> with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>> which few test failures. The test failures need
>> https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>> available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>> not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>> version for branch-1.
>> 
>> Thanks
>> Prasanth
> 
> 


Re: 0.7.1 Release

Posted by "Jianfeng (Jeff) Zhang" <jz...@hortonworks.com>.
Hi Prasanth,

TEZ-2568 is included in branch-0.7. What¹s the test failure in hive ? It
might be due to some other issues.

And regarding the release of 0.7.1, it is on our plan. Will start a thread
to discuss in the dev mail list.




Best Regard,
Jeff Zhang





On 11/25/15, 8:38 AM, "Prasanth Jayachandran"
<pj...@hortonworks.com> wrote:

>Hello Everyone
>
>We are planning to backport some patches for hive from hive master to
>branch-1. Hive master is on 0.8.1-alpha and branch-1 is on 0.5.4. The
>backport patch especially need
>https://issues.apache.org/jira/browse/TEZ-1993. We ran precommit test
>with 0.7.1-SNAPSHOT https://issues.apache.org/jira/browse/HIVE-10497
>which few test failures. The test failures need
>https://issues.apache.org/jira/browse/TEZ-2568. However, TEZ-2568 is only
>available in 0.8.x. Are there any plans to release 0.7.1? Since we are
>not running precommit tests on branch-1 we are apprehensive to use 0.8.x
>version for branch-1.
>
>Thanks
>Prasanth