You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@tez.apache.org by camelia c <ca...@yahoo.com> on 2014/05/11 22:51:16 UTC
Question about version 0.5.0-incubating
Hello,
Can
You please be kind to tell me when do You estimate that version
0.5.0-incubating will be available in the central Maven Repository?
There
have been some valuable commits in Tez during the month of April (e.g.
in MRInput,MROutput, MRHelpers, SimpleMRProcessor), that I'd like to use
in the project I'm working on [1]. Currently my dependencies are on Tez
version 0.4.0-incubating which was released on April 1st. With that
version the new WordCount example fails:
value createMRIntermediateDataPayload is not a member of object org.apache.tez.mapreduce.hadoop.MRHelpers
value createUserPayload is not a member of object org.apache.tez.mapreduce.input.MRInput
value createUserPayload is not a member of object org.apache.tez.mapreduce.output.MROutput
value waitForCompletionWithAllStatusUpdates is not a member of org.apache.tez.dag.api.client.DAGClient
Moreover,
SimpleMRProcessor and SimpleProcessor are not part of 0.4.0-incubating release, but they are very helpful.
Is it a way to use Maven based on a Github repository branch, while it is not ready the new 0.5.0-incubating release yet ?
Thank You very much. I hope to get an answer from You soon.
Yours sincerely,
Camelia
[1]https://sites.google.com/site/gsoc2014tez4summingbird/home
RE: Question about version 0.5.0-incubating
Posted by Bikas Saha <bi...@hortonworks.com>.
Most of the targeted work under TEZ-690 (API ease of use) is complete. We
should be able to wrap it in the next few weeks for late May/early June
0.5 release.
Ease of use will be an ongoing process but it may be important to release
0.5 sooner rather than later because we are moving to abstract classes
instead of interfaces and that will help make future changes smoother.
Also a lot of confusing code around MR configuration helper methods has
been cleaned up. E.g. There is no need for any invocation of
jobClientMagic :)
So it's a cleaner slate to start from.
Bikas
-----Original Message-----
From: Hitesh Shah [mailto:hitesh@apache.org]
Sent: Monday, May 12, 2014 3:18 PM
To: user@tez.incubator.apache.org; camelia c
Subject: Re: Question about version 0.5.0-incubating
Hello Camelia,
In terms of a timeline for the 0.5.0 release, I don't believe the
community has decided on a plan yet. The 0.5.0 release plans to target a
lot of API cleanup as well as improving usability of the Tez apis/helpers
( which it seems like have been quite useful for you ). My best guess
would be that we will try to target a release within the next couple of
months.
The snapshot repo is updated on an ongoing basis as soon as commits go in.
So please be aware that you may have to handle some incompatible changes
that are likely to go in as part of the API cleanup.
thanks
- Hitesh
On May 12, 2014, at 2:53 PM, camelia c <ca...@yahoo.com> wrote:
> Thank You very much!
> I chose to use the SNAPSHOTS approach for the dependencies.
>
> Yours sincerely,
> Camelia
>
> From: Rohini Palaniswamy <ro...@gmail.com>
> To: user@tez.incubator.apache.org
> Sent: Monday, May 12, 2014 6:12 AM
> Subject: Re: Question about version 0.5.0-incubating
>
> https://repository.apache.org/content/groups/snapshots/org/apache/tez -
The snapshot jars are available in apache maven repository within few
hours of commit. We have been building against those in Apache Pig.
>
> Regards,
> Rohini
>
>
> On Sun, May 11, 2014 at 7:49 PM, Yu Azuryy <az...@outlook.com> wrote:
> I don't know the release dead line, but if you eager to use new features
in 0.5.0, you can build jars by yourself.
>
> just git clone the master of Tez, then build using maven. but I suggest
built it against hadoop-2.4.0, not hadoop-2.2.0 by default.
>
>
>
>
> Date: Sun, 11 May 2014 13:51:16 -0700
> From: camelie_1985@yahoo.com
> Subject: Question about version 0.5.0-incubating
> To: user@tez.incubator.apache.org
>
>
>
> Hello,
>
> Can You please be kind to tell me when do You estimate that version
0.5.0-incubating will be available in the central Maven Repository?
> There have been some valuable commits in Tez during the month of April
(e.g. in MRInput,MROutput, MRHelpers, SimpleMRProcessor), that I'd like to
use in the project I'm working on [1]. Currently my dependencies are on
Tez version 0.4.0-incubating which was released on April 1st. With that
version the new WordCount example fails:
>
> value createMRIntermediateDataPayload is not a member of object
org.apache.tez.mapreduce.hadoop.MRHelpers
> value createUserPayload is not a member of object
org.apache.tez.mapreduce.input.MRInput
> value createUserPayload is not a member of object
org.apache.tez.mapreduce.output.MROutput
> value waitForCompletionWithAllStatusUpdates is not a member of
org.apache.tez.dag.api.client.DAGClient
>
> Moreover, SimpleMRProcessor and SimpleProcessor are not part of
0.4.0-incubating release, but they are very helpful.
>
> Is it a way to use Maven based on a Github repository branch, while it
is not ready the new 0.5.0-incubating release yet ?
>
> Thank You very much. I hope to get an answer from You soon.
>
> Yours sincerely,
> Camelia
>
>
> [1]
> https://sites.google.com/site/gsoc2014tez4summingbird/home
>
>
>
>
>
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Question about version 0.5.0-incubating
Posted by Hitesh Shah <hi...@apache.org>.
Hello Camelia,
In terms of a timeline for the 0.5.0 release, I don’t believe the community has decided on a plan yet. The 0.5.0 release plans to target a lot of API cleanup as well as improving usability of the Tez apis/helpers ( which it seems like have been quite useful for you ). My best guess would be that we will try to target a release within the next couple of months.
The snapshot repo is updated on an ongoing basis as soon as commits go in. So please be aware that you may have to handle some incompatible changes that are likely to go in as part of the API cleanup.
thanks
— Hitesh
On May 12, 2014, at 2:53 PM, camelia c <ca...@yahoo.com> wrote:
> Thank You very much!
> I chose to use the SNAPSHOTS approach for the dependencies.
>
> Yours sincerely,
> Camelia
>
> From: Rohini Palaniswamy <ro...@gmail.com>
> To: user@tez.incubator.apache.org
> Sent: Monday, May 12, 2014 6:12 AM
> Subject: Re: Question about version 0.5.0-incubating
>
> https://repository.apache.org/content/groups/snapshots/org/apache/tez - The snapshot jars are available in apache maven repository within few hours of commit. We have been building against those in Apache Pig.
>
> Regards,
> Rohini
>
>
> On Sun, May 11, 2014 at 7:49 PM, Yu Azuryy <az...@outlook.com> wrote:
> I don't know the release dead line, but if you eager to use new features in 0.5.0, you can build jars by yourself.
>
> just git clone the master of Tez, then build using maven. but I suggest built it against hadoop-2.4.0, not hadoop-2.2.0 by default.
>
>
>
>
> Date: Sun, 11 May 2014 13:51:16 -0700
> From: camelie_1985@yahoo.com
> Subject: Question about version 0.5.0-incubating
> To: user@tez.incubator.apache.org
>
>
>
> Hello,
>
> Can You please be kind to tell me when do You estimate that version 0.5.0-incubating will be available in the central Maven Repository?
> There have been some valuable commits in Tez during the month of April (e.g. in MRInput,MROutput, MRHelpers, SimpleMRProcessor), that I'd like to use in the project I'm working on [1]. Currently my dependencies are on Tez version 0.4.0-incubating which was released on April 1st. With that version the new WordCount example fails:
>
> value createMRIntermediateDataPayload is not a member of object org.apache.tez.mapreduce.hadoop.MRHelpers
> value createUserPayload is not a member of object org.apache.tez.mapreduce.input.MRInput
> value createUserPayload is not a member of object org.apache.tez.mapreduce.output.MROutput
> value waitForCompletionWithAllStatusUpdates is not a member of org.apache.tez.dag.api.client.DAGClient
>
> Moreover, SimpleMRProcessor and SimpleProcessor are not part of 0.4.0-incubating release, but they are very helpful.
>
> Is it a way to use Maven based on a Github repository branch, while it is not ready the new 0.5.0-incubating release yet ?
>
> Thank You very much. I hope to get an answer from You soon.
>
> Yours sincerely,
> Camelia
>
>
> [1]
> https://sites.google.com/site/gsoc2014tez4summingbird/home
>
>
>
>
>
>
>
>
Re: Question about version 0.5.0-incubating
Posted by camelia c <ca...@yahoo.com>.
Thank You very much!
I chose to use the SNAPSHOTS approach for the dependencies.
Yours sincerely,
Camelia
________________________________
From: Rohini Palaniswamy <ro...@gmail.com>
To: user@tez.incubator.apache.org
Sent: Monday, May 12, 2014 6:12 AM
Subject: Re: Question about version 0.5.0-incubating
https://repository.apache.org/content/groups/snapshots/org/apache/tez - The snapshot jars are available in apache maven repository within few hours of commit. We have been building against those in Apache Pig.
Regards,
Rohini
On Sun, May 11, 2014 at 7:49 PM, Yu Azuryy <az...@outlook.com> wrote:
I don't know the release dead line, but if you eager to use new features in 0.5.0, you can build jars by yourself.
>
>just git clone the master of Tez, then build using maven. but I suggest built it against hadoop-2.4.0, not hadoop-2.2.0 by default.
>
>
>
>
>
>
>________________________________
>Date: Sun, 11 May 2014 13:51:16 -0700
>From: camelie_1985@yahoo.com
>Subject: Question about version 0.5.0-incubating
>To: user@tez.incubator.apache.org
>
>
>
>
>Hello,
>
>
>Can
You please be kind to tell me when do You estimate that version
0.5.0-incubating will be available in the central Maven Repository?
>There
have been some valuable commits in Tez during the month of April (e.g.
in MRInput,MROutput, MRHelpers, SimpleMRProcessor), that I'd like to use
in the project I'm working on [1]. Currently my dependencies are on Tez
version 0.4.0-incubating which was released on April 1st. With that
version the new WordCount example fails:
>
>value createMRIntermediateDataPayload is not a member of object org.apache.tez.mapreduce.hadoop.MRHelpers
>value createUserPayload is not a member of object org.apache.tez.mapreduce.input.MRInput
>value createUserPayload is not a member of object org.apache.tez.mapreduce.output.MROutput
>value waitForCompletionWithAllStatusUpdates is not a member of org.apache.tez.dag.api.client.DAGClient
>
>Moreover,
SimpleMRProcessor and SimpleProcessor are not part of 0.4.0-incubating release, but they are very helpful.
>
>Is it a way to use Maven based on a Github repository branch, while it is not ready the new 0.5.0-incubating release yet ?
>
>Thank You very much. I hope to get an answer from You soon.
>
>Yours sincerely,
>Camelia
>
>
>
>
>[1]https://sites.google.com/site/gsoc2014tez4summingbird/home
>
>
>
>
>
>
>
Re: Question about version 0.5.0-incubating
Posted by Rohini Palaniswamy <ro...@gmail.com>.
https://repository.apache.org/content/groups/snapshots/org/apache/tez - The
snapshot jars are available in apache maven repository within few hours of
commit. We have been building against those in Apache Pig.
Regards,
Rohini
On Sun, May 11, 2014 at 7:49 PM, Yu Azuryy <az...@outlook.com> wrote:
> I don't know the release dead line, but if you eager to use new features
> in 0.5.0, you can build jars by yourself.
>
> just git clone the master of Tez, then build using maven. but I suggest
> built it against hadoop-2.4.0, not hadoop-2.2.0 by default.
>
>
>
>
> ------------------------------
> Date: Sun, 11 May 2014 13:51:16 -0700
> From: camelie_1985@yahoo.com
> Subject: Question about version 0.5.0-incubating
> To: user@tez.incubator.apache.org
>
>
>
> Hello,
>
> Can You please be kind to tell me when do You estimate that version
> 0.5.0-incubating will be available in the central Maven Repository?
> There have been some valuable commits in Tez during the month of April
> (e.g. in MRInput,MROutput, MRHelpers, SimpleMRProcessor), that I'd like to
> use in the project I'm working on [1]. Currently my dependencies are on Tez
> version 0.4.0-incubating which was released on April 1st. With that version
> the new WordCount example fails:
>
> value createMRIntermediateDataPayload is not a member of object
> org.apache.tez.mapreduce.hadoop.MRHelpers
> value createUserPayload is not a member of object
> org.apache.tez.mapreduce.input.MRInput
> value createUserPayload is not a member of object
> org.apache.tez.mapreduce.output.MROutput
> value waitForCompletionWithAllStatusUpdates is not a member of
> org.apache.tez.dag.api.client.DAGClient
>
> Moreover, SimpleMRProcessor and SimpleProcessor are not part of
> 0.4.0-incubating release, but they are very helpful.
>
> Is it a way to use Maven based on a Github repository branch, while it is
> not ready the new 0.5.0-incubating release yet ?
>
> Thank You very much. I hope to get an answer from You soon.
>
> Yours sincerely,
> Camelia
>
>
> [1]
> https://sites.google.com/site/gsoc2014tez4summingbird/home
>
>
>
>
>
>
RE: Question about version 0.5.0-incubating
Posted by Yu Azuryy <az...@outlook.com>.
I don't know the release dead line, but if you eager to use new features in 0.5.0, you can build jars by yourself.
just git clone the master of Tez, then build using maven. but I suggest built it against hadoop-2.4.0, not hadoop-2.2.0 by default.
Date: Sun, 11 May 2014 13:51:16 -0700
From: camelie_1985@yahoo.com
Subject: Question about version 0.5.0-incubating
To: user@tez.incubator.apache.org
Hello,Can
You please be kind to tell me when do You estimate that version
0.5.0-incubating will be available in the central Maven Repository?There
have been some valuable commits in Tez during the month of April (e.g.
in MRInput,MROutput, MRHelpers, SimpleMRProcessor), that I'd like to use
in the project I'm working on [1]. Currently my dependencies are on Tez
version 0.4.0-incubating which was released on April 1st. With that
version the new WordCount example fails:value createMRIntermediateDataPayload is not a member of object org.apache.tez.mapreduce.hadoop.MRHelpers value createUserPayload is not a member of object org.apache.tez.mapreduce.input.MRInput value createUserPayload is not a member of object org.apache.tez.mapreduce.output.MROutput value waitForCompletionWithAllStatusUpdates is not a member of org.apache.tez.dag.api.client.DAGClient Moreover,
SimpleMRProcessor and SimpleProcessor are not part of 0.4.0-incubating release, but they are very helpful.
Is it a way to use Maven based on a Github repository branch, while it is not ready the new 0.5.0-incubating release yet ?Thank You very much. I hope to get an answer from You soon.Yours sincerely,Camelia[1]https://sites.google.com/site/gsoc2014tez4summingbird/home