You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Junping Du <jd...@hortonworks.com> on 2017/09/11 00:00:08 UTC
[VOTE] Release Apache Hadoop 2.8.2 (RC0)
Hi folks,
With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
Thanks,
Junping
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Miklos just ping me offline that a security fix should get landed to resolve a docker runtime issue. I will retrieval RC0 for security fixes landing.
In the mean while, if people here really think a document here is necessary (although not enough verification to work as an alpha feature) and can work out a patch soon, I am open to accept it.
Thanks,
Junping
________________________________________
From: Junping Du <jd...@hortonworks.com>
Sent: Monday, September 11, 2017 5:32 PM
To: Daniel Templeton; Chris Douglas
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Miklos just ping me offline that a security fix should get landed to resolve a docker runtime issue. I will retrieval RC0 for security fixes landing.
In the mean while, if people here really think a document here is necessary (although not enough verification to work as an alpha feature) and can work out a patch soon, I am open to accept it.
Thanks,
Junping
________________________________________
From: Junping Du <jd...@hortonworks.com>
Sent: Monday, September 11, 2017 5:32 PM
To: Daniel Templeton; Chris Douglas
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Miklos just ping me offline that a security fix should get landed to resolve a docker runtime issue. I will retrieval RC0 for security fixes landing.
In the mean while, if people here really think a document here is necessary (although not enough verification to work as an alpha feature) and can work out a patch soon, I am open to accept it.
Thanks,
Junping
________________________________________
From: Junping Du <jd...@hortonworks.com>
Sent: Monday, September 11, 2017 5:32 PM
To: Daniel Templeton; Chris Douglas
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Miklos just ping me offline that a security fix should get landed to resolve a docker runtime issue. I will retrieval RC0 for security fixes landing.
In the mean while, if people here really think a document here is necessary (although not enough verification to work as an alpha feature) and can work out a patch soon, I am open to accept it.
Thanks,
Junping
________________________________________
From: Junping Du <jd...@hortonworks.com>
Sent: Monday, September 11, 2017 5:32 PM
To: Daniel Templeton; Chris Douglas
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Daniel for volunteering for documentation effort.
I suspect the problem we are facing here is not a simply documentation truncate effort, but indeed a incomplete feature problem. The umbrella JIRA YARN-3611 has 31 issues are marked as resolved but only 9 patches get backport to branch-2.8 no matter intentioned or not. So far, I haven't heard anyone claimed that they are deploying/testing 2.8 release without cherry pick additional patches for enabling new docker executor runtime.
IMO, it is better to treat this feature in 2.8 as incomplete feature instead of an alpha/experimental feature, especially it is out of our previous 2.8 scope. If so, instead of documenting something misleading, we should keep new settings/configurations private (as it is now) to get rid of getting enabled by users occasionally.
Thoughts?
Thanks,
Junping
________________________________________
From: Daniel Templeton <da...@cloudera.com>
Sent: Monday, September 11, 2017 4:45 PM
To: Chris Douglas; Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Daniel Templeton <da...@cloudera.com>.
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Daniel Templeton <da...@cloudera.com>.
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Daniel Templeton <da...@cloudera.com>.
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Daniel Templeton <da...@cloudera.com>.
YARN-6622 is now committed to 2.9. We could backport YARN-5258 and
YARN-6622 for 2.8, but it'll take some editing. We'll have to check to
see what features are unsupported in 2.8 and remove those from the
docs. Not a huge effort overall, though. Probably a hour's work. I
may have time to try do it later this week. Anyone else want to volunteer?
Daniel
On 9/11/17 3:01 PM, Chris Douglas wrote:
> On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
>> I don't think this -1 is reasonable, because:
>> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
> ...we're not going to document security implications- which include
> escalations to root- because we don't have _any_ documentation? Why
> don't we backport the documentation?
>
>> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
> YARN-6622 is *documenting* the fact that this is an alpha feature and
> that it shouldn't be enabled in secure environments. How are users
> supposed to make this determination without it?
>
>> Vote still continue until a real blocker comes.
> Soright. I remain -1. -C
>
>> ________________________________________
>> From: Chris Douglas <cd...@apache.org>
>> Sent: Monday, September 11, 2017 12:00 PM
>> To: Junping Du
>> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> -1 (binding)
>>
>> I don't think we should release this without YARN-6622.
>>
>> Since this doesn't happen often: a -1 in this case is NOT a veto.
>> Releases are approved by majority vote of the PMC. -C
>>
>> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>>
>>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>>
>>> I think vote should continue until we could find a real blocker.
>>>
>>>
>>> Thanks,
>>>
>>>
>>> Junping
>>>
>>>
>>> ________________________________
>>> From: Miklos Szegedi <mi...@cloudera.com>
>>> Sent: Monday, September 11, 2017 10:07 AM
>>> To: Mingliang Liu
>>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>>
>>> Hello Junping,
>>>
>>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>>
>>> Thank you,
>>> Miklos
>>>
>>>
>>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>>> Thanks Junping for doing this!
>>>
>>> +1 (non-binding)
>>>
>>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>>> - Build package using maven (skipping tests) with Java 8
>>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>>> - Check NN/RM Web UI
>>> - Run distcp to copy files from/to local and HDFS
>>> - Run hadoop mapreduce examples: grep and wordcount
>>> - Check the HDFS service logs
>>>
>>> All looked good to me.
>>>
>>> Mingliang
>>>
>>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>>
>>>> Hi folks,
>>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>>
>>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>>
>>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>>
>>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>>
>>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>>
>>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>>
>>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>>
>>>> Thanks,
>>>>
>>>> Junping
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
> I don't think this -1 is reasonable, because:
> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
...we're not going to document security implications- which include
escalations to root- because we don't have _any_ documentation? Why
don't we backport the documentation?
> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
YARN-6622 is *documenting* the fact that this is an alpha feature and
that it shouldn't be enabled in secure environments. How are users
supposed to make this determination without it?
> Vote still continue until a real blocker comes.
Soright. I remain -1. -C
> ________________________________________
> From: Chris Douglas <cd...@apache.org>
> Sent: Monday, September 11, 2017 12:00 PM
> To: Junping Du
> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> -1 (binding)
>
> I don't think we should release this without YARN-6622.
>
> Since this doesn't happen often: a -1 in this case is NOT a veto.
> Releases are approved by majority vote of the PMC. -C
>
> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>
>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>
>> I think vote should continue until we could find a real blocker.
>>
>>
>> Thanks,
>>
>>
>> Junping
>>
>>
>> ________________________________
>> From: Miklos Szegedi <mi...@cloudera.com>
>> Sent: Monday, September 11, 2017 10:07 AM
>> To: Mingliang Liu
>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> Hello Junping,
>>
>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>
>> Thank you,
>> Miklos
>>
>>
>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>> Thanks Junping for doing this!
>>
>> +1 (non-binding)
>>
>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>> - Build package using maven (skipping tests) with Java 8
>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>> - Check NN/RM Web UI
>> - Run distcp to copy files from/to local and HDFS
>> - Run hadoop mapreduce examples: grep and wordcount
>> - Check the HDFS service logs
>>
>> All looked good to me.
>>
>> Mingliang
>>
>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>
>>> Hi folks,
>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>
>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>
>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>
>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>
>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>
>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>
>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>
>>> Thanks,
>>>
>>> Junping
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
> I don't think this -1 is reasonable, because:
> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
...we're not going to document security implications- which include
escalations to root- because we don't have _any_ documentation? Why
don't we backport the documentation?
> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
YARN-6622 is *documenting* the fact that this is an alpha feature and
that it shouldn't be enabled in secure environments. How are users
supposed to make this determination without it?
> Vote still continue until a real blocker comes.
Soright. I remain -1. -C
> ________________________________________
> From: Chris Douglas <cd...@apache.org>
> Sent: Monday, September 11, 2017 12:00 PM
> To: Junping Du
> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> -1 (binding)
>
> I don't think we should release this without YARN-6622.
>
> Since this doesn't happen often: a -1 in this case is NOT a veto.
> Releases are approved by majority vote of the PMC. -C
>
> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>
>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>
>> I think vote should continue until we could find a real blocker.
>>
>>
>> Thanks,
>>
>>
>> Junping
>>
>>
>> ________________________________
>> From: Miklos Szegedi <mi...@cloudera.com>
>> Sent: Monday, September 11, 2017 10:07 AM
>> To: Mingliang Liu
>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> Hello Junping,
>>
>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>
>> Thank you,
>> Miklos
>>
>>
>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>> Thanks Junping for doing this!
>>
>> +1 (non-binding)
>>
>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>> - Build package using maven (skipping tests) with Java 8
>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>> - Check NN/RM Web UI
>> - Run distcp to copy files from/to local and HDFS
>> - Run hadoop mapreduce examples: grep and wordcount
>> - Check the HDFS service logs
>>
>> All looked good to me.
>>
>> Mingliang
>>
>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>
>>> Hi folks,
>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>
>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>
>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>
>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>
>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>
>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>
>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>
>>> Thanks,
>>>
>>> Junping
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
> I don't think this -1 is reasonable, because:
> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
...we're not going to document security implications- which include
escalations to root- because we don't have _any_ documentation? Why
don't we backport the documentation?
> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
YARN-6622 is *documenting* the fact that this is an alpha feature and
that it shouldn't be enabled in secure environments. How are users
supposed to make this determination without it?
> Vote still continue until a real blocker comes.
Soright. I remain -1. -C
> ________________________________________
> From: Chris Douglas <cd...@apache.org>
> Sent: Monday, September 11, 2017 12:00 PM
> To: Junping Du
> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> -1 (binding)
>
> I don't think we should release this without YARN-6622.
>
> Since this doesn't happen often: a -1 in this case is NOT a veto.
> Releases are approved by majority vote of the PMC. -C
>
> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>
>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>
>> I think vote should continue until we could find a real blocker.
>>
>>
>> Thanks,
>>
>>
>> Junping
>>
>>
>> ________________________________
>> From: Miklos Szegedi <mi...@cloudera.com>
>> Sent: Monday, September 11, 2017 10:07 AM
>> To: Mingliang Liu
>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> Hello Junping,
>>
>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>
>> Thank you,
>> Miklos
>>
>>
>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>> Thanks Junping for doing this!
>>
>> +1 (non-binding)
>>
>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>> - Build package using maven (skipping tests) with Java 8
>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>> - Check NN/RM Web UI
>> - Run distcp to copy files from/to local and HDFS
>> - Run hadoop mapreduce examples: grep and wordcount
>> - Check the HDFS service logs
>>
>> All looked good to me.
>>
>> Mingliang
>>
>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>
>>> Hi folks,
>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>
>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>
>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>
>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>
>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>
>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>
>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>
>>> Thanks,
>>>
>>> Junping
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
On Mon, Sep 11, 2017 at 2:52 PM, Junping Du <jd...@hortonworks.com> wrote:
> I don't think this -1 is reasonable, because:
> - If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
...we're not going to document security implications- which include
escalations to root- because we don't have _any_ documentation? Why
don't we backport the documentation?
> - New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
YARN-6622 is *documenting* the fact that this is an alpha feature and
that it shouldn't be enabled in secure environments. How are users
supposed to make this determination without it?
> Vote still continue until a real blocker comes.
Soright. I remain -1. -C
> ________________________________________
> From: Chris Douglas <cd...@apache.org>
> Sent: Monday, September 11, 2017 12:00 PM
> To: Junping Du
> Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> -1 (binding)
>
> I don't think we should release this without YARN-6622.
>
> Since this doesn't happen often: a -1 in this case is NOT a veto.
> Releases are approved by majority vote of the PMC. -C
>
> On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
>> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>>
>> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>>
>> I think vote should continue until we could find a real blocker.
>>
>>
>> Thanks,
>>
>>
>> Junping
>>
>>
>> ________________________________
>> From: Miklos Szegedi <mi...@cloudera.com>
>> Sent: Monday, September 11, 2017 10:07 AM
>> To: Mingliang Liu
>> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
>> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>>
>> Hello Junping,
>>
>> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>>
>> Thank you,
>> Miklos
>>
>>
>> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
>> Thanks Junping for doing this!
>>
>> +1 (non-binding)
>>
>> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
>> - Build package using maven (skipping tests) with Java 8
>> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
>> - Operate the basic HDFS/YARN operations from command line, both client and admin
>> - Check NN/RM Web UI
>> - Run distcp to copy files from/to local and HDFS
>> - Run hadoop mapreduce examples: grep and wordcount
>> - Check the HDFS service logs
>>
>> All looked good to me.
>>
>> Mingliang
>>
>>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>>
>>> Hi folks,
>>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>>
>>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>>
>>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>>
>>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>>
>>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>>
>>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>>
>>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>>
>>> Thanks,
>>>
>>> Junping
>>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
>> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
I don't think this -1 is reasonable, because:
- If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
- New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
Vote still continue until a real blocker comes.
Thanks,
Junping
________________________________________
From: Chris Douglas <cd...@apache.org>
Sent: Monday, September 11, 2017 12:00 PM
To: Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
I don't think this -1 is reasonable, because:
- If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
- New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
Vote still continue until a real blocker comes.
Thanks,
Junping
________________________________________
From: Chris Douglas <cd...@apache.org>
Sent: Monday, September 11, 2017 12:00 PM
To: Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
I don't think this -1 is reasonable, because:
- If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
- New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
Vote still continue until a real blocker comes.
Thanks,
Junping
________________________________________
From: Chris Douglas <cd...@apache.org>
Sent: Monday, September 11, 2017 12:00 PM
To: Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
I don't think this -1 is reasonable, because:
- If you look at YARN-6622 closely, it targets to fix a problematic documentation work on YARN-5258 which get checked into 2.9 and 3.0 branch only. It means it targets to fix a problem that 2.8.2 never exists.
- New docker container support (replace of old DockerContainerExectutor) is still an alpha feature now which doesn't highlight in 2.8 major features/improvement (http://hadoop.apache.org/docs/r2.8.0/index.html). So adding documentation here is also not a blocker.
Vote still continue until a real blocker comes.
Thanks,
Junping
________________________________________
From: Chris Douglas <cd...@apache.org>
Sent: Monday, September 11, 2017 12:00 PM
To: Junping Du
Cc: Miklos Szegedi; Mingliang Liu; Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Chris Douglas <cd...@apache.org>.
-1 (binding)
I don't think we should release this without YARN-6622.
Since this doesn't happen often: a -1 in this case is NOT a veto.
Releases are approved by majority vote of the PMC. -C
On Mon, Sep 11, 2017 at 11:45 AM, Junping Du <jd...@hortonworks.com> wrote:
> Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
>
> I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
>
> I think vote should continue until we could find a real blocker.
>
>
> Thanks,
>
>
> Junping
>
>
> ________________________________
> From: Miklos Szegedi <mi...@cloudera.com>
> Sent: Monday, September 11, 2017 10:07 AM
> To: Mingliang Liu
> Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
> Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
>
> Hello Junping,
>
> Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
>
> Thank you,
> Miklos
>
>
> On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
>> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>>
>> Hi folks,
>> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>>
>> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>>
>> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>>
>> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>>
>> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>>
>> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>>
>> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>>
>> Thanks,
>>
>> Junping
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
I think vote should continue until we could find a real blocker.
Thanks,
Junping
________________________________
From: Miklos Szegedi <mi...@cloudera.com>
Sent: Monday, September 11, 2017 10:07 AM
To: Mingliang Liu
Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Hello Junping,
Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
Thank you,
Miklos
On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
I think vote should continue until we could find a real blocker.
Thanks,
Junping
________________________________
From: Miklos Szegedi <mi...@cloudera.com>
Sent: Monday, September 11, 2017 10:07 AM
To: Mingliang Liu
Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Hello Junping,
Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
Thank you,
Miklos
On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
I think vote should continue until we could find a real blocker.
Thanks,
Junping
________________________________
From: Miklos Szegedi <mi...@cloudera.com>
Sent: Monday, September 11, 2017 10:07 AM
To: Mingliang Liu
Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Hello Junping,
Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
Thank you,
Miklos
On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Junping Du <jd...@hortonworks.com>.
Thanks Mikols for notifying on this. I think docker support is general known as alpha feature so document it as experimental is nice to have but not a blocker for 2.8.2. I also noticed that our 2.7.x document (https://hadoop.apache.org/docs/r2.7.4/hadoop-yarn/hadoop-yarn-site/DockerContainerExecutor.html) without mentioning docker support is experimental. We may need to fix that as well in following releases.
I can also add it (mentioning docker container support feature is experimental) to release message in public website just like previous release we call 2.7.0/2.8.0 as non-production release.
I think vote should continue until we could find a real blocker.
Thanks,
Junping
________________________________
From: Miklos Szegedi <mi...@cloudera.com>
Sent: Monday, September 11, 2017 10:07 AM
To: Mingliang Liu
Cc: Hadoop Common; Hdfs-dev; mapreduce-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; junping_du; Junping Du
Subject: Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Hello Junping,
Thank you for working on this. Should not YARN-6622 be addressed first? "Summary: Document Docker work as experimental".
Thank you,
Miklos
On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com>> wrote:
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com>> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org<http://repository.apache.org> at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org<ma...@hadoop.apache.org>
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org<ma...@hadoop.apache.org>
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Miklos Szegedi <mi...@cloudera.com>.
Hello Junping,
Thank you for working on this. Should not YARN-6622 be addressed
first? "Summary:
Document Docker work as experimental".
Thank you,
Miklos
On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM)
> and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client
> and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
> > On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com> wrote:
> >
> > Hi folks,
> > With fix of HADOOP-14842 get in, I've created our first release
> candidate (RC0) for Apache Hadoop 2.8.2.
> >
> > Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line
> and will be the latest stable/production release for Apache Hadoop - it
> includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as
> blocker/critical issues.
> >
> > More information about the 2.8.2 release plan can be found here:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
> >
> > New RC is available at: http://home.apache.org/~
> junping_du/hadoop-2.8.2-RC0
> >
> > The RC tag in git is: release-2.8.2-RC0, and the latest commit id
> is: e6597fe3000b06847d2bf55f2bab81770f4b2505
> >
> > The maven artifacts are available via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1062
> >
> > Please try the release and vote; the vote will run for the usual 5
> days, ending on 09/15/2017 5pm PST time.
> >
> > Thanks,
> >
> > Junping
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Miklos Szegedi <mi...@cloudera.com>.
Hello Junping,
Thank you for working on this. Should not YARN-6622 be addressed
first? "Summary:
Document Docker work as experimental".
Thank you,
Miklos
On Sun, Sep 10, 2017 at 6:39 PM, Mingliang Liu <li...@gmail.com> wrote:
> Thanks Junping for doing this!
>
> +1 (non-binding)
>
> - Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
> - Build package using maven (skipping tests) with Java 8
> - Spin up a test cluster in Docker containers having 1 master node (NN/RM)
> and 3 slave nodes (DN/NM)
> - Operate the basic HDFS/YARN operations from command line, both client
> and admin
> - Check NN/RM Web UI
> - Run distcp to copy files from/to local and HDFS
> - Run hadoop mapreduce examples: grep and wordcount
> - Check the HDFS service logs
>
> All looked good to me.
>
> Mingliang
>
> > On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com> wrote:
> >
> > Hi folks,
> > With fix of HADOOP-14842 get in, I've created our first release
> candidate (RC0) for Apache Hadoop 2.8.2.
> >
> > Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line
> and will be the latest stable/production release for Apache Hadoop - it
> includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as
> blocker/critical issues.
> >
> > More information about the 2.8.2 release plan can be found here:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
> >
> > New RC is available at: http://home.apache.org/~
> junping_du/hadoop-2.8.2-RC0
> >
> > The RC tag in git is: release-2.8.2-RC0, and the latest commit id
> is: e6597fe3000b06847d2bf55f2bab81770f4b2505
> >
> > The maven artifacts are available via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1062
> >
> > Please try the release and vote; the vote will run for the usual 5
> days, ending on 09/15/2017 5pm PST time.
> >
> > Thanks,
> >
> > Junping
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Mingliang Liu <li...@gmail.com>.
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Junping Du.
+1 (non-binding)
-Built from source
-Installed HA cluster
-Executed basic shell commands
-Ran sample jobs
-Verified HDFS/YARN UI.
--Brahma Reddy Battula
On Mon, 11 Sep 2017 at 5:30 AM, Junping Du <jd...@hortonworks.com> wrote:
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release
> candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line
> and will be the latest stable/production release for Apache Hadoop - it
> includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as
> blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at:
> http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id
> is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5
> days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
> --
--Brahma Reddy Battula
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Mingliang Liu <li...@gmail.com>.
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Junping Du.
+1 (non-binding)
-Built from source
-Installed HA cluster
-Executed basic shell commands
-Ran sample jobs
-Verified HDFS/YARN UI.
--Brahma Reddy Battula
On Mon, 11 Sep 2017 at 5:30 AM, Junping Du <jd...@hortonworks.com> wrote:
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release
> candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line
> and will be the latest stable/production release for Apache Hadoop - it
> includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as
> blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at:
> http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id
> is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5
> days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
> --
--Brahma Reddy Battula
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Mingliang Liu <li...@gmail.com>.
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Junping Du.
+1 (non-binding)
-Built from source
-Installed HA cluster
-Executed basic shell commands
-Ran sample jobs
-Verified HDFS/YARN UI.
--Brahma Reddy Battula
On Mon, 11 Sep 2017 at 5:30 AM, Junping Du <jd...@hortonworks.com> wrote:
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release
> candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line
> and will be the latest stable/production release for Apache Hadoop - it
> includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as
> blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at:
> http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id
> is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5
> days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
> --
--Brahma Reddy Battula
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Mingliang Liu <li...@gmail.com>.
Thanks Junping for doing this!
+1 (non-binding)
- Download the hadoop-2.8.2-src.tar.gz file and checked the md5 value
- Build package using maven (skipping tests) with Java 8
- Spin up a test cluster in Docker containers having 1 master node (NN/RM) and 3 slave nodes (DN/NM)
- Operate the basic HDFS/YARN operations from command line, both client and admin
- Check NN/RM Web UI
- Run distcp to copy files from/to local and HDFS
- Run hadoop mapreduce examples: grep and wordcount
- Check the HDFS service logs
All looked good to me.
Mingliang
> On Sep 10, 2017, at 5:00 PM, Junping Du <jd...@hortonworks.com> wrote:
>
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line and will be the latest stable/production release for Apache Hadoop - it includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at: http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at: https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5 days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.8.2 (RC0)
Posted by Brahma Reddy Battula <br...@apache.org>.
Thanks Junping Du.
+1 (non-binding)
-Built from source
-Installed HA cluster
-Executed basic shell commands
-Ran sample jobs
-Verified HDFS/YARN UI.
--Brahma Reddy Battula
On Mon, 11 Sep 2017 at 5:30 AM, Junping Du <jd...@hortonworks.com> wrote:
> Hi folks,
> With fix of HADOOP-14842 get in, I've created our first release
> candidate (RC0) for Apache Hadoop 2.8.2.
>
> Apache Hadoop 2.8.2 is the first stable release of Hadoop 2.8 line
> and will be the latest stable/production release for Apache Hadoop - it
> includes 305 new fixed issues since 2.8.1 and 63 fixes are marked as
> blocker/critical issues.
>
> More information about the 2.8.2 release plan can be found here:
> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
>
> New RC is available at:
> http://home.apache.org/~junping_du/hadoop-2.8.2-RC0
>
> The RC tag in git is: release-2.8.2-RC0, and the latest commit id
> is: e6597fe3000b06847d2bf55f2bab81770f4b2505
>
> The maven artifacts are available via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1062
>
> Please try the release and vote; the vote will run for the usual 5
> days, ending on 09/15/2017 5pm PST time.
>
> Thanks,
>
> Junping
>
> --
--Brahma Reddy Battula