You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Arpit Agarwal <aa...@hortonworks.com> on 2018/04/03 00:31:35 UTC
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Hi Lei,
It looks like the release artefacts have dummy shaded jars. E.g.
Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
Uploaded by: lei
Size: 44.47 KB
Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
Thanks,
Arpit
On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
Hi, All
Thanks everyone for voting! The vote passes successfully with 6
binding +1s, 7 non-binding +1s and no -1s.
I will work on the staging and releases.
Best,
On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
> +1 (non-binding)
>
> Built from source.
> Installed on a pseudo distributed cluster.
> Ran word count job and basic hdfs commands.
>
> Thank you for the effort on this release.
>
> Regards,
> Kuhu
>
> On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
>
>>
>> +1 (non binding)
>>
>> I did a full build from source code, created a docker container and did
>> various basic level tests with robotframework based automation and
>> docker-compose based pseudo clusters[1].
>>
>> Including:
>>
>> * Hdfs federation smoke test
>> * Basic ViewFS configuration
>> * Yarn example jobs
>> * Spark example jobs (with and without yarn)
>> * Simple hive table creation
>>
>> Marton
>>
>>
>> [1]: https://github.com/flokkr/runtime-compose
>>
>> On 03/18/2018 05:11 AM, Lei Xu wrote:
>>
>>> Hi, all
>>>
>>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
>>>
>>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
>>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
>>> include 12
>>> blockers and 17 are critical.
>>>
>>> Please note:
>>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
>>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
>>> Hadoop 3.0.0 will be deprecated due to this change.
>>>
>>> The release page is:
>>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
>>>
>>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>>>
>>> The git tag is release-3.0.1-RC1, and the latest commit is
>>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
>>>
>>> The maven artifacts are available at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
>>>
>>> Please try the release and vote; the vote will run for the usual 5
>>> days, ending on 3/22/2017 6pm PST time.
>>>
>>> Thanks!
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>>>
>>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>>
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Arpit for reporting this and helping investigate the issue offline!
I follow the same tutorial so the previously RC1 maven repo has the same
issue. Just deployed jars by removing -DskipShade and shaded jars have
correct sizes.
Will post an update to RC1 voting thread.
- Wangda
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com>
> wrote:
> > Hi Lei,
> >
> > It looks like the release artefacts have dummy shaded jars. E.g.
> >
> > Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-
> client-runtime-3.0.1.jar
> > Uploaded by: lei
> > Size: 44.47 KB
> > Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> > Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> >
> > https://repository.apache.org/index.html#view-repositories;
> releases~browsestorage~/org/apache/hadoop/hadoop-client-
> runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> >
> > Am I looking at this wrong or is this supposed to be the shaded jar
> which is ~20MB?
> >
> > Thanks,
> > Arpit
> >
> >
> >
> > On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
> >
> > Hi, All
> >
> > Thanks everyone for voting! The vote passes successfully with 6
> > binding +1s, 7 non-binding +1s and no -1s.
> >
> > I will work on the staging and releases.
> >
> > Best,
> >
> >
> > On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla
> <ks...@oath.com.invalid> wrote:
> > > +1 (non-binding)
> > >
> > > Built from source.
> > > Installed on a pseudo distributed cluster.
> > > Ran word count job and basic hdfs commands.
> > >
> > > Thank you for the effort on this release.
> > >
> > > Regards,
> > > Kuhu
> > >
> > > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org>
> wrote:
> > >
> > >>
> > >> +1 (non binding)
> > >>
> > >> I did a full build from source code, created a docker container
> and did
> > >> various basic level tests with robotframework based automation and
> > >> docker-compose based pseudo clusters[1].
> > >>
> > >> Including:
> > >>
> > >> * Hdfs federation smoke test
> > >> * Basic ViewFS configuration
> > >> * Yarn example jobs
> > >> * Spark example jobs (with and without yarn)
> > >> * Simple hive table creation
> > >>
> > >> Marton
> > >>
> > >>
> > >> [1]: https://github.com/flokkr/runtime-compose
> > >>
> > >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> > >>
> > >>> Hi, all
> > >>>
> > >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> > >>>
> > >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> > >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes,
> which
> > >>> include 12
> > >>> blockers and 17 are critical.
> > >>>
> > >>> Please note:
> > >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It
> makes
> > >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases,
> Apache
> > >>> Hadoop 3.0.0 will be deprecated due to this change.
> > >>>
> > >>> The release page is:
> > >>> https://cwiki.apache.org/confluence/display/HADOOP/
> Hadoop+3.0+Release
> > >>>
> > >>> New RC is available at: http://home.apache.org/~lei/
> hadoop-3.0.1-RC1/
> > >>>
> > >>> The git tag is release-3.0.1-RC1, and the latest commit is
> > >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> > >>>
> > >>> The maven artifacts are available at:
> > >>> https://repository.apache.org/content/repositories/
> orgapachehadoop-1081/
> > >>>
> > >>> Please try the release and vote; the vote will run for the usual
> 5
> > >>> days, ending on 3/22/2017 6pm PST time.
> > >>>
> > >>> Thanks!
> > >>>
> > >>> ------------------------------------------------------------
> ---------
> > >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >>>
> > >>>
> > >> ------------------------------------------------------------
> ---------
> > >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> For additional commands, e-mail: common-dev-help@hadoop.apache.
> org
> > >>
> > >>
> >
> >
> >
> > --
> > Lei (Eddy) Xu
> > Software Engineer, Cloudera
> >
> > ------------------------------------------------------------
> ---------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
> >
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Arpit for reporting this and helping investigate the issue offline!
I follow the same tutorial so the previously RC1 maven repo has the same
issue. Just deployed jars by removing -DskipShade and shaded jars have
correct sizes.
Will post an update to RC1 voting thread.
- Wangda
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com>
> wrote:
> > Hi Lei,
> >
> > It looks like the release artefacts have dummy shaded jars. E.g.
> >
> > Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-
> client-runtime-3.0.1.jar
> > Uploaded by: lei
> > Size: 44.47 KB
> > Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> > Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> >
> > https://repository.apache.org/index.html#view-repositories;
> releases~browsestorage~/org/apache/hadoop/hadoop-client-
> runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> >
> > Am I looking at this wrong or is this supposed to be the shaded jar
> which is ~20MB?
> >
> > Thanks,
> > Arpit
> >
> >
> >
> > On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
> >
> > Hi, All
> >
> > Thanks everyone for voting! The vote passes successfully with 6
> > binding +1s, 7 non-binding +1s and no -1s.
> >
> > I will work on the staging and releases.
> >
> > Best,
> >
> >
> > On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla
> <ks...@oath.com.invalid> wrote:
> > > +1 (non-binding)
> > >
> > > Built from source.
> > > Installed on a pseudo distributed cluster.
> > > Ran word count job and basic hdfs commands.
> > >
> > > Thank you for the effort on this release.
> > >
> > > Regards,
> > > Kuhu
> > >
> > > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org>
> wrote:
> > >
> > >>
> > >> +1 (non binding)
> > >>
> > >> I did a full build from source code, created a docker container
> and did
> > >> various basic level tests with robotframework based automation and
> > >> docker-compose based pseudo clusters[1].
> > >>
> > >> Including:
> > >>
> > >> * Hdfs federation smoke test
> > >> * Basic ViewFS configuration
> > >> * Yarn example jobs
> > >> * Spark example jobs (with and without yarn)
> > >> * Simple hive table creation
> > >>
> > >> Marton
> > >>
> > >>
> > >> [1]: https://github.com/flokkr/runtime-compose
> > >>
> > >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> > >>
> > >>> Hi, all
> > >>>
> > >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> > >>>
> > >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> > >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes,
> which
> > >>> include 12
> > >>> blockers and 17 are critical.
> > >>>
> > >>> Please note:
> > >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It
> makes
> > >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases,
> Apache
> > >>> Hadoop 3.0.0 will be deprecated due to this change.
> > >>>
> > >>> The release page is:
> > >>> https://cwiki.apache.org/confluence/display/HADOOP/
> Hadoop+3.0+Release
> > >>>
> > >>> New RC is available at: http://home.apache.org/~lei/
> hadoop-3.0.1-RC1/
> > >>>
> > >>> The git tag is release-3.0.1-RC1, and the latest commit is
> > >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> > >>>
> > >>> The maven artifacts are available at:
> > >>> https://repository.apache.org/content/repositories/
> orgapachehadoop-1081/
> > >>>
> > >>> Please try the release and vote; the vote will run for the usual
> 5
> > >>> days, ending on 3/22/2017 6pm PST time.
> > >>>
> > >>> Thanks!
> > >>>
> > >>> ------------------------------------------------------------
> ---------
> > >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >>>
> > >>>
> > >> ------------------------------------------------------------
> ---------
> > >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> For additional commands, e-mail: common-dev-help@hadoop.apache.
> org
> > >>
> > >>
> >
> >
> >
> > --
> > Lei (Eddy) Xu
> > Software Engineer, Cloudera
> >
> > ------------------------------------------------------------
> ---------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
> >
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, All
Thanks Arpit to find that 3.0.1 artifacts missed shaded jars. I will
create a new 3.0.2 release with the same codebase as 3.0.1, but deploy
it as shaded jars. A new vote thread will start later this week.
After that, 3.0.3 release will be cut from branch-3.0 and includes the
new bug fixes. Please change the target version of new fixes to 3.0.3.
I will also go over JIRAs to fix targeted versions for committed changes.
Best,
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
>> Hi Lei,
>>
>> It looks like the release artefacts have dummy shaded jars. E.g.
>>
>> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>> Uploaded by: lei
>> Size: 44.47 KB
>> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>>
>> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>>
>> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>>
>> Thanks,
>> Arpit
>>
>>
>>
>> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>>
>> Hi, All
>>
>> Thanks everyone for voting! The vote passes successfully with 6
>> binding +1s, 7 non-binding +1s and no -1s.
>>
>> I will work on the staging and releases.
>>
>> Best,
>>
>>
>> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
>> > +1 (non-binding)
>> >
>> > Built from source.
>> > Installed on a pseudo distributed cluster.
>> > Ran word count job and basic hdfs commands.
>> >
>> > Thank you for the effort on this release.
>> >
>> > Regards,
>> > Kuhu
>> >
>> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
>> >
>> >>
>> >> +1 (non binding)
>> >>
>> >> I did a full build from source code, created a docker container and did
>> >> various basic level tests with robotframework based automation and
>> >> docker-compose based pseudo clusters[1].
>> >>
>> >> Including:
>> >>
>> >> * Hdfs federation smoke test
>> >> * Basic ViewFS configuration
>> >> * Yarn example jobs
>> >> * Spark example jobs (with and without yarn)
>> >> * Simple hive table creation
>> >>
>> >> Marton
>> >>
>> >>
>> >> [1]: https://github.com/flokkr/runtime-compose
>> >>
>> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
>> >>
>> >>> Hi, all
>> >>>
>> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
>> >>>
>> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
>> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
>> >>> include 12
>> >>> blockers and 17 are critical.
>> >>>
>> >>> Please note:
>> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
>> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
>> >>> Hadoop 3.0.0 will be deprecated due to this change.
>> >>>
>> >>> The release page is:
>> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
>> >>>
>> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>> >>>
>> >>> The git tag is release-3.0.1-RC1, and the latest commit is
>> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
>> >>>
>> >>> The maven artifacts are available at:
>> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
>> >>>
>> >>> Please try the release and vote; the vote will run for the usual 5
>> >>> days, ending on 3/22/2017 6pm PST time.
>> >>>
>> >>> Thanks!
>> >>>
>> >>> ---------------------------------------------------------------------
>> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>> >>>
>> >>>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >>
>> >>
>>
>>
>>
>> --
>> Lei (Eddy) Xu
>> Software Engineer, Cloudera
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, All
Thanks Arpit to find that 3.0.1 artifacts missed shaded jars. I will
create a new 3.0.2 release with the same codebase as 3.0.1, but deploy
it as shaded jars. A new vote thread will start later this week.
After that, 3.0.3 release will be cut from branch-3.0 and includes the
new bug fixes. Please change the target version of new fixes to 3.0.3.
I will also go over JIRAs to fix targeted versions for committed changes.
Best,
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
>> Hi Lei,
>>
>> It looks like the release artefacts have dummy shaded jars. E.g.
>>
>> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>> Uploaded by: lei
>> Size: 44.47 KB
>> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>>
>> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>>
>> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>>
>> Thanks,
>> Arpit
>>
>>
>>
>> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>>
>> Hi, All
>>
>> Thanks everyone for voting! The vote passes successfully with 6
>> binding +1s, 7 non-binding +1s and no -1s.
>>
>> I will work on the staging and releases.
>>
>> Best,
>>
>>
>> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
>> > +1 (non-binding)
>> >
>> > Built from source.
>> > Installed on a pseudo distributed cluster.
>> > Ran word count job and basic hdfs commands.
>> >
>> > Thank you for the effort on this release.
>> >
>> > Regards,
>> > Kuhu
>> >
>> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
>> >
>> >>
>> >> +1 (non binding)
>> >>
>> >> I did a full build from source code, created a docker container and did
>> >> various basic level tests with robotframework based automation and
>> >> docker-compose based pseudo clusters[1].
>> >>
>> >> Including:
>> >>
>> >> * Hdfs federation smoke test
>> >> * Basic ViewFS configuration
>> >> * Yarn example jobs
>> >> * Spark example jobs (with and without yarn)
>> >> * Simple hive table creation
>> >>
>> >> Marton
>> >>
>> >>
>> >> [1]: https://github.com/flokkr/runtime-compose
>> >>
>> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
>> >>
>> >>> Hi, all
>> >>>
>> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
>> >>>
>> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
>> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
>> >>> include 12
>> >>> blockers and 17 are critical.
>> >>>
>> >>> Please note:
>> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
>> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
>> >>> Hadoop 3.0.0 will be deprecated due to this change.
>> >>>
>> >>> The release page is:
>> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
>> >>>
>> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>> >>>
>> >>> The git tag is release-3.0.1-RC1, and the latest commit is
>> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
>> >>>
>> >>> The maven artifacts are available at:
>> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
>> >>>
>> >>> Please try the release and vote; the vote will run for the usual 5
>> >>> days, ending on 3/22/2017 6pm PST time.
>> >>>
>> >>> Thanks!
>> >>>
>> >>> ---------------------------------------------------------------------
>> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>> >>>
>> >>>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >>
>> >>
>>
>>
>>
>> --
>> Lei (Eddy) Xu
>> Software Engineer, Cloudera
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Arpit for reporting this and helping investigate the issue offline!
I follow the same tutorial so the previously RC1 maven repo has the same
issue. Just deployed jars by removing -DskipShade and shaded jars have
correct sizes.
Will post an update to RC1 voting thread.
- Wangda
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com>
> wrote:
> > Hi Lei,
> >
> > It looks like the release artefacts have dummy shaded jars. E.g.
> >
> > Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-
> client-runtime-3.0.1.jar
> > Uploaded by: lei
> > Size: 44.47 KB
> > Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> > Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> >
> > https://repository.apache.org/index.html#view-repositories;
> releases~browsestorage~/org/apache/hadoop/hadoop-client-
> runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> >
> > Am I looking at this wrong or is this supposed to be the shaded jar
> which is ~20MB?
> >
> > Thanks,
> > Arpit
> >
> >
> >
> > On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
> >
> > Hi, All
> >
> > Thanks everyone for voting! The vote passes successfully with 6
> > binding +1s, 7 non-binding +1s and no -1s.
> >
> > I will work on the staging and releases.
> >
> > Best,
> >
> >
> > On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla
> <ks...@oath.com.invalid> wrote:
> > > +1 (non-binding)
> > >
> > > Built from source.
> > > Installed on a pseudo distributed cluster.
> > > Ran word count job and basic hdfs commands.
> > >
> > > Thank you for the effort on this release.
> > >
> > > Regards,
> > > Kuhu
> > >
> > > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org>
> wrote:
> > >
> > >>
> > >> +1 (non binding)
> > >>
> > >> I did a full build from source code, created a docker container
> and did
> > >> various basic level tests with robotframework based automation and
> > >> docker-compose based pseudo clusters[1].
> > >>
> > >> Including:
> > >>
> > >> * Hdfs federation smoke test
> > >> * Basic ViewFS configuration
> > >> * Yarn example jobs
> > >> * Spark example jobs (with and without yarn)
> > >> * Simple hive table creation
> > >>
> > >> Marton
> > >>
> > >>
> > >> [1]: https://github.com/flokkr/runtime-compose
> > >>
> > >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> > >>
> > >>> Hi, all
> > >>>
> > >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> > >>>
> > >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> > >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes,
> which
> > >>> include 12
> > >>> blockers and 17 are critical.
> > >>>
> > >>> Please note:
> > >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It
> makes
> > >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases,
> Apache
> > >>> Hadoop 3.0.0 will be deprecated due to this change.
> > >>>
> > >>> The release page is:
> > >>> https://cwiki.apache.org/confluence/display/HADOOP/
> Hadoop+3.0+Release
> > >>>
> > >>> New RC is available at: http://home.apache.org/~lei/
> hadoop-3.0.1-RC1/
> > >>>
> > >>> The git tag is release-3.0.1-RC1, and the latest commit is
> > >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> > >>>
> > >>> The maven artifacts are available at:
> > >>> https://repository.apache.org/content/repositories/
> orgapachehadoop-1081/
> > >>>
> > >>> Please try the release and vote; the vote will run for the usual
> 5
> > >>> days, ending on 3/22/2017 6pm PST time.
> > >>>
> > >>> Thanks!
> > >>>
> > >>> ------------------------------------------------------------
> ---------
> > >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >>>
> > >>>
> > >> ------------------------------------------------------------
> ---------
> > >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> For additional commands, e-mail: common-dev-help@hadoop.apache.
> org
> > >>
> > >>
> >
> >
> >
> > --
> > Lei (Eddy) Xu
> > Software Engineer, Cloudera
> >
> > ------------------------------------------------------------
> ---------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
> >
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Wangda Tan <wh...@gmail.com>.
Thanks Arpit for reporting this and helping investigate the issue offline!
I follow the same tutorial so the previously RC1 maven repo has the same
issue. Just deployed jars by removing -DskipShade and shaded jars have
correct sizes.
Will post an update to RC1 voting thread.
- Wangda
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com>
> wrote:
> > Hi Lei,
> >
> > It looks like the release artefacts have dummy shaded jars. E.g.
> >
> > Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-
> client-runtime-3.0.1.jar
> > Uploaded by: lei
> > Size: 44.47 KB
> > Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> > Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> >
> > https://repository.apache.org/index.html#view-repositories;
> releases~browsestorage~/org/apache/hadoop/hadoop-client-
> runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> >
> > Am I looking at this wrong or is this supposed to be the shaded jar
> which is ~20MB?
> >
> > Thanks,
> > Arpit
> >
> >
> >
> > On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
> >
> > Hi, All
> >
> > Thanks everyone for voting! The vote passes successfully with 6
> > binding +1s, 7 non-binding +1s and no -1s.
> >
> > I will work on the staging and releases.
> >
> > Best,
> >
> >
> > On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla
> <ks...@oath.com.invalid> wrote:
> > > +1 (non-binding)
> > >
> > > Built from source.
> > > Installed on a pseudo distributed cluster.
> > > Ran word count job and basic hdfs commands.
> > >
> > > Thank you for the effort on this release.
> > >
> > > Regards,
> > > Kuhu
> > >
> > > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org>
> wrote:
> > >
> > >>
> > >> +1 (non binding)
> > >>
> > >> I did a full build from source code, created a docker container
> and did
> > >> various basic level tests with robotframework based automation and
> > >> docker-compose based pseudo clusters[1].
> > >>
> > >> Including:
> > >>
> > >> * Hdfs federation smoke test
> > >> * Basic ViewFS configuration
> > >> * Yarn example jobs
> > >> * Spark example jobs (with and without yarn)
> > >> * Simple hive table creation
> > >>
> > >> Marton
> > >>
> > >>
> > >> [1]: https://github.com/flokkr/runtime-compose
> > >>
> > >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> > >>
> > >>> Hi, all
> > >>>
> > >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> > >>>
> > >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> > >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes,
> which
> > >>> include 12
> > >>> blockers and 17 are critical.
> > >>>
> > >>> Please note:
> > >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It
> makes
> > >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases,
> Apache
> > >>> Hadoop 3.0.0 will be deprecated due to this change.
> > >>>
> > >>> The release page is:
> > >>> https://cwiki.apache.org/confluence/display/HADOOP/
> Hadoop+3.0+Release
> > >>>
> > >>> New RC is available at: http://home.apache.org/~lei/
> hadoop-3.0.1-RC1/
> > >>>
> > >>> The git tag is release-3.0.1-RC1, and the latest commit is
> > >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> > >>>
> > >>> The maven artifacts are available at:
> > >>> https://repository.apache.org/content/repositories/
> orgapachehadoop-1081/
> > >>>
> > >>> Please try the release and vote; the vote will run for the usual
> 5
> > >>> days, ending on 3/22/2017 6pm PST time.
> > >>>
> > >>> Thanks!
> > >>>
> > >>> ------------------------------------------------------------
> ---------
> > >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> > >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> > >>>
> > >>>
> > >> ------------------------------------------------------------
> ---------
> > >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > >> For additional commands, e-mail: common-dev-help@hadoop.apache.
> org
> > >>
> > >>
> >
> >
> >
> > --
> > Lei (Eddy) Xu
> > Software Engineer, Cloudera
> >
> > ------------------------------------------------------------
> ---------
> > To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
> >
> >
> >
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, All
Thanks Arpit to find that 3.0.1 artifacts missed shaded jars. I will
create a new 3.0.2 release with the same codebase as 3.0.1, but deploy
it as shaded jars. A new vote thread will start later this week.
After that, 3.0.3 release will be cut from branch-3.0 and includes the
new bug fixes. Please change the target version of new fixes to 3.0.3.
I will also go over JIRAs to fix targeted versions for committed changes.
Best,
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
>> Hi Lei,
>>
>> It looks like the release artefacts have dummy shaded jars. E.g.
>>
>> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>> Uploaded by: lei
>> Size: 44.47 KB
>> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>>
>> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>>
>> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>>
>> Thanks,
>> Arpit
>>
>>
>>
>> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>>
>> Hi, All
>>
>> Thanks everyone for voting! The vote passes successfully with 6
>> binding +1s, 7 non-binding +1s and no -1s.
>>
>> I will work on the staging and releases.
>>
>> Best,
>>
>>
>> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
>> > +1 (non-binding)
>> >
>> > Built from source.
>> > Installed on a pseudo distributed cluster.
>> > Ran word count job and basic hdfs commands.
>> >
>> > Thank you for the effort on this release.
>> >
>> > Regards,
>> > Kuhu
>> >
>> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
>> >
>> >>
>> >> +1 (non binding)
>> >>
>> >> I did a full build from source code, created a docker container and did
>> >> various basic level tests with robotframework based automation and
>> >> docker-compose based pseudo clusters[1].
>> >>
>> >> Including:
>> >>
>> >> * Hdfs federation smoke test
>> >> * Basic ViewFS configuration
>> >> * Yarn example jobs
>> >> * Spark example jobs (with and without yarn)
>> >> * Simple hive table creation
>> >>
>> >> Marton
>> >>
>> >>
>> >> [1]: https://github.com/flokkr/runtime-compose
>> >>
>> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
>> >>
>> >>> Hi, all
>> >>>
>> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
>> >>>
>> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
>> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
>> >>> include 12
>> >>> blockers and 17 are critical.
>> >>>
>> >>> Please note:
>> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
>> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
>> >>> Hadoop 3.0.0 will be deprecated due to this change.
>> >>>
>> >>> The release page is:
>> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
>> >>>
>> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>> >>>
>> >>> The git tag is release-3.0.1-RC1, and the latest commit is
>> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
>> >>>
>> >>> The maven artifacts are available at:
>> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
>> >>>
>> >>> Please try the release and vote; the vote will run for the usual 5
>> >>> days, ending on 3/22/2017 6pm PST time.
>> >>>
>> >>> Thanks!
>> >>>
>> >>> ---------------------------------------------------------------------
>> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>> >>>
>> >>>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >>
>> >>
>>
>>
>>
>> --
>> Lei (Eddy) Xu
>> Software Engineer, Cloudera
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, All
Thanks Arpit to find that 3.0.1 artifacts missed shaded jars. I will
create a new 3.0.2 release with the same codebase as 3.0.1, but deploy
it as shaded jars. A new vote thread will start later this week.
After that, 3.0.3 release will be cut from branch-3.0 and includes the
new bug fixes. Please change the target version of new fixes to 3.0.3.
I will also go over JIRAs to fix targeted versions for committed changes.
Best,
On Mon, Apr 2, 2018 at 6:08 PM, Lei Xu <le...@cloudera.com> wrote:
> Hi, Arpit
>
> I followed this instruction
> https://wiki.apache.org/hadoop/HowToRelease
>
> It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
>
> It seems wrong, given that 3.0.0 is a shaded jar.
> I will do another deploy to fix it.
>
>
> On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
>> Hi Lei,
>>
>> It looks like the release artefacts have dummy shaded jars. E.g.
>>
>> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>> Uploaded by: lei
>> Size: 44.47 KB
>> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>>
>> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>>
>> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>>
>> Thanks,
>> Arpit
>>
>>
>>
>> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>>
>> Hi, All
>>
>> Thanks everyone for voting! The vote passes successfully with 6
>> binding +1s, 7 non-binding +1s and no -1s.
>>
>> I will work on the staging and releases.
>>
>> Best,
>>
>>
>> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
>> > +1 (non-binding)
>> >
>> > Built from source.
>> > Installed on a pseudo distributed cluster.
>> > Ran word count job and basic hdfs commands.
>> >
>> > Thank you for the effort on this release.
>> >
>> > Regards,
>> > Kuhu
>> >
>> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
>> >
>> >>
>> >> +1 (non binding)
>> >>
>> >> I did a full build from source code, created a docker container and did
>> >> various basic level tests with robotframework based automation and
>> >> docker-compose based pseudo clusters[1].
>> >>
>> >> Including:
>> >>
>> >> * Hdfs federation smoke test
>> >> * Basic ViewFS configuration
>> >> * Yarn example jobs
>> >> * Spark example jobs (with and without yarn)
>> >> * Simple hive table creation
>> >>
>> >> Marton
>> >>
>> >>
>> >> [1]: https://github.com/flokkr/runtime-compose
>> >>
>> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
>> >>
>> >>> Hi, all
>> >>>
>> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
>> >>>
>> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
>> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
>> >>> include 12
>> >>> blockers and 17 are critical.
>> >>>
>> >>> Please note:
>> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
>> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
>> >>> Hadoop 3.0.0 will be deprecated due to this change.
>> >>>
>> >>> The release page is:
>> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
>> >>>
>> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
>> >>>
>> >>> The git tag is release-3.0.1-RC1, and the latest commit is
>> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
>> >>>
>> >>> The maven artifacts are available at:
>> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
>> >>>
>> >>> Please try the release and vote; the vote will run for the usual 5
>> >>> days, ending on 3/22/2017 6pm PST time.
>> >>>
>> >>> Thanks!
>> >>>
>> >>> ---------------------------------------------------------------------
>> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
>> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>> >>>
>> >>>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>> >>
>> >>
>>
>>
>>
>> --
>> Lei (Eddy) Xu
>> Software Engineer, Cloudera
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>>
>>
>>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, Arpit
I followed this instruction
https://wiki.apache.org/hadoop/HowToRelease
It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
It seems wrong, given that 3.0.0 is a shaded jar.
I will do another deploy to fix it.
On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
> Hi Lei,
>
> It looks like the release artefacts have dummy shaded jars. E.g.
>
> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> Uploaded by: lei
> Size: 44.47 KB
> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>
> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>
> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>
> Thanks,
> Arpit
>
>
>
> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>
> Hi, All
>
> Thanks everyone for voting! The vote passes successfully with 6
> binding +1s, 7 non-binding +1s and no -1s.
>
> I will work on the staging and releases.
>
> Best,
>
>
> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
> > +1 (non-binding)
> >
> > Built from source.
> > Installed on a pseudo distributed cluster.
> > Ran word count job and basic hdfs commands.
> >
> > Thank you for the effort on this release.
> >
> > Regards,
> > Kuhu
> >
> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
> >
> >>
> >> +1 (non binding)
> >>
> >> I did a full build from source code, created a docker container and did
> >> various basic level tests with robotframework based automation and
> >> docker-compose based pseudo clusters[1].
> >>
> >> Including:
> >>
> >> * Hdfs federation smoke test
> >> * Basic ViewFS configuration
> >> * Yarn example jobs
> >> * Spark example jobs (with and without yarn)
> >> * Simple hive table creation
> >>
> >> Marton
> >>
> >>
> >> [1]: https://github.com/flokkr/runtime-compose
> >>
> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> >>
> >>> Hi, all
> >>>
> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> >>>
> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
> >>> include 12
> >>> blockers and 17 are critical.
> >>>
> >>> Please note:
> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
> >>> Hadoop 3.0.0 will be deprecated due to this change.
> >>>
> >>> The release page is:
> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
> >>>
> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
> >>>
> >>> The git tag is release-3.0.1-RC1, and the latest commit is
> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> >>>
> >>> The maven artifacts are available at:
> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> >>> days, ending on 3/22/2017 6pm PST time.
> >>>
> >>> Thanks!
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >>>
> >>>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >>
> >>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, Arpit
I followed this instruction
https://wiki.apache.org/hadoop/HowToRelease
It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
It seems wrong, given that 3.0.0 is a shaded jar.
I will do another deploy to fix it.
On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
> Hi Lei,
>
> It looks like the release artefacts have dummy shaded jars. E.g.
>
> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> Uploaded by: lei
> Size: 44.47 KB
> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>
> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>
> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>
> Thanks,
> Arpit
>
>
>
> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>
> Hi, All
>
> Thanks everyone for voting! The vote passes successfully with 6
> binding +1s, 7 non-binding +1s and no -1s.
>
> I will work on the staging and releases.
>
> Best,
>
>
> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
> > +1 (non-binding)
> >
> > Built from source.
> > Installed on a pseudo distributed cluster.
> > Ran word count job and basic hdfs commands.
> >
> > Thank you for the effort on this release.
> >
> > Regards,
> > Kuhu
> >
> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
> >
> >>
> >> +1 (non binding)
> >>
> >> I did a full build from source code, created a docker container and did
> >> various basic level tests with robotframework based automation and
> >> docker-compose based pseudo clusters[1].
> >>
> >> Including:
> >>
> >> * Hdfs federation smoke test
> >> * Basic ViewFS configuration
> >> * Yarn example jobs
> >> * Spark example jobs (with and without yarn)
> >> * Simple hive table creation
> >>
> >> Marton
> >>
> >>
> >> [1]: https://github.com/flokkr/runtime-compose
> >>
> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> >>
> >>> Hi, all
> >>>
> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> >>>
> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
> >>> include 12
> >>> blockers and 17 are critical.
> >>>
> >>> Please note:
> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
> >>> Hadoop 3.0.0 will be deprecated due to this change.
> >>>
> >>> The release page is:
> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
> >>>
> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
> >>>
> >>> The git tag is release-3.0.1-RC1, and the latest commit is
> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> >>>
> >>> The maven artifacts are available at:
> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> >>> days, ending on 3/22/2017 6pm PST time.
> >>>
> >>> Thanks!
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >>>
> >>>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >>
> >>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, Arpit
I followed this instruction
https://wiki.apache.org/hadoop/HowToRelease
It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
It seems wrong, given that 3.0.0 is a shaded jar.
I will do another deploy to fix it.
On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
> Hi Lei,
>
> It looks like the release artefacts have dummy shaded jars. E.g.
>
> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> Uploaded by: lei
> Size: 44.47 KB
> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>
> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>
> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>
> Thanks,
> Arpit
>
>
>
> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>
> Hi, All
>
> Thanks everyone for voting! The vote passes successfully with 6
> binding +1s, 7 non-binding +1s and no -1s.
>
> I will work on the staging and releases.
>
> Best,
>
>
> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
> > +1 (non-binding)
> >
> > Built from source.
> > Installed on a pseudo distributed cluster.
> > Ran word count job and basic hdfs commands.
> >
> > Thank you for the effort on this release.
> >
> > Regards,
> > Kuhu
> >
> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
> >
> >>
> >> +1 (non binding)
> >>
> >> I did a full build from source code, created a docker container and did
> >> various basic level tests with robotframework based automation and
> >> docker-compose based pseudo clusters[1].
> >>
> >> Including:
> >>
> >> * Hdfs federation smoke test
> >> * Basic ViewFS configuration
> >> * Yarn example jobs
> >> * Spark example jobs (with and without yarn)
> >> * Simple hive table creation
> >>
> >> Marton
> >>
> >>
> >> [1]: https://github.com/flokkr/runtime-compose
> >>
> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> >>
> >>> Hi, all
> >>>
> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> >>>
> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
> >>> include 12
> >>> blockers and 17 are critical.
> >>>
> >>> Please note:
> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
> >>> Hadoop 3.0.0 will be deprecated due to this change.
> >>>
> >>> The release page is:
> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
> >>>
> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
> >>>
> >>> The git tag is release-3.0.1-RC1, and the latest commit is
> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> >>>
> >>> The maven artifacts are available at:
> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> >>> days, ending on 3/22/2017 6pm PST time.
> >>>
> >>> Thanks!
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >>>
> >>>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >>
> >>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)
Posted by Lei Xu <le...@cloudera.com>.
Hi, Arpit
I followed this instruction
https://wiki.apache.org/hadoop/HowToRelease
It instructs to use "mvn deploy -Psign -DskipTests -DskipShade".
It seems wrong, given that 3.0.0 is a shaded jar.
I will do another deploy to fix it.
On Mon, Apr 2, 2018 at 5:31 PM, Arpit Agarwal <aa...@hortonworks.com> wrote:
> Hi Lei,
>
> It looks like the release artefacts have dummy shaded jars. E.g.
>
> Repository Path: /org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
> Uploaded by: lei
> Size: 44.47 KB
> Uploaded Date: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
> Last Modified: Fri Mar 16 2018 15:50:42 GMT-0700 (PDT)
>
> https://repository.apache.org/index.html#view-repositories;releases~browsestorage~/org/apache/hadoop/hadoop-client-runtime/3.0.1/hadoop-client-runtime-3.0.1.jar
>
> Am I looking at this wrong or is this supposed to be the shaded jar which is ~20MB?
>
> Thanks,
> Arpit
>
>
>
> On 3/23/18, 10:18 AM, "Lei Xu" <le...@cloudera.com> wrote:
>
> Hi, All
>
> Thanks everyone for voting! The vote passes successfully with 6
> binding +1s, 7 non-binding +1s and no -1s.
>
> I will work on the staging and releases.
>
> Best,
>
>
> On Fri, Mar 23, 2018 at 5:10 AM, Kuhu Shukla <ks...@oath.com.invalid> wrote:
> > +1 (non-binding)
> >
> > Built from source.
> > Installed on a pseudo distributed cluster.
> > Ran word count job and basic hdfs commands.
> >
> > Thank you for the effort on this release.
> >
> > Regards,
> > Kuhu
> >
> > On Thu, Mar 22, 2018 at 5:25 PM, Elek, Marton <el...@apache.org> wrote:
> >
> >>
> >> +1 (non binding)
> >>
> >> I did a full build from source code, created a docker container and did
> >> various basic level tests with robotframework based automation and
> >> docker-compose based pseudo clusters[1].
> >>
> >> Including:
> >>
> >> * Hdfs federation smoke test
> >> * Basic ViewFS configuration
> >> * Yarn example jobs
> >> * Spark example jobs (with and without yarn)
> >> * Simple hive table creation
> >>
> >> Marton
> >>
> >>
> >> [1]: https://github.com/flokkr/runtime-compose
> >>
> >> On 03/18/2018 05:11 AM, Lei Xu wrote:
> >>
> >>> Hi, all
> >>>
> >>> I've created release candidate RC-1 for Apache Hadoop 3.0.1
> >>>
> >>> Apache Hadoop 3.0.1 will be the first bug fix release for Apache
> >>> Hadoop 3.0 release. It includes 49 bug fixes and security fixes, which
> >>> include 12
> >>> blockers and 17 are critical.
> >>>
> >>> Please note:
> >>> * HDFS-12990. Change default NameNode RPC port back to 8020. It makes
> >>> incompatible changes to Hadoop 3.0.0. After 3.0.1 releases, Apache
> >>> Hadoop 3.0.0 will be deprecated due to this change.
> >>>
> >>> The release page is:
> >>> https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3.0+Release
> >>>
> >>> New RC is available at: http://home.apache.org/~lei/hadoop-3.0.1-RC1/
> >>>
> >>> The git tag is release-3.0.1-RC1, and the latest commit is
> >>> 496dc57cc2e4f4da117f7a8e3840aaeac0c1d2d0
> >>>
> >>> The maven artifacts are available at:
> >>> https://repository.apache.org/content/repositories/orgapachehadoop-1081/
> >>>
> >>> Please try the release and vote; the vote will run for the usual 5
> >>> days, ending on 3/22/2017 6pm PST time.
> >>>
> >>> Thanks!
> >>>
> >>> ---------------------------------------------------------------------
> >>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> >>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
> >>>
> >>>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> >> For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >>
> >>
>
>
>
> --
> Lei (Eddy) Xu
> Software Engineer, Cloudera
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
>
>
--
Lei (Eddy) Xu
Software Engineer, Cloudera
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org