You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Sammi Chen <sa...@apache.org> on 2020/08/20 12:55:40 UTC
[VOTE] Apache Hadoop Ozone 1.0.0 RC0
This Ozone 1.0.0 release includes 620 JIRAs,
https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
Thanks everyone for putting in the effort and making this happen.
You can find the RC0 artifacts are at:
https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1277
The public key used for signing the artifacts can be found at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
The RC0 tag in github is at:
https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
*The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
Thanks,
Sammi Chen
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Hi Sammi,
Thanks for creating the RC. If you do spin up a new RC, could you please consider including the following 2 Jiras in the release:
HDDS-4068
HDDS-4063
Thanks,
Hanisha
> On Aug 24, 2020, at 1:01 PM, Attila Doroszlai <ad...@apache.org> wrote:
>
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <elek@apache.org <ma...@apache.org>> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Hi Sammi,
Thanks for creating the RC. If you do spin up a new RC, could you please consider including the following 2 Jiras in the release:
HDDS-4068
HDDS-4063
Thanks,
Hanisha
> On Aug 24, 2020, at 1:01 PM, Attila Doroszlai <ad...@apache.org> wrote:
>
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <elek@apache.org <ma...@apache.org>> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
@Marton， thanks for the verify.
@Attila, thanks for report the issue.
@Hanish, HDDS-4068 is still under development. I will include HDDS-4063
in next RC.
@All,
Please hold on the verification, will provide RC1 very soon.
Sammi
On Tue, Aug 25, 2020 at 5:28 PM Attila Doroszlai <ad...@cloudera.com>
wrote:
> > Is it a blocker?
>
> I don't think so, just nice to have.
>
> -Attila
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
@Marton， thanks for the verify.
@Attila, thanks for report the issue.
@Hanish, HDDS-4068 is still under development. I will include HDDS-4063
in next RC.
@All,
Please hold on the verification, will provide RC1 very soon.
Sammi
On Tue, Aug 25, 2020 at 5:28 PM Attila Doroszlai <ad...@cloudera.com>
wrote:
> > Is it a blocker?
>
> I don't think so, just nice to have.
>
> -Attila
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
@Marton， thanks for the verify.
@Attila, thanks for report the issue.
@Hanish, HDDS-4068 is still under development. I will include HDDS-4063
in next RC.
@All,
Please hold on the verification, will provide RC1 very soon.
Sammi
On Tue, Aug 25, 2020 at 5:28 PM Attila Doroszlai <ad...@cloudera.com>
wrote:
> > Is it a blocker?
>
> I don't think so, just nice to have.
>
> -Attila
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
@Marton， thanks for the verify.
@Attila, thanks for report the issue.
@Hanish, HDDS-4068 is still under development. I will include HDDS-4063
in next RC.
@All,
Please hold on the verification, will provide RC1 very soon.
Sammi
On Tue, Aug 25, 2020 at 5:28 PM Attila Doroszlai <ad...@cloudera.com>
wrote:
> > Is it a blocker?
>
> I don't think so, just nice to have.
>
> -Attila
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
@Marton， thanks for the verify.
@Attila, thanks for report the issue.
@Hanish, HDDS-4068 is still under development. I will include HDDS-4063
in next RC.
@All,
Please hold on the verification, will provide RC1 very soon.
Sammi
On Tue, Aug 25, 2020 at 5:28 PM Attila Doroszlai <ad...@cloudera.com>
wrote:
> > Is it a blocker?
>
> I don't think so, just nice to have.
>
> -Attila
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@cloudera.com.INVALID>.
> Is it a blocker?
I don't think so, just nice to have.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@cloudera.com.INVALID>.
> Is it a blocker?
I don't think so, just nice to have.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@cloudera.com.INVALID>.
> Is it a blocker?
I don't think so, just nice to have.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@cloudera.com.INVALID>.
> Is it a blocker?
I don't think so, just nice to have.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@cloudera.com.INVALID>.
> Is it a blocker?
I don't think so, just nice to have.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
Is it a blocker? It seems to be an optional test. While it can be
confusing to have 0.6.0 it's very rarely used and the functionality is
tested anyway...
What do you think?
Thanks,
Marton
On 8/24/20 10:01 PM, Attila Doroszlai wrote:
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
Is it a blocker? It seems to be an optional test. While it can be
confusing to have 0.6.0 it's very rarely used and the functionality is
tested anyway...
What do you think?
Thanks,
Marton
On 8/24/20 10:01 PM, Attila Doroszlai wrote:
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
Is it a blocker? It seems to be an optional test. While it can be
confusing to have 0.6.0 it's very rarely used and the functionality is
tested anyway...
What do you think?
Thanks,
Marton
On 8/24/20 10:01 PM, Attila Doroszlai wrote:
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Hi Sammi,
Thanks for creating the RC. If you do spin up a new RC, could you please consider including the following 2 Jiras in the release:
HDDS-4068
HDDS-4063
Thanks,
Hanisha
> On Aug 24, 2020, at 1:01 PM, Attila Doroszlai <ad...@apache.org> wrote:
>
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <elek@apache.org <ma...@apache.org>> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
Is it a blocker? It seems to be an optional test. While it can be
confusing to have 0.6.0 it's very rarely used and the functionality is
tested anyway...
What do you think?
Thanks,
Marton
On 8/24/20 10:01 PM, Attila Doroszlai wrote:
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
Is it a blocker? It seems to be an optional test. While it can be
confusing to have 0.6.0 it's very rarely used and the functionality is
tested anyway...
What do you think?
Thanks,
Marton
On 8/24/20 10:01 PM, Attila Doroszlai wrote:
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Hi Sammi,
Thanks for creating the RC. If you do spin up a new RC, could you please consider including the following 2 Jiras in the release:
HDDS-4068
HDDS-4063
Thanks,
Hanisha
> On Aug 24, 2020, at 1:01 PM, Attila Doroszlai <ad...@apache.org> wrote:
>
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <elek@apache.org <ma...@apache.org>> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Hi Sammi,
Thanks for creating the RC. If you do spin up a new RC, could you please consider including the following 2 Jiras in the release:
HDDS-4068
HDDS-4063
Thanks,
Hanisha
> On Aug 24, 2020, at 1:01 PM, Attila Doroszlai <ad...@apache.org> wrote:
>
> Hi Sammi,
>
> Thanks for creating the RC. I have found that there are some leftover
> references to version "0.6.0" in upgrade scripts and tests
> (HDDS-4139). Created a pull request to fix it, please consider
> including it in the release.
>
> thanks,
> Attila
>
> On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <elek@apache.org <ma...@apache.org>> wrote:
>>
>>
>> +1 (binding)
>>
>>
>>
>>
>> 1. verified signatures
>>
>> 2. verified checksums
>>
>> 3. verified the output of `ozone version` (includes the good git revision)
>>
>> 4. verified that the source package matches the git tag
>>
>> 5. verified source can be used to build Ozone without previous state
>> (docker run -v ... -it maven ... --> built from the source with zero
>> local maven cache during 30 minutes)
>>
>> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
>> test.sh --> all tests were passed)
>>
>> 7. Verified documentation is included in SCM UI
>>
>> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>>
>> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
>> executor) [2]
>>
>>
>> I know about a few performance problems (like HDDS-4119) but I don't
>> think we should further block the release (they are not regressions just
>> improvements). If we will have significant performance improvements
>> soon, we can release 1.0.1 within 1 month.
>>
>>
>> Thanks the great work Sammi!!
>>
>> Marton
>>
>> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
>> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>>
>>
>>
>>
>> On 8/20/20 3:12 PM, Sammi Chen wrote:
>>> my +1(binding)
>>>
>>> - Verified ozone version of binary package
>>>
>>> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>>>
>>> - Build ozone from source package
>>>
>>> - Upgrade an existing 1+3 cluster using RC0 binary package
>>>
>>> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>>>
>>> - Run TestDFSIO write/read with Hadoop 2.7.5
>>>
>>> - Verified basic o3fs operations, upload and download file
>>>
>>> - Create bucket using aws CLI, upload and download 10G file through s3g
>>>
>>> Thanks,
>>> Sammi
>>>
>>> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>>>
>>>>
>>>> This Ozone 1.0.0 release includes 620 JIRAs,
>>>>
>>>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>>>
>>>> Thanks everyone for putting in the effort and making this happen.
>>>>
>>>> You can find the RC0 artifacts are at:
>>>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>>>
>>>> Maven artifacts are staged at:
>>>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>>>
>>>> The public key used for signing the artifacts can be found at:
>>>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>>>
>>>> The RC0 tag in github is at:
>>>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>>>
>>>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>>>
>>>> Thanks,
>>>> Sammi Chen
>>>>
>>>>
>>>>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@apache.org>.
Hi Sammi,
Thanks for creating the RC. I have found that there are some leftover
references to version "0.6.0" in upgrade scripts and tests
(HDDS-4139). Created a pull request to fix it, please consider
including it in the release.
thanks,
Attila
On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>
>
> +1 (binding)
>
>
>
>
> 1. verified signatures
>
> 2. verified checksums
>
> 3. verified the output of `ozone version` (includes the good git revision)
>
> 4. verified that the source package matches the git tag
>
> 5. verified source can be used to build Ozone without previous state
> (docker run -v ... -it maven ... --> built from the source with zero
> local maven cache during 30 minutes)
>
> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
> test.sh --> all tests were passed)
>
> 7. Verified documentation is included in SCM UI
>
> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>
> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
> executor) [2]
>
>
> I know about a few performance problems (like HDDS-4119) but I don't
> think we should further block the release (they are not regressions just
> improvements). If we will have significant performance improvements
> soon, we can release 1.0.1 within 1 month.
>
>
> Thanks the great work Sammi!!
>
> Marton
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>
>
>
>
> On 8/20/20 3:12 PM, Sammi Chen wrote:
> > my +1(binding)
> >
> > - Verified ozone version of binary package
> >
> > - Verified ozone source package content with ozone-1.0.0-RC0 tag
> >
> > - Build ozone from source package
> >
> > - Upgrade an existing 1+3 cluster using RC0 binary package
> >
> > - Check Ozone UI, SCM UI, Datanode UI and Recon UI
> >
> > - Run TestDFSIO write/read with Hadoop 2.7.5
> >
> > - Verified basic o3fs operations, upload and download file
> >
> > - Create bucket using aws CLI, upload and download 10G file through s3g
> >
> > Thanks,
> > Sammi
> >
> > On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
> >
> >>
> >> This Ozone 1.0.0 release includes 620 JIRAs,
> >>
> >> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
> >>
> >> Thanks everyone for putting in the effort and making this happen.
> >>
> >> You can find the RC0 artifacts are at:
> >> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
> >>
> >> Maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1277
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The RC0 tag in github is at:
> >> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
> >>
> >> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
> >>
> >> Thanks,
> >> Sammi Chen
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@apache.org>.
Hi Sammi,
Thanks for creating the RC. I have found that there are some leftover
references to version "0.6.0" in upgrade scripts and tests
(HDDS-4139). Created a pull request to fix it, please consider
including it in the release.
thanks,
Attila
On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>
>
> +1 (binding)
>
>
>
>
> 1. verified signatures
>
> 2. verified checksums
>
> 3. verified the output of `ozone version` (includes the good git revision)
>
> 4. verified that the source package matches the git tag
>
> 5. verified source can be used to build Ozone without previous state
> (docker run -v ... -it maven ... --> built from the source with zero
> local maven cache during 30 minutes)
>
> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
> test.sh --> all tests were passed)
>
> 7. Verified documentation is included in SCM UI
>
> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>
> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
> executor) [2]
>
>
> I know about a few performance problems (like HDDS-4119) but I don't
> think we should further block the release (they are not regressions just
> improvements). If we will have significant performance improvements
> soon, we can release 1.0.1 within 1 month.
>
>
> Thanks the great work Sammi!!
>
> Marton
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>
>
>
>
> On 8/20/20 3:12 PM, Sammi Chen wrote:
> > my +1(binding)
> >
> > - Verified ozone version of binary package
> >
> > - Verified ozone source package content with ozone-1.0.0-RC0 tag
> >
> > - Build ozone from source package
> >
> > - Upgrade an existing 1+3 cluster using RC0 binary package
> >
> > - Check Ozone UI, SCM UI, Datanode UI and Recon UI
> >
> > - Run TestDFSIO write/read with Hadoop 2.7.5
> >
> > - Verified basic o3fs operations, upload and download file
> >
> > - Create bucket using aws CLI, upload and download 10G file through s3g
> >
> > Thanks,
> > Sammi
> >
> > On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
> >
> >>
> >> This Ozone 1.0.0 release includes 620 JIRAs,
> >>
> >> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
> >>
> >> Thanks everyone for putting in the effort and making this happen.
> >>
> >> You can find the RC0 artifacts are at:
> >> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
> >>
> >> Maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1277
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The RC0 tag in github is at:
> >> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
> >>
> >> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
> >>
> >> Thanks,
> >> Sammi Chen
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@apache.org>.
Hi Sammi,
Thanks for creating the RC. I have found that there are some leftover
references to version "0.6.0" in upgrade scripts and tests
(HDDS-4139). Created a pull request to fix it, please consider
including it in the release.
thanks,
Attila
On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>
>
> +1 (binding)
>
>
>
>
> 1. verified signatures
>
> 2. verified checksums
>
> 3. verified the output of `ozone version` (includes the good git revision)
>
> 4. verified that the source package matches the git tag
>
> 5. verified source can be used to build Ozone without previous state
> (docker run -v ... -it maven ... --> built from the source with zero
> local maven cache during 30 minutes)
>
> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
> test.sh --> all tests were passed)
>
> 7. Verified documentation is included in SCM UI
>
> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>
> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
> executor) [2]
>
>
> I know about a few performance problems (like HDDS-4119) but I don't
> think we should further block the release (they are not regressions just
> improvements). If we will have significant performance improvements
> soon, we can release 1.0.1 within 1 month.
>
>
> Thanks the great work Sammi!!
>
> Marton
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>
>
>
>
> On 8/20/20 3:12 PM, Sammi Chen wrote:
> > my +1(binding)
> >
> > - Verified ozone version of binary package
> >
> > - Verified ozone source package content with ozone-1.0.0-RC0 tag
> >
> > - Build ozone from source package
> >
> > - Upgrade an existing 1+3 cluster using RC0 binary package
> >
> > - Check Ozone UI, SCM UI, Datanode UI and Recon UI
> >
> > - Run TestDFSIO write/read with Hadoop 2.7.5
> >
> > - Verified basic o3fs operations, upload and download file
> >
> > - Create bucket using aws CLI, upload and download 10G file through s3g
> >
> > Thanks,
> > Sammi
> >
> > On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
> >
> >>
> >> This Ozone 1.0.0 release includes 620 JIRAs,
> >>
> >> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
> >>
> >> Thanks everyone for putting in the effort and making this happen.
> >>
> >> You can find the RC0 artifacts are at:
> >> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
> >>
> >> Maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1277
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The RC0 tag in github is at:
> >> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
> >>
> >> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
> >>
> >> Thanks,
> >> Sammi Chen
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@apache.org>.
Hi Sammi,
Thanks for creating the RC. I have found that there are some leftover
references to version "0.6.0" in upgrade scripts and tests
(HDDS-4139). Created a pull request to fix it, please consider
including it in the release.
thanks,
Attila
On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>
>
> +1 (binding)
>
>
>
>
> 1. verified signatures
>
> 2. verified checksums
>
> 3. verified the output of `ozone version` (includes the good git revision)
>
> 4. verified that the source package matches the git tag
>
> 5. verified source can be used to build Ozone without previous state
> (docker run -v ... -it maven ... --> built from the source with zero
> local maven cache during 30 minutes)
>
> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
> test.sh --> all tests were passed)
>
> 7. Verified documentation is included in SCM UI
>
> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>
> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
> executor) [2]
>
>
> I know about a few performance problems (like HDDS-4119) but I don't
> think we should further block the release (they are not regressions just
> improvements). If we will have significant performance improvements
> soon, we can release 1.0.1 within 1 month.
>
>
> Thanks the great work Sammi!!
>
> Marton
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>
>
>
>
> On 8/20/20 3:12 PM, Sammi Chen wrote:
> > my +1(binding)
> >
> > - Verified ozone version of binary package
> >
> > - Verified ozone source package content with ozone-1.0.0-RC0 tag
> >
> > - Build ozone from source package
> >
> > - Upgrade an existing 1+3 cluster using RC0 binary package
> >
> > - Check Ozone UI, SCM UI, Datanode UI and Recon UI
> >
> > - Run TestDFSIO write/read with Hadoop 2.7.5
> >
> > - Verified basic o3fs operations, upload and download file
> >
> > - Create bucket using aws CLI, upload and download 10G file through s3g
> >
> > Thanks,
> > Sammi
> >
> > On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
> >
> >>
> >> This Ozone 1.0.0 release includes 620 JIRAs,
> >>
> >> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
> >>
> >> Thanks everyone for putting in the effort and making this happen.
> >>
> >> You can find the RC0 artifacts are at:
> >> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
> >>
> >> Maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1277
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The RC0 tag in github is at:
> >> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
> >>
> >> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
> >>
> >> Thanks,
> >> Sammi Chen
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Attila Doroszlai <ad...@apache.org>.
Hi Sammi,
Thanks for creating the RC. I have found that there are some leftover
references to version "0.6.0" in upgrade scripts and tests
(HDDS-4139). Created a pull request to fix it, please consider
including it in the release.
thanks,
Attila
On Mon, Aug 24, 2020 at 3:55 PM Elek, Marton <el...@apache.org> wrote:
>
>
> +1 (binding)
>
>
>
>
> 1. verified signatures
>
> 2. verified checksums
>
> 3. verified the output of `ozone version` (includes the good git revision)
>
> 4. verified that the source package matches the git tag
>
> 5. verified source can be used to build Ozone without previous state
> (docker run -v ... -it maven ... --> built from the source with zero
> local maven cache during 30 minutes)
>
> 6. Verified Ozone can be used from binary package (cd compose/ozone &&
> test.sh --> all tests were passed)
>
> 7. Verified documentation is included in SCM UI
>
> 8. Deployed to Kubernetes and executed Teragen on Yarn [1]
>
> 9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
> executor) [2]
>
>
> I know about a few performance problems (like HDDS-4119) but I don't
> think we should further block the release (they are not regressions just
> improvements). If we will have significant performance improvements
> soon, we can release 1.0.1 within 1 month.
>
>
> Thanks the great work Sammi!!
>
> Marton
>
> [1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
> [2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
>
>
>
>
> On 8/20/20 3:12 PM, Sammi Chen wrote:
> > my +1(binding)
> >
> > - Verified ozone version of binary package
> >
> > - Verified ozone source package content with ozone-1.0.0-RC0 tag
> >
> > - Build ozone from source package
> >
> > - Upgrade an existing 1+3 cluster using RC0 binary package
> >
> > - Check Ozone UI, SCM UI, Datanode UI and Recon UI
> >
> > - Run TestDFSIO write/read with Hadoop 2.7.5
> >
> > - Verified basic o3fs operations, upload and download file
> >
> > - Create bucket using aws CLI, upload and download 10G file through s3g
> >
> > Thanks,
> > Sammi
> >
> > On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
> >
> >>
> >> This Ozone 1.0.0 release includes 620 JIRAs,
> >>
> >> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
> >>
> >> Thanks everyone for putting in the effort and making this happen.
> >>
> >> You can find the RC0 artifacts are at:
> >> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
> >>
> >> Maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1277
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The RC0 tag in github is at:
> >> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
> >>
> >> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
> >>
> >> Thanks,
> >> Sammi Chen
> >>
> >>
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
1. verified signatures
2. verified checksums
3. verified the output of `ozone version` (includes the good git revision)
4. verified that the source package matches the git tag
5. verified source can be used to build Ozone without previous state
(docker run -v ... -it maven ... --> built from the source with zero
local maven cache during 30 minutes)
6. Verified Ozone can be used from binary package (cd compose/ozone &&
test.sh --> all tests were passed)
7. Verified documentation is included in SCM UI
8. Deployed to Kubernetes and executed Teragen on Yarn [1]
9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
executor) [2]
I know about a few performance problems (like HDDS-4119) but I don't
think we should further block the release (they are not regressions just
improvements). If we will have significant performance improvements
soon, we can release 1.0.1 within 1 month.
Thanks the great work Sammi!!
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
[2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
On 8/20/20 3:12 PM, Sammi Chen wrote:
> my +1(binding)
>
> - Verified ozone version of binary package
>
> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>
> - Build ozone from source package
>
> - Upgrade an existing 1+3 cluster using RC0 binary package
>
> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>
> - Run TestDFSIO write/read with Hadoop 2.7.5
>
> - Verified basic o3fs operations, upload and download file
>
> - Create bucket using aws CLI, upload and download 10G file through s3g
>
> Thanks,
> Sammi
>
> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
>>
>> This Ozone 1.0.0 release includes 620 JIRAs,
>>
>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>
>> Thanks everyone for putting in the effort and making this happen.
>>
>> You can find the RC0 artifacts are at:
>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>
>> Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The RC0 tag in github is at:
>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>
>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>
>> Thanks,
>> Sammi Chen
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
1. verified signatures
2. verified checksums
3. verified the output of `ozone version` (includes the good git revision)
4. verified that the source package matches the git tag
5. verified source can be used to build Ozone without previous state
(docker run -v ... -it maven ... --> built from the source with zero
local maven cache during 30 minutes)
6. Verified Ozone can be used from binary package (cd compose/ozone &&
test.sh --> all tests were passed)
7. Verified documentation is included in SCM UI
8. Deployed to Kubernetes and executed Teragen on Yarn [1]
9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
executor) [2]
I know about a few performance problems (like HDDS-4119) but I don't
think we should further block the release (they are not regressions just
improvements). If we will have significant performance improvements
soon, we can release 1.0.1 within 1 month.
Thanks the great work Sammi!!
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
[2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
On 8/20/20 3:12 PM, Sammi Chen wrote:
> my +1(binding)
>
> - Verified ozone version of binary package
>
> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>
> - Build ozone from source package
>
> - Upgrade an existing 1+3 cluster using RC0 binary package
>
> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>
> - Run TestDFSIO write/read with Hadoop 2.7.5
>
> - Verified basic o3fs operations, upload and download file
>
> - Create bucket using aws CLI, upload and download 10G file through s3g
>
> Thanks,
> Sammi
>
> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
>>
>> This Ozone 1.0.0 release includes 620 JIRAs,
>>
>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>
>> Thanks everyone for putting in the effort and making this happen.
>>
>> You can find the RC0 artifacts are at:
>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>
>> Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The RC0 tag in github is at:
>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>
>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>
>> Thanks,
>> Sammi Chen
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
1. verified signatures
2. verified checksums
3. verified the output of `ozone version` (includes the good git revision)
4. verified that the source package matches the git tag
5. verified source can be used to build Ozone without previous state
(docker run -v ... -it maven ... --> built from the source with zero
local maven cache during 30 minutes)
6. Verified Ozone can be used from binary package (cd compose/ozone &&
test.sh --> all tests were passed)
7. Verified documentation is included in SCM UI
8. Deployed to Kubernetes and executed Teragen on Yarn [1]
9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
executor) [2]
I know about a few performance problems (like HDDS-4119) but I don't
think we should further block the release (they are not regressions just
improvements). If we will have significant performance improvements
soon, we can release 1.0.1 within 1 month.
Thanks the great work Sammi!!
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
[2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
On 8/20/20 3:12 PM, Sammi Chen wrote:
> my +1(binding)
>
> - Verified ozone version of binary package
>
> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>
> - Build ozone from source package
>
> - Upgrade an existing 1+3 cluster using RC0 binary package
>
> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>
> - Run TestDFSIO write/read with Hadoop 2.7.5
>
> - Verified basic o3fs operations, upload and download file
>
> - Create bucket using aws CLI, upload and download 10G file through s3g
>
> Thanks,
> Sammi
>
> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
>>
>> This Ozone 1.0.0 release includes 620 JIRAs,
>>
>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>
>> Thanks everyone for putting in the effort and making this happen.
>>
>> You can find the RC0 artifacts are at:
>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>
>> Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The RC0 tag in github is at:
>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>
>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>
>> Thanks,
>> Sammi Chen
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
1. verified signatures
2. verified checksums
3. verified the output of `ozone version` (includes the good git revision)
4. verified that the source package matches the git tag
5. verified source can be used to build Ozone without previous state
(docker run -v ... -it maven ... --> built from the source with zero
local maven cache during 30 minutes)
6. Verified Ozone can be used from binary package (cd compose/ozone &&
test.sh --> all tests were passed)
7. Verified documentation is included in SCM UI
8. Deployed to Kubernetes and executed Teragen on Yarn [1]
9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
executor) [2]
I know about a few performance problems (like HDDS-4119) but I don't
think we should further block the release (they are not regressions just
improvements). If we will have significant performance improvements
soon, we can release 1.0.1 within 1 month.
Thanks the great work Sammi!!
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
[2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
On 8/20/20 3:12 PM, Sammi Chen wrote:
> my +1(binding)
>
> - Verified ozone version of binary package
>
> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>
> - Build ozone from source package
>
> - Upgrade an existing 1+3 cluster using RC0 binary package
>
> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>
> - Run TestDFSIO write/read with Hadoop 2.7.5
>
> - Verified basic o3fs operations, upload and download file
>
> - Create bucket using aws CLI, upload and download 10G file through s3g
>
> Thanks,
> Sammi
>
> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
>>
>> This Ozone 1.0.0 release includes 620 JIRAs,
>>
>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>
>> Thanks everyone for putting in the effort and making this happen.
>>
>> You can find the RC0 artifacts are at:
>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>
>> Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The RC0 tag in github is at:
>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>
>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>
>> Thanks,
>> Sammi Chen
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by "Elek, Marton" <el...@apache.org>.
+1 (binding)
1. verified signatures
2. verified checksums
3. verified the output of `ozone version` (includes the good git revision)
4. verified that the source package matches the git tag
5. verified source can be used to build Ozone without previous state
(docker run -v ... -it maven ... --> built from the source with zero
local maven cache during 30 minutes)
6. Verified Ozone can be used from binary package (cd compose/ozone &&
test.sh --> all tests were passed)
7. Verified documentation is included in SCM UI
8. Deployed to Kubernetes and executed Teragen on Yarn [1]
9. Deployed to Kubernetes and executed Spark (3.0) Word count (local
executor) [2]
I know about a few performance problems (like HDDS-4119) but I don't
think we should further block the release (they are not regressions just
improvements). If we will have significant performance improvements
soon, we can release 1.0.1 within 1 month.
Thanks the great work Sammi!!
Marton
[1]: https://github.com/elek/ozone-perf-env/tree/master/teragen-ozone
[2]: https://github.com/elek/ozone-perf-env/tree/master/spark-ozone
On 8/20/20 3:12 PM, Sammi Chen wrote:
> my +1(binding)
>
> - Verified ozone version of binary package
>
> - Verified ozone source package content with ozone-1.0.0-RC0 tag
>
> - Build ozone from source package
>
> - Upgrade an existing 1+3 cluster using RC0 binary package
>
> - Check Ozone UI, SCM UI, Datanode UI and Recon UI
>
> - Run TestDFSIO write/read with Hadoop 2.7.5
>
> - Verified basic o3fs operations, upload and download file
>
> - Create bucket using aws CLI, upload and download 10G file through s3g
>
> Thanks,
> Sammi
>
> On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
>>
>> This Ozone 1.0.0 release includes 620 JIRAs,
>>
>> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>>
>> Thanks everyone for putting in the effort and making this happen.
>>
>> You can find the RC0 artifacts are at:
>> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>>
>> Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The RC0 tag in github is at:
>> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>>
>> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>>
>> Thanks,
>> Sammi Chen
>>
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
my +1(binding)
- Verified ozone version of binary package
- Verified ozone source package content with ozone-1.0.0-RC0 tag
- Build ozone from source package
- Upgrade an existing 1+3 cluster using RC0 binary package
- Check Ozone UI, SCM UI, Datanode UI and Recon UI
- Run TestDFSIO write/read with Hadoop 2.7.5
- Verified basic o3fs operations, upload and download file
- Create bucket using aws CLI, upload and download 10G file through s3g
Thanks,
Sammi
On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
> This Ozone 1.0.0 release includes 620 JIRAs,
>
> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>
> Thanks everyone for putting in the effort and making this happen.
>
> You can find the RC0 artifacts are at:
> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>
> Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The RC0 tag in github is at:
> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>
> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>
> Thanks,
> Sammi Chen
>
>
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
my +1(binding)
- Verified ozone version of binary package
- Verified ozone source package content with ozone-1.0.0-RC0 tag
- Build ozone from source package
- Upgrade an existing 1+3 cluster using RC0 binary package
- Check Ozone UI, SCM UI, Datanode UI and Recon UI
- Run TestDFSIO write/read with Hadoop 2.7.5
- Verified basic o3fs operations, upload and download file
- Create bucket using aws CLI, upload and download 10G file through s3g
Thanks,
Sammi
On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
> This Ozone 1.0.0 release includes 620 JIRAs,
>
> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>
> Thanks everyone for putting in the effort and making this happen.
>
> You can find the RC0 artifacts are at:
> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>
> Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The RC0 tag in github is at:
> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>
> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>
> Thanks,
> Sammi Chen
>
>
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
my +1(binding)
- Verified ozone version of binary package
- Verified ozone source package content with ozone-1.0.0-RC0 tag
- Build ozone from source package
- Upgrade an existing 1+3 cluster using RC0 binary package
- Check Ozone UI, SCM UI, Datanode UI and Recon UI
- Run TestDFSIO write/read with Hadoop 2.7.5
- Verified basic o3fs operations, upload and download file
- Create bucket using aws CLI, upload and download 10G file through s3g
Thanks,
Sammi
On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
> This Ozone 1.0.0 release includes 620 JIRAs,
>
> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>
> Thanks everyone for putting in the effort and making this happen.
>
> You can find the RC0 artifacts are at:
> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>
> Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The RC0 tag in github is at:
> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>
> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>
> Thanks,
> Sammi Chen
>
>
>
Fwd: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
This Ozone 1.0.0 release includes 620 JIRAs,
https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
Thanks everyone for putting in the effort and making this happen.
You can find the RC0 artifacts are at:
https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1277
The public key used for signing the artifacts can be found at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
The RC0 tag in github is at:
https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
*The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
Thanks,
Sammi Chen
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
my +1(binding)
- Verified ozone version of binary package
- Verified ozone source package content with ozone-1.0.0-RC0 tag
- Build ozone from source package
- Upgrade an existing 1+3 cluster using RC0 binary package
- Check Ozone UI, SCM UI, Datanode UI and Recon UI
- Run TestDFSIO write/read with Hadoop 2.7.5
- Verified basic o3fs operations, upload and download file
- Create bucket using aws CLI, upload and download 10G file through s3g
Thanks,
Sammi
On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
> This Ozone 1.0.0 release includes 620 JIRAs,
>
> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>
> Thanks everyone for putting in the effort and making this happen.
>
> You can find the RC0 artifacts are at:
> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>
> Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The RC0 tag in github is at:
> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>
> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>
> Thanks,
> Sammi Chen
>
>
>
Re: [VOTE] Apache Hadoop Ozone 1.0.0 RC0
Posted by Sammi Chen <sa...@apache.org>.
my +1(binding)
- Verified ozone version of binary package
- Verified ozone source package content with ozone-1.0.0-RC0 tag
- Build ozone from source package
- Upgrade an existing 1+3 cluster using RC0 binary package
- Check Ozone UI, SCM UI, Datanode UI and Recon UI
- Run TestDFSIO write/read with Hadoop 2.7.5
- Verified basic o3fs operations, upload and download file
- Create bucket using aws CLI, upload and download 10G file through s3g
Thanks,
Sammi
On Thu, Aug 20, 2020 at 8:55 PM Sammi Chen <sa...@apache.org> wrote:
>
> This Ozone 1.0.0 release includes 620 JIRAs,
>
> https://issues.apache.org/jira/issues/?jql=project+%3D+HDDS+AND+%28cf%5B12310320%5D+%3D+0.6.0+or+fixVersion+%3D+0.6.0%29
>
> Thanks everyone for putting in the effort and making this happen.
>
> You can find the RC0 artifacts are at:
> https://home.apache.org/~sammichen/ozone-1.0.0-rc0/
>
> Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1277
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The RC0 tag in github is at:
> https://github.com/apache/hadoop-ozone/releases/tag/ozone-1.0.0-RC0
>
> *The vote will run for 7 days, ending on Aug 27th 2020 at 11:59 pm CST.*
>
> Thanks,
> Sammi Chen
>
>
>