You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Ajay Kumar <aj...@hortonworks.com> on 2019/04/15 23:09:23 UTC
VOTE: Hadoop Ozone 0.4.0-alpha RC1
Hi all,
We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
This release contains security payload for Ozone. Below are some important features in it:
* Hadoop Delegation Tokens and Block Tokens supported for Ozone.
* Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
* Kerberos support for Ozone.
* Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
* Datanode to Datanode communication secured via mutual TLS.
* Ability secure ozone cluster that works with Yarn, Hive, and Spark.
* Skaffold support to deploy Ozone clusters on K8s.
* Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
* S3 Gateway supports Multipart upload.
* S3A file system is tested and supported.
* Support for Tracing and Profiling for all Ozone components.
* Audit Support - including Audit Parser tools.
* Apache Ranger Support in Ozone.
* Extensive failure testing for Ozone.
The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
Thank you very much,
Ajay
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Ajay Kumar <aj...@hortonworks.com>.
Hi Arpit, Thanks for trying it. Will cut new RC with HDDS-1425 included.
On 4/22/19, 11:38 AM, "Arpit Agarwal" <aa...@cloudera.com.INVALID> wrote:
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Ajay Kumar <aj...@hortonworks.com>.
Hi Arpit, Thanks for trying it. Will cut new RC with HDDS-1425 included.
On 4/22/19, 11:38 AM, "Arpit Agarwal" <aa...@cloudera.com.INVALID> wrote:
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Ajay Kumar <aj...@hortonworks.com>.
Hi Arpit, Thanks for trying it. Will cut new RC with HDDS-1425 included.
On 4/22/19, 11:38 AM, "Arpit Agarwal" <aa...@cloudera.com.INVALID> wrote:
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Ajay Kumar <aj...@hortonworks.com>.
Hi Arpit, Thanks for trying it. Will cut new RC with HDDS-1425 included.
On 4/22/19, 11:38 AM, "Arpit Agarwal" <aa...@cloudera.com.INVALID> wrote:
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
Thanks Ajay for putting together this RC.
Unfortunately HDDS-1425 <https://issues.apache.org/jira/browse/HDDS-1425> looks like a blocker. We should make the docker experience smooth for anyone trying out 0.4.0.
I’ve just committed Marton’s patch for HDDS-1425 this morning. Let’s roll a new RC.
> On Apr 15, 2019, at 4:09 PM, Ajay Kumar <aj...@hortonworks.com> wrote:
>
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>, vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Shashikant Banerjee <sb...@hortonworks.com>.
+1 (non-binding)
- Verified checksums
- Built from sources
- Ran smoke tests
- Ran basic ozone shell commands in a single node cluster.
Thanks Ajay for all the work being done for the release.
Thanks
Shashi
On 4/20/19, 11:13 PM, "Dinesh Chitlangia" <dc...@hortonworks.com> wrote:
+1 (non-binding)
- Verified checksums
- Built from sources and ran all smoketests
- Repeated smoketest on the binary rc
- Verified audit logs and audit parser
- Toggle audit logging on/off, selectively on/off without having to restart the microservices
Thanks Ajay for organizing the release.
Cheers,
Dinesh
On 4/20/19, 11:19 AM, "Elek, Marton" <el...@apache.org> wrote:
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Shashikant Banerjee <sb...@hortonworks.com>.
+1 (non-binding)
- Verified checksums
- Built from sources
- Ran smoke tests
- Ran basic ozone shell commands in a single node cluster.
Thanks Ajay for all the work being done for the release.
Thanks
Shashi
On 4/20/19, 11:13 PM, "Dinesh Chitlangia" <dc...@hortonworks.com> wrote:
+1 (non-binding)
- Verified checksums
- Built from sources and ran all smoketests
- Repeated smoketest on the binary rc
- Verified audit logs and audit parser
- Toggle audit logging on/off, selectively on/off without having to restart the microservices
Thanks Ajay for organizing the release.
Cheers,
Dinesh
On 4/20/19, 11:19 AM, "Elek, Marton" <el...@apache.org> wrote:
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Shashikant Banerjee <sb...@hortonworks.com>.
+1 (non-binding)
- Verified checksums
- Built from sources
- Ran smoke tests
- Ran basic ozone shell commands in a single node cluster.
Thanks Ajay for all the work being done for the release.
Thanks
Shashi
On 4/20/19, 11:13 PM, "Dinesh Chitlangia" <dc...@hortonworks.com> wrote:
+1 (non-binding)
- Verified checksums
- Built from sources and ran all smoketests
- Repeated smoketest on the binary rc
- Verified audit logs and audit parser
- Toggle audit logging on/off, selectively on/off without having to restart the microservices
Thanks Ajay for organizing the release.
Cheers,
Dinesh
On 4/20/19, 11:19 AM, "Elek, Marton" <el...@apache.org> wrote:
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Shashikant Banerjee <sb...@hortonworks.com>.
+1 (non-binding)
- Verified checksums
- Built from sources
- Ran smoke tests
- Ran basic ozone shell commands in a single node cluster.
Thanks Ajay for all the work being done for the release.
Thanks
Shashi
On 4/20/19, 11:13 PM, "Dinesh Chitlangia" <dc...@hortonworks.com> wrote:
+1 (non-binding)
- Verified checksums
- Built from sources and ran all smoketests
- Repeated smoketest on the binary rc
- Verified audit logs and audit parser
- Toggle audit logging on/off, selectively on/off without having to restart the microservices
Thanks Ajay for organizing the release.
Cheers,
Dinesh
On 4/20/19, 11:19 AM, "Elek, Marton" <el...@apache.org> wrote:
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Dinesh Chitlangia <dc...@hortonworks.com>.
+1 (non-binding)
- Verified checksums
- Built from sources and ran all smoketests
- Repeated smoketest on the binary rc
- Verified audit logs and audit parser
- Toggle audit logging on/off, selectively on/off without having to restart the microservices
Thanks Ajay for organizing the release.
Cheers,
Dinesh
On 4/20/19, 11:19 AM, "Elek, Marton" <el...@apache.org> wrote:
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by "Elek, Marton" <el...@apache.org>.
+1 (non-binding)
- build from source
- run all the smoketest (from the fresh build based on the src package)
- run all the smoketest from the binary package
- signature files are checked
- sha512 checksums are verified
- ozone version shows the right commit information
Thanks Ajay all the releasing work,
Marton
ps: used archlinux, java 8, docker-compose 1.23.2, docker 18.09.4-ce
On 4/20/19 3:24 PM, Xiaoyu Yao wrote:
>
> +1 (binding)
>
> - Build from source
> - Misc security tests with docker compose
> - MR and Spark sample jobs with secure ozone cluster
>
> —Xiaoyu
>
>> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>>
>> +1 (Binding)
>>
>> -- Verified the checksums.
>> -- Built from sources.
>> -- Sniff tested the functionality.
>>
>> --Anu
>>
>>
>> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
>> wrote:
>>
>>> Hi all,
>>>
>>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>>> 0.4.0-alpha.
>>>
>>> This release contains security payload for Ozone. Below are some important
>>> features in it:
>>>
>>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>>> encrypted-at-rest.
>>> * Kerberos support for Ozone.
>>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>>> shared secrets.
>>> * Datanode to Datanode communication secured via mutual TLS.
>>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>>> * Skaffold support to deploy Ozone clusters on K8s.
>>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>>> protocol.
>>> * S3 Gateway supports Multipart upload.
>>> * S3A file system is tested and supported.
>>> * Support for Tracing and Profiling for all Ozone components.
>>> * Audit Support - including Audit Parser tools.
>>> * Apache Ranger Support in Ozone.
>>> * Extensive failure testing for Ozone.
>>>
>>> The RC artifacts are available at
>>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>>
>>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>>
>>> Please try out<
>>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>>> vote, or just give us feedback.
>>>
>>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>>
>>> Thank you very much,
>>>
>>> Ajay
>>>
>>>
>>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Xiaoyu Yao <xy...@hortonworks.com>.
+1 (binding)
- Build from source
- Misc security tests with docker compose
- MR and Spark sample jobs with secure ozone cluster
—Xiaoyu
> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>
> +1 (Binding)
>
> -- Verified the checksums.
> -- Built from sources.
> -- Sniff tested the functionality.
>
> --Anu
>
>
> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> Hi all,
>>
>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>> 0.4.0-alpha.
>>
>> This release contains security payload for Ozone. Below are some important
>> features in it:
>>
>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>> encrypted-at-rest.
>> * Kerberos support for Ozone.
>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>> shared secrets.
>> * Datanode to Datanode communication secured via mutual TLS.
>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>> * Skaffold support to deploy Ozone clusters on K8s.
>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>> protocol.
>> * S3 Gateway supports Multipart upload.
>> * S3A file system is tested and supported.
>> * Support for Tracing and Profiling for all Ozone components.
>> * Audit Support - including Audit Parser tools.
>> * Apache Ranger Support in Ozone.
>> * Extensive failure testing for Ozone.
>>
>> The RC artifacts are available at
>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>
>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>
>> Please try out<
>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>> vote, or just give us feedback.
>>
>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>
>> Thank you very much,
>>
>> Ajay
>>
>>
>>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Xiaoyu Yao <xy...@hortonworks.com>.
+1 (binding)
- Build from source
- Misc security tests with docker compose
- MR and Spark sample jobs with secure ozone cluster
—Xiaoyu
> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>
> +1 (Binding)
>
> -- Verified the checksums.
> -- Built from sources.
> -- Sniff tested the functionality.
>
> --Anu
>
>
> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> Hi all,
>>
>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>> 0.4.0-alpha.
>>
>> This release contains security payload for Ozone. Below are some important
>> features in it:
>>
>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>> encrypted-at-rest.
>> * Kerberos support for Ozone.
>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>> shared secrets.
>> * Datanode to Datanode communication secured via mutual TLS.
>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>> * Skaffold support to deploy Ozone clusters on K8s.
>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>> protocol.
>> * S3 Gateway supports Multipart upload.
>> * S3A file system is tested and supported.
>> * Support for Tracing and Profiling for all Ozone components.
>> * Audit Support - including Audit Parser tools.
>> * Apache Ranger Support in Ozone.
>> * Extensive failure testing for Ozone.
>>
>> The RC artifacts are available at
>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>
>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>
>> Please try out<
>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>> vote, or just give us feedback.
>>
>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>
>> Thank you very much,
>>
>> Ajay
>>
>>
>>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Xiaoyu Yao <xy...@hortonworks.com>.
+1 (binding)
- Build from source
- Misc security tests with docker compose
- MR and Spark sample jobs with secure ozone cluster
—Xiaoyu
> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>
> +1 (Binding)
>
> -- Verified the checksums.
> -- Built from sources.
> -- Sniff tested the functionality.
>
> --Anu
>
>
> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> Hi all,
>>
>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>> 0.4.0-alpha.
>>
>> This release contains security payload for Ozone. Below are some important
>> features in it:
>>
>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>> encrypted-at-rest.
>> * Kerberos support for Ozone.
>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>> shared secrets.
>> * Datanode to Datanode communication secured via mutual TLS.
>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>> * Skaffold support to deploy Ozone clusters on K8s.
>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>> protocol.
>> * S3 Gateway supports Multipart upload.
>> * S3A file system is tested and supported.
>> * Support for Tracing and Profiling for all Ozone components.
>> * Audit Support - including Audit Parser tools.
>> * Apache Ranger Support in Ozone.
>> * Extensive failure testing for Ozone.
>>
>> The RC artifacts are available at
>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>
>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>
>> Please try out<
>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>> vote, or just give us feedback.
>>
>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>
>> Thank you very much,
>>
>> Ajay
>>
>>
>>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Xiaoyu Yao <xy...@hortonworks.com>.
+1 (binding)
- Build from source
- Misc security tests with docker compose
- MR and Spark sample jobs with secure ozone cluster
—Xiaoyu
> On Apr 19, 2019, at 3:40 PM, Anu Engineer <ae...@cloudera.com.invalid> wrote:
>
> +1 (Binding)
>
> -- Verified the checksums.
> -- Built from sources.
> -- Sniff tested the functionality.
>
> --Anu
>
>
> On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
> wrote:
>
>> Hi all,
>>
>> We have created the second release candidate (RC1) for Apache Hadoop Ozone
>> 0.4.0-alpha.
>>
>> This release contains security payload for Ozone. Below are some important
>> features in it:
>>
>> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
>> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
>> encrypted-at-rest.
>> * Kerberos support for Ozone.
>> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
>> shared secrets.
>> * Datanode to Datanode communication secured via mutual TLS.
>> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
>> * Skaffold support to deploy Ozone clusters on K8s.
>> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
>> protocol.
>> * S3 Gateway supports Multipart upload.
>> * S3A file system is tested and supported.
>> * Support for Tracing and Profiling for all Ozone components.
>> * Audit Support - including Audit Parser tools.
>> * Apache Ranger Support in Ozone.
>> * Extensive failure testing for Ozone.
>>
>> The RC artifacts are available at
>> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>>
>> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
>> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>>
>> Please try out<
>> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
>> vote, or just give us feedback.
>>
>> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>>
>> Thank you very much,
>>
>> Ajay
>>
>>
>>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Anu Engineer <ae...@cloudera.com.INVALID>.
+1 (Binding)
-- Verified the checksums.
-- Built from sources.
-- Sniff tested the functionality.
--Anu
On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
wrote:
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone
> 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important
> features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
> encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
> shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
> protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at
> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<
> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
> vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Anu Engineer <ae...@cloudera.com.INVALID>.
+1 (Binding)
-- Verified the checksums.
-- Built from sources.
-- Sniff tested the functionality.
--Anu
On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
wrote:
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone
> 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important
> features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
> encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
> shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
> protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at
> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<
> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
> vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Anu Engineer <ae...@cloudera.com.INVALID>.
+1 (Binding)
-- Verified the checksums.
-- Built from sources.
-- Sniff tested the functionality.
--Anu
On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
wrote:
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone
> 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important
> features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
> encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
> shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
> protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at
> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<
> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
> vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
>
Re: VOTE: Hadoop Ozone 0.4.0-alpha RC1
Posted by Anu Engineer <ae...@cloudera.com.INVALID>.
+1 (Binding)
-- Verified the checksums.
-- Built from sources.
-- Sniff tested the functionality.
--Anu
On Mon, Apr 15, 2019 at 4:09 PM Ajay Kumar <aj...@hortonworks.com>
wrote:
> Hi all,
>
> We have created the second release candidate (RC1) for Apache Hadoop Ozone
> 0.4.0-alpha.
>
> This release contains security payload for Ozone. Below are some important
> features in it:
>
> * Hadoop Delegation Tokens and Block Tokens supported for Ozone.
> * Transparent Data Encryption (TDE) Support - Allows data blocks to be
> encrypted-at-rest.
> * Kerberos support for Ozone.
> * Certificate Infrastructure for Ozone - Tokens use PKI instead of
> shared secrets.
> * Datanode to Datanode communication secured via mutual TLS.
> * Ability secure ozone cluster that works with Yarn, Hive, and Spark.
> * Skaffold support to deploy Ozone clusters on K8s.
> * Support S3 Authentication Mechanisms like - S3 v4 Authentication
> protocol.
> * S3 Gateway supports Multipart upload.
> * S3A file system is tested and supported.
> * Support for Tracing and Profiling for all Ozone components.
> * Audit Support - including Audit Parser tools.
> * Apache Ranger Support in Ozone.
> * Extensive failure testing for Ozone.
>
> The RC artifacts are available at
> https://home.apache.org/~ajay/ozone-0.4.0-alpha-rc1
>
> The RC tag in git is ozone-0.4.0-alpha-RC1 (git hash
> d673e16d14bb9377f27c9017e2ffc1bcb03eebfb)
>
> Please try out<
> https://cwiki.apache.org/confluence/display/HADOOP/Running+via+Apache+Release>,
> vote, or just give us feedback.
>
> The vote will run for 5 days, ending on April 20, 2019, 19:00 UTC.
>
> Thank you very much,
>
> Ajay
>
>
>