You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Masatake Iwasaki <iw...@oss.nttdata.co.jp> on 2022/03/14 07:14:27 UTC
[VOTE] Release Apache Hadoop 3.2.3 - RC0
Hi all,
Here's Hadoop 3.2.3 release candidate #0:
The RC is available at:
https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
The RC tag is at:
https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
The Maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1339
You can find my public key at:
https://downloads.apache.org/hadoop/common/KEYS
Please evaluate the RC and vote.
Thanks,
Masatake Iwasaki
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Since the RC0 does not yet get enough attention,
I'm going to cut RC1 tomorrow in order to add HDFS-14630.
While the log message is practically harmless,
it give an impression that the release is not well baked.
Let me know if you find fix which should be contained in 3.2.3 RC1.
Thanks,
Masatake Iwasaki
On 2022/03/18 10:56, Masatake Iwasaki wrote:
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>
> HDFS-14630 is the fix for this.
> I will backport this to branch-3.2.3 if I need to cut RC1.
>
> On 2022/03/18 0:54, Masatake Iwasaki wrote:
>> +1 from myself.
>>
>> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>>
>> * launched pseudo distributed cluster.
>> * ran some MR example jobs.
>> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
>> * launched pseudo distributed cluster with Kerberos security enabled.
>> * launched KMS and created encryption zone.
>> * ran sample MR wordcount job over encryption zone.
>>
>> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>>
>> * built site documentation by `mvn site site:stage` and skimmed the contents.
>>
>> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
>> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
>> https://issues.apache.org/jira/browse/BIGTOP-3606
>>
>>
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>>
>>
>> Masatake Iwasaki
>>
>>
>> On 2022/03/16 18:36, Viraj Jasani wrote:
>>> +1 (non-binding)
>>>
>>> Using hadoop-vote.sh
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>>
>>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>>
>>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>>
>>>
>>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>>
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>>
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Since the RC0 does not yet get enough attention,
I'm going to cut RC1 tomorrow in order to add HDFS-14630.
While the log message is practically harmless,
it give an impression that the release is not well baked.
Let me know if you find fix which should be contained in 3.2.3 RC1.
Thanks,
Masatake Iwasaki
On 2022/03/18 10:56, Masatake Iwasaki wrote:
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>
> HDFS-14630 is the fix for this.
> I will backport this to branch-3.2.3 if I need to cut RC1.
>
> On 2022/03/18 0:54, Masatake Iwasaki wrote:
>> +1 from myself.
>>
>> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>>
>> * launched pseudo distributed cluster.
>> * ran some MR example jobs.
>> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
>> * launched pseudo distributed cluster with Kerberos security enabled.
>> * launched KMS and created encryption zone.
>> * ran sample MR wordcount job over encryption zone.
>>
>> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>>
>> * built site documentation by `mvn site site:stage` and skimmed the contents.
>>
>> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
>> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
>> https://issues.apache.org/jira/browse/BIGTOP-3606
>>
>>
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>>
>>
>> Masatake Iwasaki
>>
>>
>> On 2022/03/16 18:36, Viraj Jasani wrote:
>>> +1 (non-binding)
>>>
>>> Using hadoop-vote.sh
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>>
>>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>>
>>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>>
>>>
>>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>>
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>>
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Since the RC0 does not yet get enough attention,
I'm going to cut RC1 tomorrow in order to add HDFS-14630.
While the log message is practically harmless,
it give an impression that the release is not well baked.
Let me know if you find fix which should be contained in 3.2.3 RC1.
Thanks,
Masatake Iwasaki
On 2022/03/18 10:56, Masatake Iwasaki wrote:
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>
> HDFS-14630 is the fix for this.
> I will backport this to branch-3.2.3 if I need to cut RC1.
>
> On 2022/03/18 0:54, Masatake Iwasaki wrote:
>> +1 from myself.
>>
>> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>>
>> * launched pseudo distributed cluster.
>> * ran some MR example jobs.
>> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
>> * launched pseudo distributed cluster with Kerberos security enabled.
>> * launched KMS and created encryption zone.
>> * ran sample MR wordcount job over encryption zone.
>>
>> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>>
>> * built site documentation by `mvn site site:stage` and skimmed the contents.
>>
>> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
>> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
>> https://issues.apache.org/jira/browse/BIGTOP-3606
>>
>>
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>>
>>
>> Masatake Iwasaki
>>
>>
>> On 2022/03/16 18:36, Viraj Jasani wrote:
>>> +1 (non-binding)
>>>
>>> Using hadoop-vote.sh
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>>
>>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>>
>>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>>
>>>
>>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>>
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>>
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Since the RC0 does not yet get enough attention,
I'm going to cut RC1 tomorrow in order to add HDFS-14630.
While the log message is practically harmless,
it give an impression that the release is not well baked.
Let me know if you find fix which should be contained in 3.2.3 RC1.
Thanks,
Masatake Iwasaki
On 2022/03/18 10:56, Masatake Iwasaki wrote:
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>
> HDFS-14630 is the fix for this.
> I will backport this to branch-3.2.3 if I need to cut RC1.
>
> On 2022/03/18 0:54, Masatake Iwasaki wrote:
>> +1 from myself.
>>
>> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>>
>> * launched pseudo distributed cluster.
>> * ran some MR example jobs.
>> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
>> * launched pseudo distributed cluster with Kerberos security enabled.
>> * launched KMS and created encryption zone.
>> * ran sample MR wordcount job over encryption zone.
>>
>> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>>
>> * built site documentation by `mvn site site:stage` and skimmed the contents.
>>
>> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
>> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
>> https://issues.apache.org/jira/browse/BIGTOP-3606
>>
>>
>> I found that INFO level log message is emitted on every CLI invocation.
>>
>> $ bin/hdfs dfs -mkdir /tmp
>> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>>
>> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
>> There seems to be no quick fix though it is noisy.
>>
>>
>> Masatake Iwasaki
>>
>>
>> On 2022/03/16 18:36, Viraj Jasani wrote:
>>> +1 (non-binding)
>>>
>>> Using hadoop-vote.sh
>>>
>>> * Signature: ok
>>> * Checksum : ok
>>> * Rat check (1.8.0_301): ok
>>> - mvn clean apache-rat:check
>>> * Built from source (1.8.0_301): ok
>>> - mvn clean install -DskipTests
>>> * Built tar from source (1.8.0_301): ok
>>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>>
>>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>>
>>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>>
>>>
>>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>>
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>>
>>> The Maven artifacts are staged at:
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
HDFS-14630 is the fix for this.
I will backport this to branch-3.2.3 if I need to cut RC1.
On 2022/03/18 0:54, Masatake Iwasaki wrote:
> +1 from myself.
>
> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>
> * launched pseudo distributed cluster.
> * ran some MR example jobs.
> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
> * launched pseudo distributed cluster with Kerberos security enabled.
> * launched KMS and created encryption zone.
> * ran sample MR wordcount job over encryption zone.
>
> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>
> * built site documentation by `mvn site site:stage` and skimmed the contents.
>
> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
> https://issues.apache.org/jira/browse/BIGTOP-3606
>
>
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
>
>
> Masatake Iwasaki
>
>
> On 2022/03/16 18:36, Viraj Jasani wrote:
>> +1 (non-binding)
>>
>> Using hadoop-vote.sh
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>
>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>
>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>
>>
>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>
>> Hi all,
>>
>> Here's Hadoop 3.2.3 release candidate #0:
>>
>> The RC is available at:
>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>
>> Please evaluate the RC and vote.
>>
>> Thanks,
>> Masatake Iwasaki
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
HDFS-14630 is the fix for this.
I will backport this to branch-3.2.3 if I need to cut RC1.
On 2022/03/18 0:54, Masatake Iwasaki wrote:
> +1 from myself.
>
> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>
> * launched pseudo distributed cluster.
> * ran some MR example jobs.
> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
> * launched pseudo distributed cluster with Kerberos security enabled.
> * launched KMS and created encryption zone.
> * ran sample MR wordcount job over encryption zone.
>
> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>
> * built site documentation by `mvn site site:stage` and skimmed the contents.
>
> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
> https://issues.apache.org/jira/browse/BIGTOP-3606
>
>
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
>
>
> Masatake Iwasaki
>
>
> On 2022/03/16 18:36, Viraj Jasani wrote:
>> +1 (non-binding)
>>
>> Using hadoop-vote.sh
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>
>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>
>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>
>>
>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>
>> Hi all,
>>
>> Here's Hadoop 3.2.3 release candidate #0:
>>
>> The RC is available at:
>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>
>> Please evaluate the RC and vote.
>>
>> Thanks,
>> Masatake Iwasaki
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
HDFS-14630 is the fix for this.
I will backport this to branch-3.2.3 if I need to cut RC1.
On 2022/03/18 0:54, Masatake Iwasaki wrote:
> +1 from myself.
>
> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>
> * launched pseudo distributed cluster.
> * ran some MR example jobs.
> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
> * launched pseudo distributed cluster with Kerberos security enabled.
> * launched KMS and created encryption zone.
> * ran sample MR wordcount job over encryption zone.
>
> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>
> * built site documentation by `mvn site site:stage` and skimmed the contents.
>
> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
> https://issues.apache.org/jira/browse/BIGTOP-3606
>
>
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
>
>
> Masatake Iwasaki
>
>
> On 2022/03/16 18:36, Viraj Jasani wrote:
>> +1 (non-binding)
>>
>> Using hadoop-vote.sh
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>
>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>
>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>
>>
>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>
>> Hi all,
>>
>> Here's Hadoop 3.2.3 release candidate #0:
>>
>> The RC is available at:
>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>
>> Please evaluate the RC and vote.
>>
>> Thanks,
>> Masatake Iwasaki
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
HDFS-14630 is the fix for this.
I will backport this to branch-3.2.3 if I need to cut RC1.
On 2022/03/18 0:54, Masatake Iwasaki wrote:
> +1 from myself.
>
> * built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
>
> * launched pseudo distributed cluster.
> * ran some MR example jobs.
> * launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
> * launched pseudo distributed cluster with Kerberos security enabled.
> * launched KMS and created encryption zone.
> * ran sample MR wordcount job over encryption zone.
>
> * launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
>
> * built site documentation by `mvn site site:stage` and skimmed the contents.
>
> * built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
> on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
> https://issues.apache.org/jira/browse/BIGTOP-3606
>
>
> I found that INFO level log message is emitted on every CLI invocation.
>
> $ bin/hdfs dfs -mkdir /tmp
> 2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
>
> The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
> There seems to be no quick fix though it is noisy.
>
>
> Masatake Iwasaki
>
>
> On 2022/03/16 18:36, Viraj Jasani wrote:
>> +1 (non-binding)
>>
>> Using hadoop-vote.sh
>>
>> * Signature: ok
>> * Checksum : ok
>> * Rat check (1.8.0_301): ok
>> - mvn clean apache-rat:check
>> * Built from source (1.8.0_301): ok
>> - mvn clean install -DskipTests
>> * Built tar from source (1.8.0_301): ok
>> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>>
>> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>>
>> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>>
>>
>> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>>
>> Hi all,
>>
>> Here's Hadoop 3.2.3 release candidate #0:
>>
>> The RC is available at:
>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>>
>> The RC tag is at:
>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>>
>> The Maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>>
>> You can find my public key at:
>> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>>
>> Please evaluate the RC and vote.
>>
>> Thanks,
>> Masatake Iwasaki
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
>> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 from myself.
* built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
* launched pseudo distributed cluster.
* ran some MR example jobs.
* launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
* launched pseudo distributed cluster with Kerberos security enabled.
* launched KMS and created encryption zone.
* ran sample MR wordcount job over encryption zone.
* launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
* built site documentation by `mvn site site:stage` and skimmed the contents.
* built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
https://issues.apache.org/jira/browse/BIGTOP-3606
I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
Masatake Iwasaki
On 2022/03/16 18:36, Viraj Jasani wrote:
> +1 (non-binding)
>
> Using hadoop-vote.sh
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>
> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>
> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>
>
> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 from myself.
* built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
* launched pseudo distributed cluster.
* ran some MR example jobs.
* launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
* launched pseudo distributed cluster with Kerberos security enabled.
* launched KMS and created encryption zone.
* ran sample MR wordcount job over encryption zone.
* launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
* built site documentation by `mvn site site:stage` and skimmed the contents.
* built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
https://issues.apache.org/jira/browse/BIGTOP-3606
I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
Masatake Iwasaki
On 2022/03/16 18:36, Viraj Jasani wrote:
> +1 (non-binding)
>
> Using hadoop-vote.sh
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>
> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>
> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>
>
> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 from myself.
* built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
* launched pseudo distributed cluster.
* ran some MR example jobs.
* launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
* launched pseudo distributed cluster with Kerberos security enabled.
* launched KMS and created encryption zone.
* ran sample MR wordcount job over encryption zone.
* launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
* built site documentation by `mvn site site:stage` and skimmed the contents.
* built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
https://issues.apache.org/jira/browse/BIGTOP-3606
I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
Masatake Iwasaki
On 2022/03/16 18:36, Viraj Jasani wrote:
> +1 (non-binding)
>
> Using hadoop-vote.sh
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>
> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>
> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>
>
> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
+1 from myself.
* built the source tarball on CentOS 7 (x86_64) and OpenJDK 8 by `mvn install -DskipTests -Pnative -Pdist`.
* launched pseudo distributed cluster.
* ran some MR example jobs.
* launched `spark-shell --master yarn` with spark-3.2.1-bin-without-hadoop and ran some tutorial code.
* launched pseudo distributed cluster with Kerberos security enabled.
* launched KMS and created encryption zone.
* ran sample MR wordcount job over encryption zone.
* launched HA enabled 3-nodes docker cluster and ran sample MR jobs.
* built site documentation by `mvn site site:stage` and skimmed the contents.
* built HBase 2.4.8, Hive 3.1.2 and Spark 3.1.2 against Hadoop 3.2.3 RC0
on Rocky Linux 8 (x86_64) by using Bigtop and ran smoke-tests.
https://issues.apache.org/jira/browse/BIGTOP-3606
I found that INFO level log message is emitted on every CLI invocation.
$ bin/hdfs dfs -mkdir /tmp
2022-03-17 23:38:55,141 INFO Configuration.deprecation: No unit for dfs.client.datanode-restart.timeout(30) assuming SECONDS
The time unit was intentionally removed from hdfs-default.xml by DFS-12920,
There seems to be no quick fix though it is noisy.
Masatake Iwasaki
On 2022/03/16 18:36, Viraj Jasani wrote:
> +1 (non-binding)
>
> Using hadoop-vote.sh
>
> * Signature: ok
> * Checksum : ok
> * Rat check (1.8.0_301): ok
> - mvn clean apache-rat:check
> * Built from source (1.8.0_301): ok
> - mvn clean install -DskipTests
> * Built tar from source (1.8.0_301): ok
> - mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
>
> Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed cluster (1M rows ingested), all good.
>
> Test PR to run full build and track UT failures https://github.com/apache/hadoop/pull/4073 <https://github.com/apache/hadoop/pull/4073>, few tests are flaky but they are passing locally.
>
>
> On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <iwasakims@oss.nttdata.co.jp <ma...@oss.nttdata.co.jp>> wrote:
>
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/ <https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/>
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0 <https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0>
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339 <https://repository.apache.org/content/repositories/orgapachehadoop-1339>
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS <https://downloads.apache.org/hadoop/common/KEYS>
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org <ma...@hadoop.apache.org>
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org <ma...@hadoop.apache.org>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
Using hadoop-vote.sh
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed
cluster (1M rows ingested), all good.
Test PR to run full build and track UT failures
https://github.com/apache/hadoop/pull/4073, few tests are flaky but they
are passing locally.
On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
Using hadoop-vote.sh
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed
cluster (1M rows ingested), all good.
Test PR to run full build and track UT failures
https://github.com/apache/hadoop/pull/4073, few tests are flaky but they
are passing locally.
On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
Using hadoop-vote.sh
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed
cluster (1M rows ingested), all good.
Test PR to run full build and track UT failures
https://github.com/apache/hadoop/pull/4073, few tests are flaky but they
are passing locally.
On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Emil Ejbyfeldt <ee...@liveintent.com.INVALID>.
Hi,
I think I misread this discussion as 3.3.3-RC0. And since the 3.3.2
release is missing the aarch64 package I thought it not being here was
some how related. But I was clearly mistaken, thanks for the quick
replay and clarification.
Best,
Emil
On 17/03/2022 08:13, Masatake Iwasaki wrote:
> Hadoop 3.2.x depends on Protocol Buffers 2.5.0 which does not support
> aarch64.
>
> If you want to build 3.2.3 RC0 on aarch64,
> you can use the patch backporting aarch64 support.
> https://github.com/apache/bigtop/blob/master/bigtop_toolchain/files/0001-Backport-atomic-operations-with-support-of-arm64-and.patch
>
>
> You will be able to build Hadoop 3.2.3 package on aarch64 by using
> Bigtop after BIGTOP-3606 is fixed.
> https://issues.apache.org/jira/browse/BIGTOP-3606
>
> On 2022/03/17 15:40, Wei-Chiu Chuang wrote:
>> aarch64 support is only introduced in/after 3.3.0
>>
>> On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
>> <ee...@liveintent.com.invalid> wrote:
>>
>>> Hi,
>>>
>>>
>>> There is no aarch64 artifact in the release candidate. Is this something
>>> that is intended?
>>>
>>> Best,
>>> Emil Ejbyfeldt
>>>
>>> On 14/03/2022 08:14, Masatake Iwasaki wrote:
>>>> Hi all,
>>>>
>>>> Here's Hadoop 3.2.3 release candidate #0:
>>>>
>>>> The RC is available at:
>>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>>>>
>>>> The RC tag is at:
>>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>>>>
>>>> The Maven artifacts are staged at:
>>>>
>>> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>>>>
>>>> You can find my public key at:
>>>> https://downloads.apache.org/hadoop/common/KEYS
>>>>
>>>> Please evaluate the RC and vote.
>>>>
>>>> Thanks,
>>>> Masatake Iwasaki
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>
>>>
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hadoop 3.2.x depends on Protocol Buffers 2.5.0 which does not support aarch64.
If you want to build 3.2.3 RC0 on aarch64,
you can use the patch backporting aarch64 support.
https://github.com/apache/bigtop/blob/master/bigtop_toolchain/files/0001-Backport-atomic-operations-with-support-of-arm64-and.patch
You will be able to build Hadoop 3.2.3 package on aarch64 by using Bigtop after BIGTOP-3606 is fixed.
https://issues.apache.org/jira/browse/BIGTOP-3606
On 2022/03/17 15:40, Wei-Chiu Chuang wrote:
> aarch64 support is only introduced in/after 3.3.0
>
> On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
> <ee...@liveintent.com.invalid> wrote:
>
>> Hi,
>>
>>
>> There is no aarch64 artifact in the release candidate. Is this something
>> that is intended?
>>
>> Best,
>> Emil Ejbyfeldt
>>
>> On 14/03/2022 08:14, Masatake Iwasaki wrote:
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>>>
>>> The Maven artifacts are staged at:
>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hadoop 3.2.x depends on Protocol Buffers 2.5.0 which does not support aarch64.
If you want to build 3.2.3 RC0 on aarch64,
you can use the patch backporting aarch64 support.
https://github.com/apache/bigtop/blob/master/bigtop_toolchain/files/0001-Backport-atomic-operations-with-support-of-arm64-and.patch
You will be able to build Hadoop 3.2.3 package on aarch64 by using Bigtop after BIGTOP-3606 is fixed.
https://issues.apache.org/jira/browse/BIGTOP-3606
On 2022/03/17 15:40, Wei-Chiu Chuang wrote:
> aarch64 support is only introduced in/after 3.3.0
>
> On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
> <ee...@liveintent.com.invalid> wrote:
>
>> Hi,
>>
>>
>> There is no aarch64 artifact in the release candidate. Is this something
>> that is intended?
>>
>> Best,
>> Emil Ejbyfeldt
>>
>> On 14/03/2022 08:14, Masatake Iwasaki wrote:
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>>>
>>> The Maven artifacts are staged at:
>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hadoop 3.2.x depends on Protocol Buffers 2.5.0 which does not support aarch64.
If you want to build 3.2.3 RC0 on aarch64,
you can use the patch backporting aarch64 support.
https://github.com/apache/bigtop/blob/master/bigtop_toolchain/files/0001-Backport-atomic-operations-with-support-of-arm64-and.patch
You will be able to build Hadoop 3.2.3 package on aarch64 by using Bigtop after BIGTOP-3606 is fixed.
https://issues.apache.org/jira/browse/BIGTOP-3606
On 2022/03/17 15:40, Wei-Chiu Chuang wrote:
> aarch64 support is only introduced in/after 3.3.0
>
> On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
> <ee...@liveintent.com.invalid> wrote:
>
>> Hi,
>>
>>
>> There is no aarch64 artifact in the release candidate. Is this something
>> that is intended?
>>
>> Best,
>> Emil Ejbyfeldt
>>
>> On 14/03/2022 08:14, Masatake Iwasaki wrote:
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>>>
>>> The Maven artifacts are staged at:
>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Masatake Iwasaki <iw...@oss.nttdata.co.jp>.
Hadoop 3.2.x depends on Protocol Buffers 2.5.0 which does not support aarch64.
If you want to build 3.2.3 RC0 on aarch64,
you can use the patch backporting aarch64 support.
https://github.com/apache/bigtop/blob/master/bigtop_toolchain/files/0001-Backport-atomic-operations-with-support-of-arm64-and.patch
You will be able to build Hadoop 3.2.3 package on aarch64 by using Bigtop after BIGTOP-3606 is fixed.
https://issues.apache.org/jira/browse/BIGTOP-3606
On 2022/03/17 15:40, Wei-Chiu Chuang wrote:
> aarch64 support is only introduced in/after 3.3.0
>
> On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
> <ee...@liveintent.com.invalid> wrote:
>
>> Hi,
>>
>>
>> There is no aarch64 artifact in the release candidate. Is this something
>> that is intended?
>>
>> Best,
>> Emil Ejbyfeldt
>>
>> On 14/03/2022 08:14, Masatake Iwasaki wrote:
>>> Hi all,
>>>
>>> Here's Hadoop 3.2.3 release candidate #0:
>>>
>>> The RC is available at:
>>> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>>>
>>> The RC tag is at:
>>> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>>>
>>> The Maven artifacts are staged at:
>>>
>> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>>>
>>> You can find my public key at:
>>> https://downloads.apache.org/hadoop/common/KEYS
>>>
>>> Please evaluate the RC and vote.
>>>
>>> Thanks,
>>> Masatake Iwasaki
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
>> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>>
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Wei-Chiu Chuang <we...@apache.org>.
aarch64 support is only introduced in/after 3.3.0
On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
<ee...@liveintent.com.invalid> wrote:
> Hi,
>
>
> There is no aarch64 artifact in the release candidate. Is this something
> that is intended?
>
> Best,
> Emil Ejbyfeldt
>
> On 14/03/2022 08:14, Masatake Iwasaki wrote:
> > Hi all,
> >
> > Here's Hadoop 3.2.3 release candidate #0:
> >
> > The RC is available at:
> > https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
> >
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
> >
> > The Maven artifacts are staged at:
> >
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > Please evaluate the RC and vote.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Wei-Chiu Chuang <we...@apache.org>.
aarch64 support is only introduced in/after 3.3.0
On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
<ee...@liveintent.com.invalid> wrote:
> Hi,
>
>
> There is no aarch64 artifact in the release candidate. Is this something
> that is intended?
>
> Best,
> Emil Ejbyfeldt
>
> On 14/03/2022 08:14, Masatake Iwasaki wrote:
> > Hi all,
> >
> > Here's Hadoop 3.2.3 release candidate #0:
> >
> > The RC is available at:
> > https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
> >
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
> >
> > The Maven artifacts are staged at:
> >
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > Please evaluate the RC and vote.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Wei-Chiu Chuang <we...@apache.org>.
aarch64 support is only introduced in/after 3.3.0
On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
<ee...@liveintent.com.invalid> wrote:
> Hi,
>
>
> There is no aarch64 artifact in the release candidate. Is this something
> that is intended?
>
> Best,
> Emil Ejbyfeldt
>
> On 14/03/2022 08:14, Masatake Iwasaki wrote:
> > Hi all,
> >
> > Here's Hadoop 3.2.3 release candidate #0:
> >
> > The RC is available at:
> > https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
> >
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
> >
> > The Maven artifacts are staged at:
> >
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > Please evaluate the RC and vote.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Wei-Chiu Chuang <we...@apache.org>.
aarch64 support is only introduced in/after 3.3.0
On Thu, Mar 17, 2022 at 2:27 PM Emil Ejbyfeldt
<ee...@liveintent.com.invalid> wrote:
> Hi,
>
>
> There is no aarch64 artifact in the release candidate. Is this something
> that is intended?
>
> Best,
> Emil Ejbyfeldt
>
> On 14/03/2022 08:14, Masatake Iwasaki wrote:
> > Hi all,
> >
> > Here's Hadoop 3.2.3 release candidate #0:
> >
> > The RC is available at:
> > https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
> >
> > The RC tag is at:
> > https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
> >
> > The Maven artifacts are staged at:
> >
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
> >
> > You can find my public key at:
> > https://downloads.apache.org/hadoop/common/KEYS
> >
> > Please evaluate the RC and vote.
> >
> > Thanks,
> > Masatake Iwasaki
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Emil Ejbyfeldt <ee...@liveintent.com.INVALID>.
Hi,
There is no aarch64 artifact in the release candidate. Is this something
that is intended?
Best,
Emil Ejbyfeldt
On 14/03/2022 08:14, Masatake Iwasaki wrote:
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 3.2.3 - RC0
Posted by Viraj Jasani <vj...@apache.org>.
+1 (non-binding)
Using hadoop-vote.sh
* Signature: ok
* Checksum : ok
* Rat check (1.8.0_301): ok
- mvn clean apache-rat:check
* Built from source (1.8.0_301): ok
- mvn clean install -DskipTests
* Built tar from source (1.8.0_301): ok
- mvn clean package -Pdist -DskipTests -Dtar -Dmaven.javadoc.skip=true
Tested HDFS on pseudo-distributed mode with HBase 2.4 pseudo-distributed
cluster (1M rows ingested), all good.
Test PR to run full build and track UT failures
https://github.com/apache/hadoop/pull/4073, few tests are flaky but they
are passing locally.
On Mon, Mar 14, 2022 at 12:45 PM Masatake Iwasaki <
iwasakims@oss.nttdata.co.jp> wrote:
> Hi all,
>
> Here's Hadoop 3.2.3 release candidate #0:
>
> The RC is available at:
> https://home.apache.org/~iwasakims/hadoop-3.2.3-RC0/
>
> The RC tag is at:
> https://github.com/apache/hadoop/releases/tag/release-3.2.3-RC0
>
> The Maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1339
>
> You can find my public key at:
> https://downloads.apache.org/hadoop/common/KEYS
>
> Please evaluate the RC and vote.
>
> Thanks,
> Masatake Iwasaki
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
>
>