You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Dinesh Chitlangia <di...@gmail.com> on 2020/03/16 02:27:02 UTC
[VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Hi Folks,
We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
The RC artifacts are at:
https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
The public key used for signing the artifacts can be found at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
The maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1262
The RC tag in git is at:
https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
This release contains 800+ fixes/improvements [1].
Thanks to everyone who put in the effort to make this happen.
*The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
Note: This release is beta quality, it’s not recommended to use in
production but we believe that it’s stable enough to try out the feature
set and collect feedback.
[1] https://s.apache.org/ozone-0.5.0-fixed-issues
Thanks,
Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2(Internet mail)
Posted by "simonssu (苏舒)" <si...@tencent.com>.
+1 ( non-binding )
Verified the following:
- Built from source
- Deployed to 3 node docker cluster by docker compose
- Run freon to create 100k keys
- Run smoke tests
Thank you Dinesh for putting up the RCs.
Thanks
Simon
> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Bharat Viswanadham <bh...@apache.org>.
I am seeing this issue when running hdfs commands on hadoop 27
docker-compose. I see the same test failing when running the smoke test.
$ docker exec -it c7fe17804044 bash
bash-4.4$ hdfs dfs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:40:14 WARN NativeCodeLoader:60 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2020-03-22 04:40:15 INFO MetricsConfig:118 - Loaded properties from
hadoop-metrics2.properties
2020-03-22 04:40:16 INFO MetricsSystemImpl:374 - Scheduled Metric snapshot
period at 10 second(s).
2020-03-22 04:40:16 INFO MetricsSystemImpl:191 - XceiverClientMetrics
metrics system started
-put: Fatal internal error
java.lang.NullPointerException: client is null
at java.util.Objects.requireNonNull(Objects.java:228)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.getClient(XceiverClientRatis.java:201)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendRequestAsync(XceiverClientRatis.java:227)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendCommandAsync(XceiverClientRatis.java:305)
at
org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.writeChunkAsync(ContainerProtocolCalls.java:315)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunkToContainer(BlockOutputStream.java:599)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunk(BlockOutputStream.java:452)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.handleFlush(BlockOutputStream.java:463)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.close(BlockOutputStream.java:486)
at
org.apache.hadoop.ozone.client.io.BlockOutputStreamEntry.close(BlockOutputStreamEntry.java:144)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleStreamAction(KeyOutputStream.java:481)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleFlushOrClose(KeyOutputStream.java:455)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.close(KeyOutputStream.java:508)
at
org.apache.hadoop.fs.ozone.OzoneFSOutputStream.close(OzoneFSOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
at
org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:62)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:120)
at
org.apache.hadoop.fs.shell.CommandWithDestination$TargetFileSystem.writeStreamToFile(CommandWithDestination.java:466)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyStreamToTarget(CommandWithDestination.java:391)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyFileToTarget(CommandWithDestination.java:328)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:263)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:248)
at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:317)
at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:289)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPathArgument(CommandWithDestination.java:243)
at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:271)
at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:255)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processArguments(CommandWithDestination.java:220)
at
org.apache.hadoop.fs.shell.CopyCommands$Put.processArguments(CopyCommands.java:267)
at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:201)
at org.apache.hadoop.fs.shell.Command.run(Command.java:165)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:287)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)
The same command when using ozone fs is working fine.
docker exec -it fe5d39cf6eed bash
bash-4.2$ ozone fs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:41:10,999 [main] INFO impl.MetricsConfig: Loaded properties
from hadoop-metrics2.properties
2020-03-22 04:41:11,123 [main] INFO impl.MetricsSystemImpl: Scheduled
Metric snapshot period at 10 second(s).
2020-03-22 04:41:11,127 [main] INFO impl.MetricsSystemImpl:
XceiverClientMetrics metrics system started
bash-4.2$ ozone fs -ls o3fs://bucket1.vol1/
Found 1 items
-rw-rw-rw- 3 hadoop hadoop 17540 2020-03-22 04:41
o3fs://bucket1.vol1/kk
- Built from the source tarball
- Verified md5 and sha256 signatures.
- Ran smoke tests, found one above issue.
- Deployed to a 5 node docker cluster using ozone compose definition(OM +
SCM + 3 Datanodes), and ran basic ozone shell and fs commands.
Thank You, Dinesh for driving the release.
Thanks,
Bharat
On Sat, Mar 21, 2020 at 8:48 PM Arpit Agarwal <aa...@cloudera.com.invalid>
wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Deployed to 5 node cluster
> - Tried ozone shell and filesystem operations
> - Ran freon stress test for a while with write validation
>
>
> I couldn’t find the RC2 tag in the gitbox repo, although it is there in
> GitHub.
>
> Thanks,
> Arpit
>
>
>
> > On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID>
> wrote:
> >
> > Thank you Dinesh for putting up the RCs.
> >
> > +1 binding.
> >
> > Verified the following:
> > - Built from source
> > - Deployed to 5 node docker cluster and ran sanity tests.
> > - Ran smoke tests
> >
> > Thanks
> > Hanisha
> >
> >> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com>
> wrote:
> >>
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Bharat Viswanadham <bh...@apache.org>.
I am seeing this issue when running hdfs commands on hadoop 27
docker-compose. I see the same test failing when running the smoke test.
$ docker exec -it c7fe17804044 bash
bash-4.4$ hdfs dfs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:40:14 WARN NativeCodeLoader:60 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2020-03-22 04:40:15 INFO MetricsConfig:118 - Loaded properties from
hadoop-metrics2.properties
2020-03-22 04:40:16 INFO MetricsSystemImpl:374 - Scheduled Metric snapshot
period at 10 second(s).
2020-03-22 04:40:16 INFO MetricsSystemImpl:191 - XceiverClientMetrics
metrics system started
-put: Fatal internal error
java.lang.NullPointerException: client is null
at java.util.Objects.requireNonNull(Objects.java:228)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.getClient(XceiverClientRatis.java:201)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendRequestAsync(XceiverClientRatis.java:227)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendCommandAsync(XceiverClientRatis.java:305)
at
org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.writeChunkAsync(ContainerProtocolCalls.java:315)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunkToContainer(BlockOutputStream.java:599)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunk(BlockOutputStream.java:452)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.handleFlush(BlockOutputStream.java:463)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.close(BlockOutputStream.java:486)
at
org.apache.hadoop.ozone.client.io.BlockOutputStreamEntry.close(BlockOutputStreamEntry.java:144)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleStreamAction(KeyOutputStream.java:481)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleFlushOrClose(KeyOutputStream.java:455)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.close(KeyOutputStream.java:508)
at
org.apache.hadoop.fs.ozone.OzoneFSOutputStream.close(OzoneFSOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
at
org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:62)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:120)
at
org.apache.hadoop.fs.shell.CommandWithDestination$TargetFileSystem.writeStreamToFile(CommandWithDestination.java:466)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyStreamToTarget(CommandWithDestination.java:391)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyFileToTarget(CommandWithDestination.java:328)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:263)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:248)
at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:317)
at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:289)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPathArgument(CommandWithDestination.java:243)
at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:271)
at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:255)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processArguments(CommandWithDestination.java:220)
at
org.apache.hadoop.fs.shell.CopyCommands$Put.processArguments(CopyCommands.java:267)
at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:201)
at org.apache.hadoop.fs.shell.Command.run(Command.java:165)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:287)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)
The same command when using ozone fs is working fine.
docker exec -it fe5d39cf6eed bash
bash-4.2$ ozone fs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:41:10,999 [main] INFO impl.MetricsConfig: Loaded properties
from hadoop-metrics2.properties
2020-03-22 04:41:11,123 [main] INFO impl.MetricsSystemImpl: Scheduled
Metric snapshot period at 10 second(s).
2020-03-22 04:41:11,127 [main] INFO impl.MetricsSystemImpl:
XceiverClientMetrics metrics system started
bash-4.2$ ozone fs -ls o3fs://bucket1.vol1/
Found 1 items
-rw-rw-rw- 3 hadoop hadoop 17540 2020-03-22 04:41
o3fs://bucket1.vol1/kk
- Built from the source tarball
- Verified md5 and sha256 signatures.
- Ran smoke tests, found one above issue.
- Deployed to a 5 node docker cluster using ozone compose definition(OM +
SCM + 3 Datanodes), and ran basic ozone shell and fs commands.
Thank You, Dinesh for driving the release.
Thanks,
Bharat
On Sat, Mar 21, 2020 at 8:48 PM Arpit Agarwal <aa...@cloudera.com.invalid>
wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Deployed to 5 node cluster
> - Tried ozone shell and filesystem operations
> - Ran freon stress test for a while with write validation
>
>
> I couldn’t find the RC2 tag in the gitbox repo, although it is there in
> GitHub.
>
> Thanks,
> Arpit
>
>
>
> > On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID>
> wrote:
> >
> > Thank you Dinesh for putting up the RCs.
> >
> > +1 binding.
> >
> > Verified the following:
> > - Built from source
> > - Deployed to 5 node docker cluster and ran sanity tests.
> > - Ran smoke tests
> >
> > Thanks
> > Hanisha
> >
> >> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com>
> wrote:
> >>
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Bharat Viswanadham <bh...@apache.org>.
I am seeing this issue when running hdfs commands on hadoop 27
docker-compose. I see the same test failing when running the smoke test.
$ docker exec -it c7fe17804044 bash
bash-4.4$ hdfs dfs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:40:14 WARN NativeCodeLoader:60 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2020-03-22 04:40:15 INFO MetricsConfig:118 - Loaded properties from
hadoop-metrics2.properties
2020-03-22 04:40:16 INFO MetricsSystemImpl:374 - Scheduled Metric snapshot
period at 10 second(s).
2020-03-22 04:40:16 INFO MetricsSystemImpl:191 - XceiverClientMetrics
metrics system started
-put: Fatal internal error
java.lang.NullPointerException: client is null
at java.util.Objects.requireNonNull(Objects.java:228)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.getClient(XceiverClientRatis.java:201)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendRequestAsync(XceiverClientRatis.java:227)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendCommandAsync(XceiverClientRatis.java:305)
at
org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.writeChunkAsync(ContainerProtocolCalls.java:315)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunkToContainer(BlockOutputStream.java:599)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunk(BlockOutputStream.java:452)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.handleFlush(BlockOutputStream.java:463)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.close(BlockOutputStream.java:486)
at
org.apache.hadoop.ozone.client.io.BlockOutputStreamEntry.close(BlockOutputStreamEntry.java:144)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleStreamAction(KeyOutputStream.java:481)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleFlushOrClose(KeyOutputStream.java:455)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.close(KeyOutputStream.java:508)
at
org.apache.hadoop.fs.ozone.OzoneFSOutputStream.close(OzoneFSOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
at
org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:62)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:120)
at
org.apache.hadoop.fs.shell.CommandWithDestination$TargetFileSystem.writeStreamToFile(CommandWithDestination.java:466)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyStreamToTarget(CommandWithDestination.java:391)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyFileToTarget(CommandWithDestination.java:328)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:263)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:248)
at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:317)
at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:289)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPathArgument(CommandWithDestination.java:243)
at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:271)
at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:255)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processArguments(CommandWithDestination.java:220)
at
org.apache.hadoop.fs.shell.CopyCommands$Put.processArguments(CopyCommands.java:267)
at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:201)
at org.apache.hadoop.fs.shell.Command.run(Command.java:165)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:287)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)
The same command when using ozone fs is working fine.
docker exec -it fe5d39cf6eed bash
bash-4.2$ ozone fs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:41:10,999 [main] INFO impl.MetricsConfig: Loaded properties
from hadoop-metrics2.properties
2020-03-22 04:41:11,123 [main] INFO impl.MetricsSystemImpl: Scheduled
Metric snapshot period at 10 second(s).
2020-03-22 04:41:11,127 [main] INFO impl.MetricsSystemImpl:
XceiverClientMetrics metrics system started
bash-4.2$ ozone fs -ls o3fs://bucket1.vol1/
Found 1 items
-rw-rw-rw- 3 hadoop hadoop 17540 2020-03-22 04:41
o3fs://bucket1.vol1/kk
- Built from the source tarball
- Verified md5 and sha256 signatures.
- Ran smoke tests, found one above issue.
- Deployed to a 5 node docker cluster using ozone compose definition(OM +
SCM + 3 Datanodes), and ran basic ozone shell and fs commands.
Thank You, Dinesh for driving the release.
Thanks,
Bharat
On Sat, Mar 21, 2020 at 8:48 PM Arpit Agarwal <aa...@cloudera.com.invalid>
wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Deployed to 5 node cluster
> - Tried ozone shell and filesystem operations
> - Ran freon stress test for a while with write validation
>
>
> I couldn’t find the RC2 tag in the gitbox repo, although it is there in
> GitHub.
>
> Thanks,
> Arpit
>
>
>
> > On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID>
> wrote:
> >
> > Thank you Dinesh for putting up the RCs.
> >
> > +1 binding.
> >
> > Verified the following:
> > - Built from source
> > - Deployed to 5 node docker cluster and ran sanity tests.
> > - Ran smoke tests
> >
> > Thanks
> > Hanisha
> >
> >> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com>
> wrote:
> >>
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Bharat Viswanadham <bh...@apache.org>.
I am seeing this issue when running hdfs commands on hadoop 27
docker-compose. I see the same test failing when running the smoke test.
$ docker exec -it c7fe17804044 bash
bash-4.4$ hdfs dfs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:40:14 WARN NativeCodeLoader:60 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2020-03-22 04:40:15 INFO MetricsConfig:118 - Loaded properties from
hadoop-metrics2.properties
2020-03-22 04:40:16 INFO MetricsSystemImpl:374 - Scheduled Metric snapshot
period at 10 second(s).
2020-03-22 04:40:16 INFO MetricsSystemImpl:191 - XceiverClientMetrics
metrics system started
-put: Fatal internal error
java.lang.NullPointerException: client is null
at java.util.Objects.requireNonNull(Objects.java:228)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.getClient(XceiverClientRatis.java:201)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendRequestAsync(XceiverClientRatis.java:227)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendCommandAsync(XceiverClientRatis.java:305)
at
org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.writeChunkAsync(ContainerProtocolCalls.java:315)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunkToContainer(BlockOutputStream.java:599)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunk(BlockOutputStream.java:452)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.handleFlush(BlockOutputStream.java:463)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.close(BlockOutputStream.java:486)
at
org.apache.hadoop.ozone.client.io.BlockOutputStreamEntry.close(BlockOutputStreamEntry.java:144)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleStreamAction(KeyOutputStream.java:481)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleFlushOrClose(KeyOutputStream.java:455)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.close(KeyOutputStream.java:508)
at
org.apache.hadoop.fs.ozone.OzoneFSOutputStream.close(OzoneFSOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
at
org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:62)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:120)
at
org.apache.hadoop.fs.shell.CommandWithDestination$TargetFileSystem.writeStreamToFile(CommandWithDestination.java:466)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyStreamToTarget(CommandWithDestination.java:391)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyFileToTarget(CommandWithDestination.java:328)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:263)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:248)
at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:317)
at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:289)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPathArgument(CommandWithDestination.java:243)
at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:271)
at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:255)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processArguments(CommandWithDestination.java:220)
at
org.apache.hadoop.fs.shell.CopyCommands$Put.processArguments(CopyCommands.java:267)
at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:201)
at org.apache.hadoop.fs.shell.Command.run(Command.java:165)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:287)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)
The same command when using ozone fs is working fine.
docker exec -it fe5d39cf6eed bash
bash-4.2$ ozone fs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:41:10,999 [main] INFO impl.MetricsConfig: Loaded properties
from hadoop-metrics2.properties
2020-03-22 04:41:11,123 [main] INFO impl.MetricsSystemImpl: Scheduled
Metric snapshot period at 10 second(s).
2020-03-22 04:41:11,127 [main] INFO impl.MetricsSystemImpl:
XceiverClientMetrics metrics system started
bash-4.2$ ozone fs -ls o3fs://bucket1.vol1/
Found 1 items
-rw-rw-rw- 3 hadoop hadoop 17540 2020-03-22 04:41
o3fs://bucket1.vol1/kk
- Built from the source tarball
- Verified md5 and sha256 signatures.
- Ran smoke tests, found one above issue.
- Deployed to a 5 node docker cluster using ozone compose definition(OM +
SCM + 3 Datanodes), and ran basic ozone shell and fs commands.
Thank You, Dinesh for driving the release.
Thanks,
Bharat
On Sat, Mar 21, 2020 at 8:48 PM Arpit Agarwal <aa...@cloudera.com.invalid>
wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Deployed to 5 node cluster
> - Tried ozone shell and filesystem operations
> - Ran freon stress test for a while with write validation
>
>
> I couldn’t find the RC2 tag in the gitbox repo, although it is there in
> GitHub.
>
> Thanks,
> Arpit
>
>
>
> > On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID>
> wrote:
> >
> > Thank you Dinesh for putting up the RCs.
> >
> > +1 binding.
> >
> > Verified the following:
> > - Built from source
> > - Deployed to 5 node docker cluster and ran sanity tests.
> > - Ran smoke tests
> >
> > Thanks
> > Hanisha
> >
> >> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com>
> wrote:
> >>
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Bharat Viswanadham <bh...@apache.org>.
I am seeing this issue when running hdfs commands on hadoop 27
docker-compose. I see the same test failing when running the smoke test.
$ docker exec -it c7fe17804044 bash
bash-4.4$ hdfs dfs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:40:14 WARN NativeCodeLoader:60 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2020-03-22 04:40:15 INFO MetricsConfig:118 - Loaded properties from
hadoop-metrics2.properties
2020-03-22 04:40:16 INFO MetricsSystemImpl:374 - Scheduled Metric snapshot
period at 10 second(s).
2020-03-22 04:40:16 INFO MetricsSystemImpl:191 - XceiverClientMetrics
metrics system started
-put: Fatal internal error
java.lang.NullPointerException: client is null
at java.util.Objects.requireNonNull(Objects.java:228)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.getClient(XceiverClientRatis.java:201)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendRequestAsync(XceiverClientRatis.java:227)
at
org.apache.hadoop.hdds.scm.XceiverClientRatis.sendCommandAsync(XceiverClientRatis.java:305)
at
org.apache.hadoop.hdds.scm.storage.ContainerProtocolCalls.writeChunkAsync(ContainerProtocolCalls.java:315)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunkToContainer(BlockOutputStream.java:599)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.writeChunk(BlockOutputStream.java:452)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.handleFlush(BlockOutputStream.java:463)
at
org.apache.hadoop.hdds.scm.storage.BlockOutputStream.close(BlockOutputStream.java:486)
at
org.apache.hadoop.ozone.client.io.BlockOutputStreamEntry.close(BlockOutputStreamEntry.java:144)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleStreamAction(KeyOutputStream.java:481)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.handleFlushOrClose(KeyOutputStream.java:455)
at
org.apache.hadoop.ozone.client.io.KeyOutputStream.close(KeyOutputStream.java:508)
at
org.apache.hadoop.fs.ozone.OzoneFSOutputStream.close(OzoneFSOutputStream.java:56)
at
org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72)
at
org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:106)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:62)
at org.apache.hadoop.io.IOUtils.copyBytes(IOUtils.java:120)
at
org.apache.hadoop.fs.shell.CommandWithDestination$TargetFileSystem.writeStreamToFile(CommandWithDestination.java:466)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyStreamToTarget(CommandWithDestination.java:391)
at
org.apache.hadoop.fs.shell.CommandWithDestination.copyFileToTarget(CommandWithDestination.java:328)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:263)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPath(CommandWithDestination.java:248)
at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:317)
at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:289)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processPathArgument(CommandWithDestination.java:243)
at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:271)
at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:255)
at
org.apache.hadoop.fs.shell.CommandWithDestination.processArguments(CommandWithDestination.java:220)
at
org.apache.hadoop.fs.shell.CopyCommands$Put.processArguments(CopyCommands.java:267)
at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:201)
at org.apache.hadoop.fs.shell.Command.run(Command.java:165)
at org.apache.hadoop.fs.FsShell.run(FsShell.java:287)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.hadoop.fs.FsShell.main(FsShell.java:340)
The same command when using ozone fs is working fine.
docker exec -it fe5d39cf6eed bash
bash-4.2$ ozone fs -put /opt/hadoop/NOTICE.txt o3fs://bucket1.vol1/kk
2020-03-22 04:41:10,999 [main] INFO impl.MetricsConfig: Loaded properties
from hadoop-metrics2.properties
2020-03-22 04:41:11,123 [main] INFO impl.MetricsSystemImpl: Scheduled
Metric snapshot period at 10 second(s).
2020-03-22 04:41:11,127 [main] INFO impl.MetricsSystemImpl:
XceiverClientMetrics metrics system started
bash-4.2$ ozone fs -ls o3fs://bucket1.vol1/
Found 1 items
-rw-rw-rw- 3 hadoop hadoop 17540 2020-03-22 04:41
o3fs://bucket1.vol1/kk
- Built from the source tarball
- Verified md5 and sha256 signatures.
- Ran smoke tests, found one above issue.
- Deployed to a 5 node docker cluster using ozone compose definition(OM +
SCM + 3 Datanodes), and ran basic ozone shell and fs commands.
Thank You, Dinesh for driving the release.
Thanks,
Bharat
On Sat, Mar 21, 2020 at 8:48 PM Arpit Agarwal <aa...@cloudera.com.invalid>
wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Deployed to 5 node cluster
> - Tried ozone shell and filesystem operations
> - Ran freon stress test for a while with write validation
>
>
> I couldn’t find the RC2 tag in the gitbox repo, although it is there in
> GitHub.
>
> Thanks,
> Arpit
>
>
>
> > On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID>
> wrote:
> >
> > Thank you Dinesh for putting up the RCs.
> >
> > +1 binding.
> >
> > Verified the following:
> > - Built from source
> > - Deployed to 5 node docker cluster and ran sanity tests.
> > - Ran smoke tests
> >
> > Thanks
> > Hanisha
> >
> >> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com>
> wrote:
> >>
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Deployed to 5 node cluster
- Tried ozone shell and filesystem operations
- Ran freon stress test for a while with write validation
I couldn’t find the RC2 tag in the gitbox repo, although it is there in GitHub.
Thanks,
Arpit
> On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID> wrote:
>
> Thank you Dinesh for putting up the RCs.
>
> +1 binding.
>
> Verified the following:
> - Built from source
> - Deployed to 5 node docker cluster and ran sanity tests.
> - Ran smoke tests
>
> Thanks
> Hanisha
>
>> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>>
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Deployed to 5 node cluster
- Tried ozone shell and filesystem operations
- Ran freon stress test for a while with write validation
I couldn’t find the RC2 tag in the gitbox repo, although it is there in GitHub.
Thanks,
Arpit
> On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID> wrote:
>
> Thank you Dinesh for putting up the RCs.
>
> +1 binding.
>
> Verified the following:
> - Built from source
> - Deployed to 5 node docker cluster and ran sanity tests.
> - Ran smoke tests
>
> Thanks
> Hanisha
>
>> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>>
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Deployed to 5 node cluster
- Tried ozone shell and filesystem operations
- Ran freon stress test for a while with write validation
I couldn’t find the RC2 tag in the gitbox repo, although it is there in GitHub.
Thanks,
Arpit
> On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID> wrote:
>
> Thank you Dinesh for putting up the RCs.
>
> +1 binding.
>
> Verified the following:
> - Built from source
> - Deployed to 5 node docker cluster and ran sanity tests.
> - Ran smoke tests
>
> Thanks
> Hanisha
>
>> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>>
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Deployed to 5 node cluster
- Tried ozone shell and filesystem operations
- Ran freon stress test for a while with write validation
I couldn’t find the RC2 tag in the gitbox repo, although it is there in GitHub.
Thanks,
Arpit
> On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID> wrote:
>
> Thank you Dinesh for putting up the RCs.
>
> +1 binding.
>
> Verified the following:
> - Built from source
> - Deployed to 5 node docker cluster and ran sanity tests.
> - Ran smoke tests
>
> Thanks
> Hanisha
>
>> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>>
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Arpit Agarwal <aa...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Deployed to 5 node cluster
- Tried ozone shell and filesystem operations
- Ran freon stress test for a while with write validation
I couldn’t find the RC2 tag in the gitbox repo, although it is there in GitHub.
Thanks,
Arpit
> On Mar 21, 2020, at 3:57 PM, Hanisha Koneru <hk...@cloudera.com.INVALID> wrote:
>
> Thank you Dinesh for putting up the RCs.
>
> +1 binding.
>
> Verified the following:
> - Built from source
> - Deployed to 5 node docker cluster and ran sanity tests.
> - Ran smoke tests
>
> Thanks
> Hanisha
>
>> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>>
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Thank you Dinesh for putting up the RCs.
+1 binding.
Verified the following:
- Built from source
- Deployed to 5 node docker cluster and ran sanity tests.
- Ran smoke tests
Thanks
Hanisha
> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Attila Doroszlai <ad...@apache.org>.
+1
* Verified GPG signature and SHA512 checksum
* Compiled sources
* Ran ozone smoke test against both binary and locally compiled versions
Thanks Dinesh for building yet another RC.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Attila Doroszlai <ad...@apache.org>.
+1
* Verified GPG signature and SHA512 checksum
* Compiled sources
* Ran ozone smoke test against both binary and locally compiled versions
Thanks Dinesh for building yet another RC.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Attila Doroszlai <ad...@apache.org>.
+1
* Verified GPG signature and SHA512 checksum
* Compiled sources
* Ran ozone smoke test against both binary and locally compiled versions
Thanks Dinesh for building yet another RC.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Attila Doroszlai <ad...@apache.org>.
+1
* Verified GPG signature and SHA512 checksum
* Compiled sources
* Ran ozone smoke test against both binary and locally compiled versions
Thanks Dinesh for building yet another RC.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Attila Doroszlai <ad...@apache.org>.
+1
* Verified GPG signature and SHA512 checksum
* Compiled sources
* Ran ozone smoke test against both binary and locally compiled versions
Thanks Dinesh for building yet another RC.
-Attila
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Thanks Runzhi for your contribution in HDDS-3041.
As discussed on Ozone Slack channel, including this fix will require a
ratis release. This will delay the Ozone release by another 4-5 weeks
atleast.
Thus we agreed to proceed with release without HDDS-3041 and then follow up
with a minor release 0.5.1 to include this fix.
Thank you for your understanding & cooperation.
Looking forward to future collaboration!
Regards,
Dinesh
On Thu, Mar 19, 2020 at 3:40 AM runzhiwang <wa...@qq.com> wrote:
>
> Hi Dinesh Chitlangia,
>
> I think 0.5.0-beta RC2 is short of the commit: HDDS-3041. Memory leak of
> s3g(#637). Contributed by Runzhi Wang, the commitID is
> 37a626064dd8ab4d435cc2c95cfec7091dc50226.
> If without this commit, make a stress testing on ozone cluster, s3g will
> memory leak and the worst is the cpu of datanode will be 100% as the image
> shows, the root cause is the bug JDK-8129861.
>
> Thanks,
> Runzhi Wang
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dinesh Chitlangia"<di...@gmail.com>;
> *发送时间:* 2020年3月16日(星期一) 上午10:27
> *收件人:* "Hadoop Common"<co...@hadoop.apache.org>;"Hdfs-dev"<
> hdfs-dev@hadoop.apache.org>;"ozone-dev"<ozone-dev@hadoop.apache.org
> >;"yarn-dev"<ya...@hadoop.apache.org>;"mapreduce-dev"<
> mapreduce-dev@hadoop.apache.org>;
> *主题:* [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Thanks Runzhi for your contribution in HDDS-3041.
As discussed on Ozone Slack channel, including this fix will require a
ratis release. This will delay the Ozone release by another 4-5 weeks
atleast.
Thus we agreed to proceed with release without HDDS-3041 and then follow up
with a minor release 0.5.1 to include this fix.
Thank you for your understanding & cooperation.
Looking forward to future collaboration!
Regards,
Dinesh
On Thu, Mar 19, 2020 at 3:40 AM runzhiwang <wa...@qq.com> wrote:
>
> Hi Dinesh Chitlangia,
>
> I think 0.5.0-beta RC2 is short of the commit: HDDS-3041. Memory leak of
> s3g(#637). Contributed by Runzhi Wang, the commitID is
> 37a626064dd8ab4d435cc2c95cfec7091dc50226.
> If without this commit, make a stress testing on ozone cluster, s3g will
> memory leak and the worst is the cpu of datanode will be 100% as the image
> shows, the root cause is the bug JDK-8129861.
>
> Thanks,
> Runzhi Wang
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dinesh Chitlangia"<di...@gmail.com>;
> *发送时间:* 2020年3月16日(星期一) 上午10:27
> *收件人:* "Hadoop Common"<co...@hadoop.apache.org>;"Hdfs-dev"<
> hdfs-dev@hadoop.apache.org>;"ozone-dev"<ozone-dev@hadoop.apache.org
> >;"yarn-dev"<ya...@hadoop.apache.org>;"mapreduce-dev"<
> mapreduce-dev@hadoop.apache.org>;
> *主题:* [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Thanks Runzhi for your contribution in HDDS-3041.
As discussed on Ozone Slack channel, including this fix will require a
ratis release. This will delay the Ozone release by another 4-5 weeks
atleast.
Thus we agreed to proceed with release without HDDS-3041 and then follow up
with a minor release 0.5.1 to include this fix.
Thank you for your understanding & cooperation.
Looking forward to future collaboration!
Regards,
Dinesh
On Thu, Mar 19, 2020 at 3:40 AM runzhiwang <wa...@qq.com> wrote:
>
> Hi Dinesh Chitlangia,
>
> I think 0.5.0-beta RC2 is short of the commit: HDDS-3041. Memory leak of
> s3g(#637). Contributed by Runzhi Wang, the commitID is
> 37a626064dd8ab4d435cc2c95cfec7091dc50226.
> If without this commit, make a stress testing on ozone cluster, s3g will
> memory leak and the worst is the cpu of datanode will be 100% as the image
> shows, the root cause is the bug JDK-8129861.
>
> Thanks,
> Runzhi Wang
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dinesh Chitlangia"<di...@gmail.com>;
> *发送时间:* 2020年3月16日(星期一) 上午10:27
> *收件人:* "Hadoop Common"<co...@hadoop.apache.org>;"Hdfs-dev"<
> hdfs-dev@hadoop.apache.org>;"ozone-dev"<ozone-dev@hadoop.apache.org
> >;"yarn-dev"<ya...@hadoop.apache.org>;"mapreduce-dev"<
> mapreduce-dev@hadoop.apache.org>;
> *主题:* [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Thanks Runzhi for your contribution in HDDS-3041.
As discussed on Ozone Slack channel, including this fix will require a
ratis release. This will delay the Ozone release by another 4-5 weeks
atleast.
Thus we agreed to proceed with release without HDDS-3041 and then follow up
with a minor release 0.5.1 to include this fix.
Thank you for your understanding & cooperation.
Looking forward to future collaboration!
Regards,
Dinesh
On Thu, Mar 19, 2020 at 3:40 AM runzhiwang <wa...@qq.com> wrote:
>
> Hi Dinesh Chitlangia,
>
> I think 0.5.0-beta RC2 is short of the commit: HDDS-3041. Memory leak of
> s3g(#637). Contributed by Runzhi Wang, the commitID is
> 37a626064dd8ab4d435cc2c95cfec7091dc50226.
> If without this commit, make a stress testing on ozone cluster, s3g will
> memory leak and the worst is the cpu of datanode will be 100% as the image
> shows, the root cause is the bug JDK-8129861.
>
> Thanks,
> Runzhi Wang
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dinesh Chitlangia"<di...@gmail.com>;
> *发送时间:* 2020年3月16日(星期一) 上午10:27
> *收件人:* "Hadoop Common"<co...@hadoop.apache.org>;"Hdfs-dev"<
> hdfs-dev@hadoop.apache.org>;"ozone-dev"<ozone-dev@hadoop.apache.org
> >;"yarn-dev"<ya...@hadoop.apache.org>;"mapreduce-dev"<
> mapreduce-dev@hadoop.apache.org>;
> *主题:* [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Thanks Runzhi for your contribution in HDDS-3041.
As discussed on Ozone Slack channel, including this fix will require a
ratis release. This will delay the Ozone release by another 4-5 weeks
atleast.
Thus we agreed to proceed with release without HDDS-3041 and then follow up
with a minor release 0.5.1 to include this fix.
Thank you for your understanding & cooperation.
Looking forward to future collaboration!
Regards,
Dinesh
On Thu, Mar 19, 2020 at 3:40 AM runzhiwang <wa...@qq.com> wrote:
>
> Hi Dinesh Chitlangia,
>
> I think 0.5.0-beta RC2 is short of the commit: HDDS-3041. Memory leak of
> s3g(#637). Contributed by Runzhi Wang, the commitID is
> 37a626064dd8ab4d435cc2c95cfec7091dc50226.
> If without this commit, make a stress testing on ozone cluster, s3g will
> memory leak and the worst is the cpu of datanode will be 100% as the image
> shows, the root cause is the bug JDK-8129861.
>
> Thanks,
> Runzhi Wang
>
>
> ------------------ 原始邮件 ------------------
> *发件人:* "Dinesh Chitlangia"<di...@gmail.com>;
> *发送时间:* 2020年3月16日(星期一) 上午10:27
> *收件人:* "Hadoop Common"<co...@hadoop.apache.org>;"Hdfs-dev"<
> hdfs-dev@hadoop.apache.org>;"ozone-dev"<ozone-dev@hadoop.apache.org
> >;"yarn-dev"<ya...@hadoop.apache.org>;"mapreduce-dev"<
> mapreduce-dev@hadoop.apache.org>;
> *主题:* [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
>
回复：[VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by runzhiwang <wa...@qq.com>.
Hi Dinesh Chitlangia,
I think 0.5.0-beta RC2 is short of the commit: HDDS-3041. Memory leak of s3g(#637). Contributed by Runzhi Wang, the commitID is 37a626064dd8ab4d435cc2c95cfec7091dc50226.
If without this commit, make a stress testing on ozone cluster, s3g will memory leak and the worst is the cpu of datanode will be 100% as the image shows, the root cause is the bug JDK-8129861.
Thanks,
Runzhi Wang
------------------ 原始邮件 ------------------
发件人: "Dinesh Chitlangia"<dineshc.asf@gmail.com>;
发送时间: 2020年3月16日(星期一) 上午10:27
收件人: "Hadoop Common"<common-dev@hadoop.apache.org>;"Hdfs-dev"<hdfs-dev@hadoop.apache.org>;"ozone-dev"<ozone-dev@hadoop.apache.org>;"yarn-dev"<yarn-dev@hadoop.apache.org>;"mapreduce-dev"<mapreduce-dev@hadoop.apache.org>;
主题: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Hi Folks,
We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
The RC artifacts are at:
https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
The public key used for signing the artifacts can be found at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
The maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1262
The RC tag in git is at:
https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
This release contains 800+ fixes/improvements [1].
Thanks to everyone who put in the effort to make this happen.
*The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
Note: This release is beta quality, it’s not recommended to use in
production but we believe that it’s stable enough to try out the feature
set and collect feedback.
[1] https://s.apache.org/ozone-0.5.0-fixed-issues
Thanks,
Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Sammi Chen <sa...@apache.org>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Verfied that the last commit of release binary matches the tag
- Start a ozone cluster with docker compose
- Run ozone sh and scmcli commands
- Run freon to create 100k keys with validation
Thanks Dinesh for driving the release.
Bests,
Sammi
On Mon, Mar 16, 2020 at 10:27 AM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
回复：[VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by runzhiwang <wa...@qq.com>.
+1 (non-binding)
Verified mds, sha512
Built from source
Deployed to 48 node cluster on k8s
Tried a few ozone shell and filesystem commands
Thanks Dinesh for putting the RC1 together.
------------------ 原始邮件 ------------------
发件人: "Dinesh Chitlangia"<dineshc.asf@gmail.com>;
发送时间: 2020年3月16日(星期一) 上午10:27
收件人: "Hadoop Common"<common-dev@hadoop.apache.org>;"Hdfs-dev"<hdfs-dev@hadoop.apache.org>;"ozone-dev"<ozone-dev@hadoop.apache.org>;"yarn-dev"<yarn-dev@hadoop.apache.org>;"mapreduce-dev"<mapreduce-dev@hadoop.apache.org>;
主题: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Hi Folks,
We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
The RC artifacts are at:
https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
The public key used for signing the artifacts can be found at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
The maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1262
The RC tag in git is at:
https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
This release contains 800+ fixes/improvements [1].
Thanks to everyone who put in the effort to make this happen.
*The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
Note: This release is beta quality, it’s not recommended to use in
production but we believe that it’s stable enough to try out the feature
set and collect feedback.
[1] https://s.apache.org/ozone-0.5.0-fixed-issues
Thanks,
Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Ayush Saxena <ay...@gmail.com>.
+1(non binding)
*Built from source
*Verified Checksums
*Ran some basic Shell Commands.
Thanx Dinesh for driving the release.
-Ayush
On Mon, 16 Mar 2020 at 07:57, Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Sammi Chen <sa...@apache.org>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Verfied that the last commit of release binary matches the tag
- Start a ozone cluster with docker compose
- Run ozone sh and scmcli commands
- Run freon to create 100k keys with validation
Thanks Dinesh for driving the release.
Bests,
Sammi
On Mon, Mar 16, 2020 at 10:27 AM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Sammi Chen <sa...@apache.org>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Verfied that the last commit of release binary matches the tag
- Start a ozone cluster with docker compose
- Run ozone sh and scmcli commands
- Run freon to create 100k keys with validation
Thanks Dinesh for driving the release.
Bests,
Sammi
On Mon, Mar 16, 2020 at 10:27 AM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Thank you Dinesh for putting up the RCs.
+1 binding.
Verified the following:
- Built from source
- Deployed to 5 node docker cluster and ran sanity tests.
- Ran smoke tests
Thanks
Hanisha
> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by mingchao zhao <ca...@gmail.com>.
+1
Verify the GPG and SHA512.
Compiled the source code.
Deploy the docker environment through docker-compose and tested common
ozone commands.
Set up a single node environment, using the filesystem API to test the
common interface and looks good.
Thanks to Dinesh for helping to release this version.
Elek, Marton <el...@apache.org> 于2020年3月20日周五 下午7:14写道：
> +1
>
> * signatures checked
> * sha512 checked
> * can be built from the source (without using my local mvn cache:
> using apache/ozone-build docker image)
> * created docker image with the provided Dockerfile
> * Deployed to Kubernetes together with Yarn and Hdfs
> * tested with 100G teragen (one pipeline, storage/execution were
> separated)
>
>
> Thank you Dinesh for the continuous effort for this release.
>
> Marton
>
> On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> > Hi Folks,
> >
> > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >
> > The RC artifacts are at:
> > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >
> > The public key used for signing the artifacts can be found at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >
> > The RC tag in git is at:
> > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >
> > This release contains 800+ fixes/improvements [1].
> > Thanks to everyone who put in the effort to make this happen.
> >
> > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >
> > Note: This release is beta quality, it’s not recommended to use in
> > production but we believe that it’s stable enough to try out the feature
> > set and collect feedback.
> >
> >
> > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >
> > Thanks,
> > Dinesh Chitlangia
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
>
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Sure Zoltan, we will review this and take care in future releases.
On Fri, Mar 20, 2020 at 8:20 AM Zoltan Haindrich <ki...@rxd.hu> wrote:
>
> The artifacts with sources classifiers seem to be missing:
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
> is that by design? I know that this is a beta - so it's okay; but could we
> have that in some release?
>
> cheers,
> Zoltan
>
> On 3/20/20 12:13 PM, Elek, Marton wrote:
> > +1
> >
> > * signatures checked
> > * sha512 checked
> > * can be built from the source (without using my local mvn cache:
> using apache/ozone-build docker image)
> > * created docker image with the provided Dockerfile
> > * Deployed to Kubernetes together with Yarn and Hdfs
> > * tested with 100G teragen (one pipeline, storage/execution were
> separated)
> >
> >
> > Thank you Dinesh for the continuous effort for this release.
> >
> > Marton
> >
> > On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Sure Zoltan, we will review this and take care in future releases.
On Fri, Mar 20, 2020 at 8:20 AM Zoltan Haindrich <ki...@rxd.hu> wrote:
>
> The artifacts with sources classifiers seem to be missing:
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
> is that by design? I know that this is a beta - so it's okay; but could we
> have that in some release?
>
> cheers,
> Zoltan
>
> On 3/20/20 12:13 PM, Elek, Marton wrote:
> > +1
> >
> > * signatures checked
> > * sha512 checked
> > * can be built from the source (without using my local mvn cache:
> using apache/ozone-build docker image)
> > * created docker image with the provided Dockerfile
> > * Deployed to Kubernetes together with Yarn and Hdfs
> > * tested with 100G teragen (one pipeline, storage/execution were
> separated)
> >
> >
> > Thank you Dinesh for the continuous effort for this release.
> >
> > Marton
> >
> > On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Sure Zoltan, we will review this and take care in future releases.
On Fri, Mar 20, 2020 at 8:20 AM Zoltan Haindrich <ki...@rxd.hu> wrote:
>
> The artifacts with sources classifiers seem to be missing:
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
> is that by design? I know that this is a beta - so it's okay; but could we
> have that in some release?
>
> cheers,
> Zoltan
>
> On 3/20/20 12:13 PM, Elek, Marton wrote:
> > +1
> >
> > * signatures checked
> > * sha512 checked
> > * can be built from the source (without using my local mvn cache:
> using apache/ozone-build docker image)
> > * created docker image with the provided Dockerfile
> > * Deployed to Kubernetes together with Yarn and Hdfs
> > * tested with 100G teragen (one pipeline, storage/execution were
> separated)
> >
> >
> > Thank you Dinesh for the continuous effort for this release.
> >
> > Marton
> >
> > On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Sure Zoltan, we will review this and take care in future releases.
On Fri, Mar 20, 2020 at 8:20 AM Zoltan Haindrich <ki...@rxd.hu> wrote:
>
> The artifacts with sources classifiers seem to be missing:
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
> is that by design? I know that this is a beta - so it's okay; but could we
> have that in some release?
>
> cheers,
> Zoltan
>
> On 3/20/20 12:13 PM, Elek, Marton wrote:
> > +1
> >
> > * signatures checked
> > * sha512 checked
> > * can be built from the source (without using my local mvn cache:
> using apache/ozone-build docker image)
> > * created docker image with the provided Dockerfile
> > * Deployed to Kubernetes together with Yarn and Hdfs
> > * tested with 100G teragen (one pipeline, storage/execution were
> separated)
> >
> >
> > Thank you Dinesh for the continuous effort for this release.
> >
> > Marton
> >
> > On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Sure Zoltan, we will review this and take care in future releases.
On Fri, Mar 20, 2020 at 8:20 AM Zoltan Haindrich <ki...@rxd.hu> wrote:
>
> The artifacts with sources classifiers seem to be missing:
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
> is that by design? I know that this is a beta - so it's okay; but could we
> have that in some release?
>
> cheers,
> Zoltan
>
> On 3/20/20 12:13 PM, Elek, Marton wrote:
> > +1
> >
> > * signatures checked
> > * sha512 checked
> > * can be built from the source (without using my local mvn cache:
> using apache/ozone-build docker image)
> > * created docker image with the provided Dockerfile
> > * Deployed to Kubernetes together with Yarn and Hdfs
> > * tested with 100G teragen (one pipeline, storage/execution were
> separated)
> >
> >
> > Thank you Dinesh for the continuous effort for this release.
> >
> > Marton
> >
> > On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> >> Hi Folks,
> >>
> >> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >>
> >> The RC artifacts are at:
> >> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >>
> >> The public key used for signing the artifacts can be found at:
> >> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >>
> >> The maven artifacts are staged at:
> >> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >>
> >> The RC tag in git is at:
> >> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >>
> >> This release contains 800+ fixes/improvements [1].
> >> Thanks to everyone who put in the effort to make this happen.
> >>
> >> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >>
> >> Note: This release is beta quality, it’s not recommended to use in
> >> production but we believe that it’s stable enough to try out the feature
> >> set and collect feedback.
> >>
> >>
> >> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >>
> >> Thanks,
> >> Dinesh Chitlangia
> >>
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> > For additional commands, e-mail: common-dev-help@hadoop.apache.org
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Zoltan Haindrich <ki...@rxd.hu>.
The artifacts with sources classifiers seem to be missing:
https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
is that by design? I know that this is a beta - so it's okay; but could we have that in some release?
cheers,
Zoltan
On 3/20/20 12:13 PM, Elek, Marton wrote:
> +1
>
> * signatures checked
> * sha512 checked
> * can be built from the source (without using my local mvn cache: using apache/ozone-build docker image)
> * created docker image with the provided Dockerfile
> * Deployed to Kubernetes together with Yarn and Hdfs
> * tested with 100G teragen (one pipeline, storage/execution were separated)
>
>
> Thank you Dinesh for the continuous effort for this release.
>
> Marton
>
> On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Zoltan Haindrich <ki...@rxd.hu>.
The artifacts with sources classifiers seem to be missing:
https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
is that by design? I know that this is a beta - so it's okay; but could we have that in some release?
cheers,
Zoltan
On 3/20/20 12:13 PM, Elek, Marton wrote:
> +1
>
> * signatures checked
> * sha512 checked
> * can be built from the source (without using my local mvn cache: using apache/ozone-build docker image)
> * created docker image with the provided Dockerfile
> * Deployed to Kubernetes together with Yarn and Hdfs
> * tested with 100G teragen (one pipeline, storage/execution were separated)
>
>
> Thank you Dinesh for the continuous effort for this release.
>
> Marton
>
> On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Zoltan Haindrich <ki...@rxd.hu>.
The artifacts with sources classifiers seem to be missing:
https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
is that by design? I know that this is a beta - so it's okay; but could we have that in some release?
cheers,
Zoltan
On 3/20/20 12:13 PM, Elek, Marton wrote:
> +1
>
> * signatures checked
> * sha512 checked
> * can be built from the source (without using my local mvn cache: using apache/ozone-build docker image)
> * created docker image with the provided Dockerfile
> * Deployed to Kubernetes together with Yarn and Hdfs
> * tested with 100G teragen (one pipeline, storage/execution were separated)
>
>
> Thank you Dinesh for the continuous effort for this release.
>
> Marton
>
> On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Zoltan Haindrich <ki...@rxd.hu>.
The artifacts with sources classifiers seem to be missing:
https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
is that by design? I know that this is a beta - so it's okay; but could we have that in some release?
cheers,
Zoltan
On 3/20/20 12:13 PM, Elek, Marton wrote:
> +1
>
> * signatures checked
> * sha512 checked
> * can be built from the source (without using my local mvn cache: using apache/ozone-build docker image)
> * created docker image with the provided Dockerfile
> * Deployed to Kubernetes together with Yarn and Hdfs
> * tested with 100G teragen (one pipeline, storage/execution were separated)
>
>
> Thank you Dinesh for the continuous effort for this release.
>
> Marton
>
> On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Zoltan Haindrich <ki...@rxd.hu>.
The artifacts with sources classifiers seem to be missing:
https://repository.apache.org/content/repositories/orgapachehadoop-1262/org/apache/hadoop/hadoop-hdds-client/0.5.0-beta/
is that by design? I know that this is a beta - so it's okay; but could we have that in some release?
cheers,
Zoltan
On 3/20/20 12:13 PM, Elek, Marton wrote:
> +1
>
> * signatures checked
> * sha512 checked
> * can be built from the source (without using my local mvn cache: using apache/ozone-build docker image)
> * created docker image with the provided Dockerfile
> * Deployed to Kubernetes together with Yarn and Hdfs
> * tested with 100G teragen (one pipeline, storage/execution were separated)
>
>
> Thank you Dinesh for the continuous effort for this release.
>
> Marton
>
> On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
>> Hi Folks,
>>
>> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>>
>> The RC artifacts are at:
>> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>>
>> The public key used for signing the artifacts can be found at:
>> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>>
>> The maven artifacts are staged at:
>> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>>
>> The RC tag in git is at:
>> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>>
>> This release contains 800+ fixes/improvements [1].
>> Thanks to everyone who put in the effort to make this happen.
>>
>> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>>
>> Note: This release is beta quality, it’s not recommended to use in
>> production but we believe that it’s stable enough to try out the feature
>> set and collect feedback.
>>
>>
>> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>>
>> Thanks,
>> Dinesh Chitlangia
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by "Elek, Marton" <el...@apache.org>.
+1
* signatures checked
* sha512 checked
* can be built from the source (without using my local mvn cache:
using apache/ozone-build docker image)
* created docker image with the provided Dockerfile
* Deployed to Kubernetes together with Yarn and Hdfs
* tested with 100G teragen (one pipeline, storage/execution were
separated)
Thank you Dinesh for the continuous effort for this release.
Marton
On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Ayush Saxena <ay...@gmail.com>.
+1(non binding)
*Built from source
*Verified Checksums
*Ran some basic Shell Commands.
Thanx Dinesh for driving the release.
-Ayush
On Mon, 16 Mar 2020 at 07:57, Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2(Internet mail)
Posted by "timmycheng (程力)" <ti...@tencent.com>.
+1
Verified all signatures.
Built from tag branch.
Ran freon test on 3 node env.
Tried deploying to a test cluster of 4 VMs. CLI and s3g works well.
-Li
On 2020/3/23, 5:51 AM, "Aravindan Vijayan" <av...@cloudera.com.INVALID> wrote:
+1
Deployed a 3 node cluster
Tried ozone shell and filesystem commands
Ran freon load generator
Thanks Dinesh for working on the RC2.
On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Hi All,
Voting has ended with:
6 binding +1s
7 non-binding +1s (including mine)
0 -1s
0 0s
A few minor issues were reported by Xiaoyu/Bharat, I will file jira for
those.
I will proceed with releasing the artifacts and announcement.
Thank you all for voting for Ozone 0.5.0 beta RC2.
Regards,
Dinesh
On Mon, Mar 23, 2020 at 7:17 AM Shashikant Banerjee
<sb...@cloudera.com.invalid> wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Ran Freon Random key generator
> - Verified unit tests
>
>
> Thanks Dinesh for driving the release.
>
> Thanks
> Shashi
>
> On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
> wrote:
>
> > +1 binding
> > Download source and verify signature.
> > Verify build and documents.
> > Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> > Verify multiple RATIS-3 pipelines are created as expected.
> > Tried ozone shell commands via o3 and o3fs, focus on security and HA
> > related.
> > Only find a few minor issues that we can fix in followup JIRAs.
> > 1) ozone getconf -ozonemanagers does not return all the om instances
> > bash-4.2$ ozone getconf -ozonemanagers
> > 0.0.0.0
> > 2) The document on specifying service/ID can be improved. More
> > specifically, the URI should give examples for the Service ID in HA.
> > Currently, it only mentions host/port.
> >
> > ozone sh vol create /vol1
> > Service ID or host name must not be omitted when ozone.om.service.ids is
> > defined.
> > bash-4.2$ ozone sh vol create --help
> > Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> > <uri>
> > Creates a volume for the specified user
> > <uri> URI of the volume.
> > Ozone URI could start with o3:// or without
> > prefix. URI
> > may contain the host and port of the OM
> server.
> > Both are
> > optional. If they are not specified it will
> be
> > identified from the config files.
> > 3). ozone scmcli container list seems report incorrect numberOfKeys and
> > usedBytes
> > Also, container owner is set as the current leader om(om3), should we use
> > the om service id here instead?
> > bash-4.2$ ozone scmcli container list
> > {
> > "state" : "OPEN",
> > "replicationFactor" : "THREE",
> > "replicationType" : "RATIS",
> > "usedBytes" : 3813,
> > "numberOfKeys" : 1,
> > ...
> > bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k1",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:23:30.670Z",
> > "modificationTime" : "2020-03-23T03:23:33.207Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k2",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:18:46.735Z",
> > "modificationTime" : "2020-03-23T03:20:15.005Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> >
> >
> > Run freon with random key generation.
> >
> > Thanks Dinesh for driving the the release of Beta RC2.
> >
> > Xiaoyu
> >
> > On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> > <av...@cloudera.com.invalid> wrote:
> >
> > > +1
> > > Deployed a 3 node cluster
> > > Tried ozone shell and filesystem commands
> > > Ran freon load generator
> > >
> > > Thanks Dinesh for working on the RC2.
> > >
> > > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <
> dineshc.asf@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi Folks,
> > > >
> > > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > > >
> > > > The RC artifacts are at:
> > > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > > >
> > > > The public key used for signing the artifacts can be found at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > The maven artifacts are staged at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > > >
> > > > The RC tag in git is at:
> > > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > > >
> > > > This release contains 800+ fixes/improvements [1].
> > > > Thanks to everyone who put in the effort to make this happen.
> > > >
> > > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > > PST.*
> > > >
> > > > Note: This release is beta quality, it’s not recommended to use in
> > > > production but we believe that it’s stable enough to try out the
> > feature
> > > > set and collect feedback.
> > > >
> > > >
> > > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > > >
> > > > Thanks,
> > > > Dinesh Chitlangia
> > > >
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Hi All,
Voting has ended with:
6 binding +1s
7 non-binding +1s (including mine)
0 -1s
0 0s
A few minor issues were reported by Xiaoyu/Bharat, I will file jira for
those.
I will proceed with releasing the artifacts and announcement.
Thank you all for voting for Ozone 0.5.0 beta RC2.
Regards,
Dinesh
On Mon, Mar 23, 2020 at 7:17 AM Shashikant Banerjee
<sb...@cloudera.com.invalid> wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Ran Freon Random key generator
> - Verified unit tests
>
>
> Thanks Dinesh for driving the release.
>
> Thanks
> Shashi
>
> On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
> wrote:
>
> > +1 binding
> > Download source and verify signature.
> > Verify build and documents.
> > Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> > Verify multiple RATIS-3 pipelines are created as expected.
> > Tried ozone shell commands via o3 and o3fs, focus on security and HA
> > related.
> > Only find a few minor issues that we can fix in followup JIRAs.
> > 1) ozone getconf -ozonemanagers does not return all the om instances
> > bash-4.2$ ozone getconf -ozonemanagers
> > 0.0.0.0
> > 2) The document on specifying service/ID can be improved. More
> > specifically, the URI should give examples for the Service ID in HA.
> > Currently, it only mentions host/port.
> >
> > ozone sh vol create /vol1
> > Service ID or host name must not be omitted when ozone.om.service.ids is
> > defined.
> > bash-4.2$ ozone sh vol create --help
> > Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> > <uri>
> > Creates a volume for the specified user
> > <uri> URI of the volume.
> > Ozone URI could start with o3:// or without
> > prefix. URI
> > may contain the host and port of the OM
> server.
> > Both are
> > optional. If they are not specified it will
> be
> > identified from the config files.
> > 3). ozone scmcli container list seems report incorrect numberOfKeys and
> > usedBytes
> > Also, container owner is set as the current leader om(om3), should we use
> > the om service id here instead?
> > bash-4.2$ ozone scmcli container list
> > {
> > "state" : "OPEN",
> > "replicationFactor" : "THREE",
> > "replicationType" : "RATIS",
> > "usedBytes" : 3813,
> > "numberOfKeys" : 1,
> > ...
> > bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k1",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:23:30.670Z",
> > "modificationTime" : "2020-03-23T03:23:33.207Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k2",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:18:46.735Z",
> > "modificationTime" : "2020-03-23T03:20:15.005Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> >
> >
> > Run freon with random key generation.
> >
> > Thanks Dinesh for driving the the release of Beta RC2.
> >
> > Xiaoyu
> >
> > On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> > <av...@cloudera.com.invalid> wrote:
> >
> > > +1
> > > Deployed a 3 node cluster
> > > Tried ozone shell and filesystem commands
> > > Ran freon load generator
> > >
> > > Thanks Dinesh for working on the RC2.
> > >
> > > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <
> dineshc.asf@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi Folks,
> > > >
> > > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > > >
> > > > The RC artifacts are at:
> > > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > > >
> > > > The public key used for signing the artifacts can be found at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > The maven artifacts are staged at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > > >
> > > > The RC tag in git is at:
> > > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > > >
> > > > This release contains 800+ fixes/improvements [1].
> > > > Thanks to everyone who put in the effort to make this happen.
> > > >
> > > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > > PST.*
> > > >
> > > > Note: This release is beta quality, it’s not recommended to use in
> > > > production but we believe that it’s stable enough to try out the
> > feature
> > > > set and collect feedback.
> > > >
> > > >
> > > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > > >
> > > > Thanks,
> > > > Dinesh Chitlangia
> > > >
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Hi All,
Voting has ended with:
6 binding +1s
7 non-binding +1s (including mine)
0 -1s
0 0s
A few minor issues were reported by Xiaoyu/Bharat, I will file jira for
those.
I will proceed with releasing the artifacts and announcement.
Thank you all for voting for Ozone 0.5.0 beta RC2.
Regards,
Dinesh
On Mon, Mar 23, 2020 at 7:17 AM Shashikant Banerjee
<sb...@cloudera.com.invalid> wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Ran Freon Random key generator
> - Verified unit tests
>
>
> Thanks Dinesh for driving the release.
>
> Thanks
> Shashi
>
> On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
> wrote:
>
> > +1 binding
> > Download source and verify signature.
> > Verify build and documents.
> > Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> > Verify multiple RATIS-3 pipelines are created as expected.
> > Tried ozone shell commands via o3 and o3fs, focus on security and HA
> > related.
> > Only find a few minor issues that we can fix in followup JIRAs.
> > 1) ozone getconf -ozonemanagers does not return all the om instances
> > bash-4.2$ ozone getconf -ozonemanagers
> > 0.0.0.0
> > 2) The document on specifying service/ID can be improved. More
> > specifically, the URI should give examples for the Service ID in HA.
> > Currently, it only mentions host/port.
> >
> > ozone sh vol create /vol1
> > Service ID or host name must not be omitted when ozone.om.service.ids is
> > defined.
> > bash-4.2$ ozone sh vol create --help
> > Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> > <uri>
> > Creates a volume for the specified user
> > <uri> URI of the volume.
> > Ozone URI could start with o3:// or without
> > prefix. URI
> > may contain the host and port of the OM
> server.
> > Both are
> > optional. If they are not specified it will
> be
> > identified from the config files.
> > 3). ozone scmcli container list seems report incorrect numberOfKeys and
> > usedBytes
> > Also, container owner is set as the current leader om(om3), should we use
> > the om service id here instead?
> > bash-4.2$ ozone scmcli container list
> > {
> > "state" : "OPEN",
> > "replicationFactor" : "THREE",
> > "replicationType" : "RATIS",
> > "usedBytes" : 3813,
> > "numberOfKeys" : 1,
> > ...
> > bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k1",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:23:30.670Z",
> > "modificationTime" : "2020-03-23T03:23:33.207Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k2",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:18:46.735Z",
> > "modificationTime" : "2020-03-23T03:20:15.005Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> >
> >
> > Run freon with random key generation.
> >
> > Thanks Dinesh for driving the the release of Beta RC2.
> >
> > Xiaoyu
> >
> > On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> > <av...@cloudera.com.invalid> wrote:
> >
> > > +1
> > > Deployed a 3 node cluster
> > > Tried ozone shell and filesystem commands
> > > Ran freon load generator
> > >
> > > Thanks Dinesh for working on the RC2.
> > >
> > > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <
> dineshc.asf@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi Folks,
> > > >
> > > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > > >
> > > > The RC artifacts are at:
> > > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > > >
> > > > The public key used for signing the artifacts can be found at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > The maven artifacts are staged at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > > >
> > > > The RC tag in git is at:
> > > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > > >
> > > > This release contains 800+ fixes/improvements [1].
> > > > Thanks to everyone who put in the effort to make this happen.
> > > >
> > > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > > PST.*
> > > >
> > > > Note: This release is beta quality, it’s not recommended to use in
> > > > production but we believe that it’s stable enough to try out the
> > feature
> > > > set and collect feedback.
> > > >
> > > >
> > > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > > >
> > > > Thanks,
> > > > Dinesh Chitlangia
> > > >
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Hi All,
Voting has ended with:
6 binding +1s
7 non-binding +1s (including mine)
0 -1s
0 0s
A few minor issues were reported by Xiaoyu/Bharat, I will file jira for
those.
I will proceed with releasing the artifacts and announcement.
Thank you all for voting for Ozone 0.5.0 beta RC2.
Regards,
Dinesh
On Mon, Mar 23, 2020 at 7:17 AM Shashikant Banerjee
<sb...@cloudera.com.invalid> wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Ran Freon Random key generator
> - Verified unit tests
>
>
> Thanks Dinesh for driving the release.
>
> Thanks
> Shashi
>
> On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
> wrote:
>
> > +1 binding
> > Download source and verify signature.
> > Verify build and documents.
> > Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> > Verify multiple RATIS-3 pipelines are created as expected.
> > Tried ozone shell commands via o3 and o3fs, focus on security and HA
> > related.
> > Only find a few minor issues that we can fix in followup JIRAs.
> > 1) ozone getconf -ozonemanagers does not return all the om instances
> > bash-4.2$ ozone getconf -ozonemanagers
> > 0.0.0.0
> > 2) The document on specifying service/ID can be improved. More
> > specifically, the URI should give examples for the Service ID in HA.
> > Currently, it only mentions host/port.
> >
> > ozone sh vol create /vol1
> > Service ID or host name must not be omitted when ozone.om.service.ids is
> > defined.
> > bash-4.2$ ozone sh vol create --help
> > Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> > <uri>
> > Creates a volume for the specified user
> > <uri> URI of the volume.
> > Ozone URI could start with o3:// or without
> > prefix. URI
> > may contain the host and port of the OM
> server.
> > Both are
> > optional. If they are not specified it will
> be
> > identified from the config files.
> > 3). ozone scmcli container list seems report incorrect numberOfKeys and
> > usedBytes
> > Also, container owner is set as the current leader om(om3), should we use
> > the om service id here instead?
> > bash-4.2$ ozone scmcli container list
> > {
> > "state" : "OPEN",
> > "replicationFactor" : "THREE",
> > "replicationType" : "RATIS",
> > "usedBytes" : 3813,
> > "numberOfKeys" : 1,
> > ...
> > bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k1",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:23:30.670Z",
> > "modificationTime" : "2020-03-23T03:23:33.207Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k2",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:18:46.735Z",
> > "modificationTime" : "2020-03-23T03:20:15.005Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> >
> >
> > Run freon with random key generation.
> >
> > Thanks Dinesh for driving the the release of Beta RC2.
> >
> > Xiaoyu
> >
> > On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> > <av...@cloudera.com.invalid> wrote:
> >
> > > +1
> > > Deployed a 3 node cluster
> > > Tried ozone shell and filesystem commands
> > > Ran freon load generator
> > >
> > > Thanks Dinesh for working on the RC2.
> > >
> > > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <
> dineshc.asf@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi Folks,
> > > >
> > > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > > >
> > > > The RC artifacts are at:
> > > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > > >
> > > > The public key used for signing the artifacts can be found at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > The maven artifacts are staged at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > > >
> > > > The RC tag in git is at:
> > > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > > >
> > > > This release contains 800+ fixes/improvements [1].
> > > > Thanks to everyone who put in the effort to make this happen.
> > > >
> > > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > > PST.*
> > > >
> > > > Note: This release is beta quality, it’s not recommended to use in
> > > > production but we believe that it’s stable enough to try out the
> > feature
> > > > set and collect feedback.
> > > >
> > > >
> > > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > > >
> > > > Thanks,
> > > > Dinesh Chitlangia
> > > >
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Dinesh Chitlangia <di...@gmail.com>.
Hi All,
Voting has ended with:
6 binding +1s
7 non-binding +1s (including mine)
0 -1s
0 0s
A few minor issues were reported by Xiaoyu/Bharat, I will file jira for
those.
I will proceed with releasing the artifacts and announcement.
Thank you all for voting for Ozone 0.5.0 beta RC2.
Regards,
Dinesh
On Mon, Mar 23, 2020 at 7:17 AM Shashikant Banerjee
<sb...@cloudera.com.invalid> wrote:
> +1 binding.
>
> - Verified hashes and signatures
> - Built from source
> - Ran Freon Random key generator
> - Verified unit tests
>
>
> Thanks Dinesh for driving the release.
>
> Thanks
> Shashi
>
> On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
> wrote:
>
> > +1 binding
> > Download source and verify signature.
> > Verify build and documents.
> > Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> > Verify multiple RATIS-3 pipelines are created as expected.
> > Tried ozone shell commands via o3 and o3fs, focus on security and HA
> > related.
> > Only find a few minor issues that we can fix in followup JIRAs.
> > 1) ozone getconf -ozonemanagers does not return all the om instances
> > bash-4.2$ ozone getconf -ozonemanagers
> > 0.0.0.0
> > 2) The document on specifying service/ID can be improved. More
> > specifically, the URI should give examples for the Service ID in HA.
> > Currently, it only mentions host/port.
> >
> > ozone sh vol create /vol1
> > Service ID or host name must not be omitted when ozone.om.service.ids is
> > defined.
> > bash-4.2$ ozone sh vol create --help
> > Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> > <uri>
> > Creates a volume for the specified user
> > <uri> URI of the volume.
> > Ozone URI could start with o3:// or without
> > prefix. URI
> > may contain the host and port of the OM
> server.
> > Both are
> > optional. If they are not specified it will
> be
> > identified from the config files.
> > 3). ozone scmcli container list seems report incorrect numberOfKeys and
> > usedBytes
> > Also, container owner is set as the current leader om(om3), should we use
> > the om service id here instead?
> > bash-4.2$ ozone scmcli container list
> > {
> > "state" : "OPEN",
> > "replicationFactor" : "THREE",
> > "replicationType" : "RATIS",
> > "usedBytes" : 3813,
> > "numberOfKeys" : 1,
> > ...
> > bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k1",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:23:30.670Z",
> > "modificationTime" : "2020-03-23T03:23:33.207Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> > {
> > "volumeName" : "vol1",
> > "bucketName" : "bucket1",
> > "name" : "k2",
> > "dataSize" : 3813,
> > "creationTime" : "2020-03-23T03:18:46.735Z",
> > "modificationTime" : "2020-03-23T03:20:15.005Z",
> > "replicationType" : "RATIS",
> > "replicationFactor" : 3
> > }
> >
> >
> > Run freon with random key generation.
> >
> > Thanks Dinesh for driving the the release of Beta RC2.
> >
> > Xiaoyu
> >
> > On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> > <av...@cloudera.com.invalid> wrote:
> >
> > > +1
> > > Deployed a 3 node cluster
> > > Tried ozone shell and filesystem commands
> > > Ran freon load generator
> > >
> > > Thanks Dinesh for working on the RC2.
> > >
> > > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <
> dineshc.asf@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi Folks,
> > > >
> > > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > > >
> > > > The RC artifacts are at:
> > > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > > >
> > > > The public key used for signing the artifacts can be found at:
> > > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > > >
> > > > The maven artifacts are staged at:
> > > >
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > > >
> > > > The RC tag in git is at:
> > > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > > >
> > > > This release contains 800+ fixes/improvements [1].
> > > > Thanks to everyone who put in the effort to make this happen.
> > > >
> > > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > > PST.*
> > > >
> > > > Note: This release is beta quality, it’s not recommended to use in
> > > > production but we believe that it’s stable enough to try out the
> > feature
> > > > set and collect feedback.
> > > >
> > > >
> > > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > > >
> > > > Thanks,
> > > > Dinesh Chitlangia
> > > >
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Shashikant Banerjee <sb...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Ran Freon Random key generator
- Verified unit tests
Thanks Dinesh for driving the release.
Thanks
Shashi
On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
wrote:
> +1 binding
> Download source and verify signature.
> Verify build and documents.
> Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> Verify multiple RATIS-3 pipelines are created as expected.
> Tried ozone shell commands via o3 and o3fs, focus on security and HA
> related.
> Only find a few minor issues that we can fix in followup JIRAs.
> 1) ozone getconf -ozonemanagers does not return all the om instances
> bash-4.2$ ozone getconf -ozonemanagers
> 0.0.0.0
> 2) The document on specifying service/ID can be improved. More
> specifically, the URI should give examples for the Service ID in HA.
> Currently, it only mentions host/port.
>
> ozone sh vol create /vol1
> Service ID or host name must not be omitted when ozone.om.service.ids is
> defined.
> bash-4.2$ ozone sh vol create --help
> Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> <uri>
> Creates a volume for the specified user
> <uri> URI of the volume.
> Ozone URI could start with o3:// or without
> prefix. URI
> may contain the host and port of the OM server.
> Both are
> optional. If they are not specified it will be
> identified from the config files.
> 3). ozone scmcli container list seems report incorrect numberOfKeys and
> usedBytes
> Also, container owner is set as the current leader om(om3), should we use
> the om service id here instead?
> bash-4.2$ ozone scmcli container list
> {
> "state" : "OPEN",
> "replicationFactor" : "THREE",
> "replicationType" : "RATIS",
> "usedBytes" : 3813,
> "numberOfKeys" : 1,
> ...
> bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k1",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:23:30.670Z",
> "modificationTime" : "2020-03-23T03:23:33.207Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k2",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:18:46.735Z",
> "modificationTime" : "2020-03-23T03:20:15.005Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
>
>
> Run freon with random key generation.
>
> Thanks Dinesh for driving the the release of Beta RC2.
>
> Xiaoyu
>
> On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> <av...@cloudera.com.invalid> wrote:
>
> > +1
> > Deployed a 3 node cluster
> > Tried ozone shell and filesystem commands
> > Ran freon load generator
> >
> > Thanks Dinesh for working on the RC2.
> >
> > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <dineshc.asf@gmail.com
> >
> > wrote:
> >
> > > Hi Folks,
> > >
> > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > >
> > > The RC artifacts are at:
> > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > >
> > > The public key used for signing the artifacts can be found at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > The maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > >
> > > The RC tag in git is at:
> > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > >
> > > This release contains 800+ fixes/improvements [1].
> > > Thanks to everyone who put in the effort to make this happen.
> > >
> > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > PST.*
> > >
> > > Note: This release is beta quality, it’s not recommended to use in
> > > production but we believe that it’s stable enough to try out the
> feature
> > > set and collect feedback.
> > >
> > >
> > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > >
> > > Thanks,
> > > Dinesh Chitlangia
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Shashikant Banerjee <sb...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Ran Freon Random key generator
- Verified unit tests
Thanks Dinesh for driving the release.
Thanks
Shashi
On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
wrote:
> +1 binding
> Download source and verify signature.
> Verify build and documents.
> Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> Verify multiple RATIS-3 pipelines are created as expected.
> Tried ozone shell commands via o3 and o3fs, focus on security and HA
> related.
> Only find a few minor issues that we can fix in followup JIRAs.
> 1) ozone getconf -ozonemanagers does not return all the om instances
> bash-4.2$ ozone getconf -ozonemanagers
> 0.0.0.0
> 2) The document on specifying service/ID can be improved. More
> specifically, the URI should give examples for the Service ID in HA.
> Currently, it only mentions host/port.
>
> ozone sh vol create /vol1
> Service ID or host name must not be omitted when ozone.om.service.ids is
> defined.
> bash-4.2$ ozone sh vol create --help
> Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> <uri>
> Creates a volume for the specified user
> <uri> URI of the volume.
> Ozone URI could start with o3:// or without
> prefix. URI
> may contain the host and port of the OM server.
> Both are
> optional. If they are not specified it will be
> identified from the config files.
> 3). ozone scmcli container list seems report incorrect numberOfKeys and
> usedBytes
> Also, container owner is set as the current leader om(om3), should we use
> the om service id here instead?
> bash-4.2$ ozone scmcli container list
> {
> "state" : "OPEN",
> "replicationFactor" : "THREE",
> "replicationType" : "RATIS",
> "usedBytes" : 3813,
> "numberOfKeys" : 1,
> ...
> bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k1",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:23:30.670Z",
> "modificationTime" : "2020-03-23T03:23:33.207Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k2",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:18:46.735Z",
> "modificationTime" : "2020-03-23T03:20:15.005Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
>
>
> Run freon with random key generation.
>
> Thanks Dinesh for driving the the release of Beta RC2.
>
> Xiaoyu
>
> On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> <av...@cloudera.com.invalid> wrote:
>
> > +1
> > Deployed a 3 node cluster
> > Tried ozone shell and filesystem commands
> > Ran freon load generator
> >
> > Thanks Dinesh for working on the RC2.
> >
> > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <dineshc.asf@gmail.com
> >
> > wrote:
> >
> > > Hi Folks,
> > >
> > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > >
> > > The RC artifacts are at:
> > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > >
> > > The public key used for signing the artifacts can be found at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > The maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > >
> > > The RC tag in git is at:
> > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > >
> > > This release contains 800+ fixes/improvements [1].
> > > Thanks to everyone who put in the effort to make this happen.
> > >
> > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > PST.*
> > >
> > > Note: This release is beta quality, it’s not recommended to use in
> > > production but we believe that it’s stable enough to try out the
> feature
> > > set and collect feedback.
> > >
> > >
> > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > >
> > > Thanks,
> > > Dinesh Chitlangia
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Shashikant Banerjee <sb...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Ran Freon Random key generator
- Verified unit tests
Thanks Dinesh for driving the release.
Thanks
Shashi
On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
wrote:
> +1 binding
> Download source and verify signature.
> Verify build and documents.
> Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> Verify multiple RATIS-3 pipelines are created as expected.
> Tried ozone shell commands via o3 and o3fs, focus on security and HA
> related.
> Only find a few minor issues that we can fix in followup JIRAs.
> 1) ozone getconf -ozonemanagers does not return all the om instances
> bash-4.2$ ozone getconf -ozonemanagers
> 0.0.0.0
> 2) The document on specifying service/ID can be improved. More
> specifically, the URI should give examples for the Service ID in HA.
> Currently, it only mentions host/port.
>
> ozone sh vol create /vol1
> Service ID or host name must not be omitted when ozone.om.service.ids is
> defined.
> bash-4.2$ ozone sh vol create --help
> Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> <uri>
> Creates a volume for the specified user
> <uri> URI of the volume.
> Ozone URI could start with o3:// or without
> prefix. URI
> may contain the host and port of the OM server.
> Both are
> optional. If they are not specified it will be
> identified from the config files.
> 3). ozone scmcli container list seems report incorrect numberOfKeys and
> usedBytes
> Also, container owner is set as the current leader om(om3), should we use
> the om service id here instead?
> bash-4.2$ ozone scmcli container list
> {
> "state" : "OPEN",
> "replicationFactor" : "THREE",
> "replicationType" : "RATIS",
> "usedBytes" : 3813,
> "numberOfKeys" : 1,
> ...
> bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k1",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:23:30.670Z",
> "modificationTime" : "2020-03-23T03:23:33.207Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k2",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:18:46.735Z",
> "modificationTime" : "2020-03-23T03:20:15.005Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
>
>
> Run freon with random key generation.
>
> Thanks Dinesh for driving the the release of Beta RC2.
>
> Xiaoyu
>
> On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> <av...@cloudera.com.invalid> wrote:
>
> > +1
> > Deployed a 3 node cluster
> > Tried ozone shell and filesystem commands
> > Ran freon load generator
> >
> > Thanks Dinesh for working on the RC2.
> >
> > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <dineshc.asf@gmail.com
> >
> > wrote:
> >
> > > Hi Folks,
> > >
> > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > >
> > > The RC artifacts are at:
> > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > >
> > > The public key used for signing the artifacts can be found at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > The maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > >
> > > The RC tag in git is at:
> > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > >
> > > This release contains 800+ fixes/improvements [1].
> > > Thanks to everyone who put in the effort to make this happen.
> > >
> > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > PST.*
> > >
> > > Note: This release is beta quality, it’s not recommended to use in
> > > production but we believe that it’s stable enough to try out the
> feature
> > > set and collect feedback.
> > >
> > >
> > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > >
> > > Thanks,
> > > Dinesh Chitlangia
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Shashikant Banerjee <sb...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Ran Freon Random key generator
- Verified unit tests
Thanks Dinesh for driving the release.
Thanks
Shashi
On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
wrote:
> +1 binding
> Download source and verify signature.
> Verify build and documents.
> Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> Verify multiple RATIS-3 pipelines are created as expected.
> Tried ozone shell commands via o3 and o3fs, focus on security and HA
> related.
> Only find a few minor issues that we can fix in followup JIRAs.
> 1) ozone getconf -ozonemanagers does not return all the om instances
> bash-4.2$ ozone getconf -ozonemanagers
> 0.0.0.0
> 2) The document on specifying service/ID can be improved. More
> specifically, the URI should give examples for the Service ID in HA.
> Currently, it only mentions host/port.
>
> ozone sh vol create /vol1
> Service ID or host name must not be omitted when ozone.om.service.ids is
> defined.
> bash-4.2$ ozone sh vol create --help
> Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> <uri>
> Creates a volume for the specified user
> <uri> URI of the volume.
> Ozone URI could start with o3:// or without
> prefix. URI
> may contain the host and port of the OM server.
> Both are
> optional. If they are not specified it will be
> identified from the config files.
> 3). ozone scmcli container list seems report incorrect numberOfKeys and
> usedBytes
> Also, container owner is set as the current leader om(om3), should we use
> the om service id here instead?
> bash-4.2$ ozone scmcli container list
> {
> "state" : "OPEN",
> "replicationFactor" : "THREE",
> "replicationType" : "RATIS",
> "usedBytes" : 3813,
> "numberOfKeys" : 1,
> ...
> bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k1",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:23:30.670Z",
> "modificationTime" : "2020-03-23T03:23:33.207Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k2",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:18:46.735Z",
> "modificationTime" : "2020-03-23T03:20:15.005Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
>
>
> Run freon with random key generation.
>
> Thanks Dinesh for driving the the release of Beta RC2.
>
> Xiaoyu
>
> On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> <av...@cloudera.com.invalid> wrote:
>
> > +1
> > Deployed a 3 node cluster
> > Tried ozone shell and filesystem commands
> > Ran freon load generator
> >
> > Thanks Dinesh for working on the RC2.
> >
> > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <dineshc.asf@gmail.com
> >
> > wrote:
> >
> > > Hi Folks,
> > >
> > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > >
> > > The RC artifacts are at:
> > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > >
> > > The public key used for signing the artifacts can be found at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > The maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > >
> > > The RC tag in git is at:
> > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > >
> > > This release contains 800+ fixes/improvements [1].
> > > Thanks to everyone who put in the effort to make this happen.
> > >
> > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > PST.*
> > >
> > > Note: This release is beta quality, it’s not recommended to use in
> > > production but we believe that it’s stable enough to try out the
> feature
> > > set and collect feedback.
> > >
> > >
> > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > >
> > > Thanks,
> > > Dinesh Chitlangia
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Shashikant Banerjee <sb...@cloudera.com.INVALID>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Ran Freon Random key generator
- Verified unit tests
Thanks Dinesh for driving the release.
Thanks
Shashi
On Mon, Mar 23, 2020 at 8:58 AM Xiaoyu Yao <xy...@cloudera.com.invalid>
wrote:
> +1 binding
> Download source and verify signature.
> Verify build and documents.
> Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
> Verify multiple RATIS-3 pipelines are created as expected.
> Tried ozone shell commands via o3 and o3fs, focus on security and HA
> related.
> Only find a few minor issues that we can fix in followup JIRAs.
> 1) ozone getconf -ozonemanagers does not return all the om instances
> bash-4.2$ ozone getconf -ozonemanagers
> 0.0.0.0
> 2) The document on specifying service/ID can be improved. More
> specifically, the URI should give examples for the Service ID in HA.
> Currently, it only mentions host/port.
>
> ozone sh vol create /vol1
> Service ID or host name must not be omitted when ozone.om.service.ids is
> defined.
> bash-4.2$ ozone sh vol create --help
> Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
> <uri>
> Creates a volume for the specified user
> <uri> URI of the volume.
> Ozone URI could start with o3:// or without
> prefix. URI
> may contain the host and port of the OM server.
> Both are
> optional. If they are not specified it will be
> identified from the config files.
> 3). ozone scmcli container list seems report incorrect numberOfKeys and
> usedBytes
> Also, container owner is set as the current leader om(om3), should we use
> the om service id here instead?
> bash-4.2$ ozone scmcli container list
> {
> "state" : "OPEN",
> "replicationFactor" : "THREE",
> "replicationType" : "RATIS",
> "usedBytes" : 3813,
> "numberOfKeys" : 1,
> ...
> bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k1",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:23:30.670Z",
> "modificationTime" : "2020-03-23T03:23:33.207Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
> {
> "volumeName" : "vol1",
> "bucketName" : "bucket1",
> "name" : "k2",
> "dataSize" : 3813,
> "creationTime" : "2020-03-23T03:18:46.735Z",
> "modificationTime" : "2020-03-23T03:20:15.005Z",
> "replicationType" : "RATIS",
> "replicationFactor" : 3
> }
>
>
> Run freon with random key generation.
>
> Thanks Dinesh for driving the the release of Beta RC2.
>
> Xiaoyu
>
> On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
> <av...@cloudera.com.invalid> wrote:
>
> > +1
> > Deployed a 3 node cluster
> > Tried ozone shell and filesystem commands
> > Ran freon load generator
> >
> > Thanks Dinesh for working on the RC2.
> >
> > On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <dineshc.asf@gmail.com
> >
> > wrote:
> >
> > > Hi Folks,
> > >
> > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> > >
> > > The RC artifacts are at:
> > > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> > >
> > > The public key used for signing the artifacts can be found at:
> > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> > >
> > > The maven artifacts are staged at:
> > >
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
> > >
> > > The RC tag in git is at:
> > > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> > >
> > > This release contains 800+ fixes/improvements [1].
> > > Thanks to everyone who put in the effort to make this happen.
> > >
> > > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> > PST.*
> > >
> > > Note: This release is beta quality, it’s not recommended to use in
> > > production but we believe that it’s stable enough to try out the
> feature
> > > set and collect feedback.
> > >
> > >
> > > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> > >
> > > Thanks,
> > > Dinesh Chitlangia
> > >
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Xiaoyu Yao <xy...@cloudera.com.INVALID>.
+1 binding
Download source and verify signature.
Verify build and documents.
Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
Verify multiple RATIS-3 pipelines are created as expected.
Tried ozone shell commands via o3 and o3fs, focus on security and HA
related.
Only find a few minor issues that we can fix in followup JIRAs.
1) ozone getconf -ozonemanagers does not return all the om instances
bash-4.2$ ozone getconf -ozonemanagers
0.0.0.0
2) The document on specifying service/ID can be improved. More
specifically, the URI should give examples for the Service ID in HA.
Currently, it only mentions host/port.
ozone sh vol create /vol1
Service ID or host name must not be omitted when ozone.om.service.ids is
defined.
bash-4.2$ ozone sh vol create --help
Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
<uri>
Creates a volume for the specified user
<uri> URI of the volume.
Ozone URI could start with o3:// or without
prefix. URI
may contain the host and port of the OM server.
Both are
optional. If they are not specified it will be
identified from the config files.
3). ozone scmcli container list seems report incorrect numberOfKeys and
usedBytes
Also, container owner is set as the current leader om(om3), should we use
the om service id here instead?
bash-4.2$ ozone scmcli container list
{
"state" : "OPEN",
"replicationFactor" : "THREE",
"replicationType" : "RATIS",
"usedBytes" : 3813,
"numberOfKeys" : 1,
...
bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k1",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:23:30.670Z",
"modificationTime" : "2020-03-23T03:23:33.207Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k2",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:18:46.735Z",
"modificationTime" : "2020-03-23T03:20:15.005Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
Run freon with random key generation.
Thanks Dinesh for driving the the release of Beta RC2.
Xiaoyu
On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
<av...@cloudera.com.invalid> wrote:
> +1
> Deployed a 3 node cluster
> Tried ozone shell and filesystem commands
> Ran freon load generator
>
> Thanks Dinesh for working on the RC2.
>
> On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
> wrote:
>
> > Hi Folks,
> >
> > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >
> > The RC artifacts are at:
> > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >
> > The public key used for signing the artifacts can be found at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >
> > The RC tag in git is at:
> > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >
> > This release contains 800+ fixes/improvements [1].
> > Thanks to everyone who put in the effort to make this happen.
> >
> > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >
> > Note: This release is beta quality, it’s not recommended to use in
> > production but we believe that it’s stable enough to try out the feature
> > set and collect feedback.
> >
> >
> > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >
> > Thanks,
> > Dinesh Chitlangia
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Xiaoyu Yao <xy...@cloudera.com.INVALID>.
+1 binding
Download source and verify signature.
Verify build and documents.
Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
Verify multiple RATIS-3 pipelines are created as expected.
Tried ozone shell commands via o3 and o3fs, focus on security and HA
related.
Only find a few minor issues that we can fix in followup JIRAs.
1) ozone getconf -ozonemanagers does not return all the om instances
bash-4.2$ ozone getconf -ozonemanagers
0.0.0.0
2) The document on specifying service/ID can be improved. More
specifically, the URI should give examples for the Service ID in HA.
Currently, it only mentions host/port.
ozone sh vol create /vol1
Service ID or host name must not be omitted when ozone.om.service.ids is
defined.
bash-4.2$ ozone sh vol create --help
Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
<uri>
Creates a volume for the specified user
<uri> URI of the volume.
Ozone URI could start with o3:// or without
prefix. URI
may contain the host and port of the OM server.
Both are
optional. If they are not specified it will be
identified from the config files.
3). ozone scmcli container list seems report incorrect numberOfKeys and
usedBytes
Also, container owner is set as the current leader om(om3), should we use
the om service id here instead?
bash-4.2$ ozone scmcli container list
{
"state" : "OPEN",
"replicationFactor" : "THREE",
"replicationType" : "RATIS",
"usedBytes" : 3813,
"numberOfKeys" : 1,
...
bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k1",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:23:30.670Z",
"modificationTime" : "2020-03-23T03:23:33.207Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k2",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:18:46.735Z",
"modificationTime" : "2020-03-23T03:20:15.005Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
Run freon with random key generation.
Thanks Dinesh for driving the the release of Beta RC2.
Xiaoyu
On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
<av...@cloudera.com.invalid> wrote:
> +1
> Deployed a 3 node cluster
> Tried ozone shell and filesystem commands
> Ran freon load generator
>
> Thanks Dinesh for working on the RC2.
>
> On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
> wrote:
>
> > Hi Folks,
> >
> > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >
> > The RC artifacts are at:
> > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >
> > The public key used for signing the artifacts can be found at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >
> > The RC tag in git is at:
> > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >
> > This release contains 800+ fixes/improvements [1].
> > Thanks to everyone who put in the effort to make this happen.
> >
> > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >
> > Note: This release is beta quality, it’s not recommended to use in
> > production but we believe that it’s stable enough to try out the feature
> > set and collect feedback.
> >
> >
> > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >
> > Thanks,
> > Dinesh Chitlangia
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Xiaoyu Yao <xy...@cloudera.com.INVALID>.
+1 binding
Download source and verify signature.
Verify build and documents.
Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
Verify multiple RATIS-3 pipelines are created as expected.
Tried ozone shell commands via o3 and o3fs, focus on security and HA
related.
Only find a few minor issues that we can fix in followup JIRAs.
1) ozone getconf -ozonemanagers does not return all the om instances
bash-4.2$ ozone getconf -ozonemanagers
0.0.0.0
2) The document on specifying service/ID can be improved. More
specifically, the URI should give examples for the Service ID in HA.
Currently, it only mentions host/port.
ozone sh vol create /vol1
Service ID or host name must not be omitted when ozone.om.service.ids is
defined.
bash-4.2$ ozone sh vol create --help
Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
<uri>
Creates a volume for the specified user
<uri> URI of the volume.
Ozone URI could start with o3:// or without
prefix. URI
may contain the host and port of the OM server.
Both are
optional. If they are not specified it will be
identified from the config files.
3). ozone scmcli container list seems report incorrect numberOfKeys and
usedBytes
Also, container owner is set as the current leader om(om3), should we use
the om service id here instead?
bash-4.2$ ozone scmcli container list
{
"state" : "OPEN",
"replicationFactor" : "THREE",
"replicationType" : "RATIS",
"usedBytes" : 3813,
"numberOfKeys" : 1,
...
bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k1",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:23:30.670Z",
"modificationTime" : "2020-03-23T03:23:33.207Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k2",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:18:46.735Z",
"modificationTime" : "2020-03-23T03:20:15.005Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
Run freon with random key generation.
Thanks Dinesh for driving the the release of Beta RC2.
Xiaoyu
On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
<av...@cloudera.com.invalid> wrote:
> +1
> Deployed a 3 node cluster
> Tried ozone shell and filesystem commands
> Ran freon load generator
>
> Thanks Dinesh for working on the RC2.
>
> On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
> wrote:
>
> > Hi Folks,
> >
> > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >
> > The RC artifacts are at:
> > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >
> > The public key used for signing the artifacts can be found at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >
> > The RC tag in git is at:
> > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >
> > This release contains 800+ fixes/improvements [1].
> > Thanks to everyone who put in the effort to make this happen.
> >
> > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >
> > Note: This release is beta quality, it’s not recommended to use in
> > production but we believe that it’s stable enough to try out the feature
> > set and collect feedback.
> >
> >
> > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >
> > Thanks,
> > Dinesh Chitlangia
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Xiaoyu Yao <xy...@cloudera.com.INVALID>.
+1 binding
Download source and verify signature.
Verify build and documents.
Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
Verify multiple RATIS-3 pipelines are created as expected.
Tried ozone shell commands via o3 and o3fs, focus on security and HA
related.
Only find a few minor issues that we can fix in followup JIRAs.
1) ozone getconf -ozonemanagers does not return all the om instances
bash-4.2$ ozone getconf -ozonemanagers
0.0.0.0
2) The document on specifying service/ID can be improved. More
specifically, the URI should give examples for the Service ID in HA.
Currently, it only mentions host/port.
ozone sh vol create /vol1
Service ID or host name must not be omitted when ozone.om.service.ids is
defined.
bash-4.2$ ozone sh vol create --help
Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
<uri>
Creates a volume for the specified user
<uri> URI of the volume.
Ozone URI could start with o3:// or without
prefix. URI
may contain the host and port of the OM server.
Both are
optional. If they are not specified it will be
identified from the config files.
3). ozone scmcli container list seems report incorrect numberOfKeys and
usedBytes
Also, container owner is set as the current leader om(om3), should we use
the om service id here instead?
bash-4.2$ ozone scmcli container list
{
"state" : "OPEN",
"replicationFactor" : "THREE",
"replicationType" : "RATIS",
"usedBytes" : 3813,
"numberOfKeys" : 1,
...
bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k1",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:23:30.670Z",
"modificationTime" : "2020-03-23T03:23:33.207Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k2",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:18:46.735Z",
"modificationTime" : "2020-03-23T03:20:15.005Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
Run freon with random key generation.
Thanks Dinesh for driving the the release of Beta RC2.
Xiaoyu
On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
<av...@cloudera.com.invalid> wrote:
> +1
> Deployed a 3 node cluster
> Tried ozone shell and filesystem commands
> Ran freon load generator
>
> Thanks Dinesh for working on the RC2.
>
> On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
> wrote:
>
> > Hi Folks,
> >
> > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >
> > The RC artifacts are at:
> > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >
> > The public key used for signing the artifacts can be found at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >
> > The RC tag in git is at:
> > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >
> > This release contains 800+ fixes/improvements [1].
> > Thanks to everyone who put in the effort to make this happen.
> >
> > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >
> > Note: This release is beta quality, it’s not recommended to use in
> > production but we believe that it’s stable enough to try out the feature
> > set and collect feedback.
> >
> >
> > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >
> > Thanks,
> > Dinesh Chitlangia
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Xiaoyu Yao <xy...@cloudera.com.INVALID>.
+1 binding
Download source and verify signature.
Verify build and documents.
Deployed an 11 node cluster (3 om with ha, 6 datanodes, 1 scm and 1 s3g)
Verify multiple RATIS-3 pipelines are created as expected.
Tried ozone shell commands via o3 and o3fs, focus on security and HA
related.
Only find a few minor issues that we can fix in followup JIRAs.
1) ozone getconf -ozonemanagers does not return all the om instances
bash-4.2$ ozone getconf -ozonemanagers
0.0.0.0
2) The document on specifying service/ID can be improved. More
specifically, the URI should give examples for the Service ID in HA.
Currently, it only mentions host/port.
ozone sh vol create /vol1
Service ID or host name must not be omitted when ozone.om.service.ids is
defined.
bash-4.2$ ozone sh vol create --help
Usage: ozone sh volume create [-hV] [--root] [-q=<quota>] [-u=<userName>]
<uri>
Creates a volume for the specified user
<uri> URI of the volume.
Ozone URI could start with o3:// or without
prefix. URI
may contain the host and port of the OM server.
Both are
optional. If they are not specified it will be
identified from the config files.
3). ozone scmcli container list seems report incorrect numberOfKeys and
usedBytes
Also, container owner is set as the current leader om(om3), should we use
the om service id here instead?
bash-4.2$ ozone scmcli container list
{
"state" : "OPEN",
"replicationFactor" : "THREE",
"replicationType" : "RATIS",
"usedBytes" : 3813,
"numberOfKeys" : 1,
...
bash-4.2$ ozone sh key list o3://id1/vol1/bucket1/
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k1",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:23:30.670Z",
"modificationTime" : "2020-03-23T03:23:33.207Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
{
"volumeName" : "vol1",
"bucketName" : "bucket1",
"name" : "k2",
"dataSize" : 3813,
"creationTime" : "2020-03-23T03:18:46.735Z",
"modificationTime" : "2020-03-23T03:20:15.005Z",
"replicationType" : "RATIS",
"replicationFactor" : 3
}
Run freon with random key generation.
Thanks Dinesh for driving the the release of Beta RC2.
Xiaoyu
On Sun, Mar 22, 2020 at 2:51 PM Aravindan Vijayan
<av...@cloudera.com.invalid> wrote:
> +1
> Deployed a 3 node cluster
> Tried ozone shell and filesystem commands
> Ran freon load generator
>
> Thanks Dinesh for working on the RC2.
>
> On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
> wrote:
>
> > Hi Folks,
> >
> > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
> >
> > The RC artifacts are at:
> > https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
> >
> > The public key used for signing the artifacts can be found at:
> > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
> >
> > The maven artifacts are staged at:
> > https://repository.apache.org/content/repositories/orgapachehadoop-1262
> >
> > The RC tag in git is at:
> > https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
> >
> > This release contains 800+ fixes/improvements [1].
> > Thanks to everyone who put in the effort to make this happen.
> >
> > *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm
> PST.*
> >
> > Note: This release is beta quality, it’s not recommended to use in
> > production but we believe that it’s stable enough to try out the feature
> > set and collect feedback.
> >
> >
> > [1] https://s.apache.org/ozone-0.5.0-fixed-issues
> >
> > Thanks,
> > Dinesh Chitlangia
> >
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Aravindan Vijayan <av...@cloudera.com.INVALID>.
+1
Deployed a 3 node cluster
Tried ozone shell and filesystem commands
Ran freon load generator
Thanks Dinesh for working on the RC2.
On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by "Elek, Marton" <el...@apache.org>.
+1
* signatures checked
* sha512 checked
* can be built from the source (without using my local mvn cache:
using apache/ozone-build docker image)
* created docker image with the provided Dockerfile
* Deployed to Kubernetes together with Yarn and Hdfs
* tested with 100G teragen (one pipeline, storage/execution were
separated)
Thank you Dinesh for the continuous effort for this release.
Marton
On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by "Elek, Marton" <el...@apache.org>.
+1
* signatures checked
* sha512 checked
* can be built from the source (without using my local mvn cache:
using apache/ozone-build docker image)
* created docker image with the provided Dockerfile
* Deployed to Kubernetes together with Yarn and Hdfs
* tested with 100G teragen (one pipeline, storage/execution were
separated)
Thank you Dinesh for the continuous effort for this release.
Marton
On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Ayush Saxena <ay...@gmail.com>.
+1(non binding)
*Built from source
*Verified Checksums
*Ran some basic Shell Commands.
Thanx Dinesh for driving the release.
-Ayush
On Mon, 16 Mar 2020 at 07:57, Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Thank you Dinesh for putting up the RCs.
+1 binding.
Verified the following:
- Built from source
- Deployed to 5 node docker cluster and ran sanity tests.
- Ran smoke tests
Thanks
Hanisha
> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Ayush Saxena <ay...@gmail.com>.
+1(non binding)
*Built from source
*Verified Checksums
*Ran some basic Shell Commands.
Thanx Dinesh for driving the release.
-Ayush
On Mon, 16 Mar 2020 at 07:57, Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Aravindan Vijayan <av...@cloudera.com.INVALID>.
+1
Deployed a 3 node cluster
Tried ozone shell and filesystem commands
Ran freon load generator
Thanks Dinesh for working on the RC2.
On Sun, Mar 15, 2020 at 7:27 PM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Sammi Chen <sa...@apache.org>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Verfied that the last commit of release binary matches the tag
- Start a ozone cluster with docker compose
- Run ozone sh and scmcli commands
- Run freon to create 100k keys with validation
Thanks Dinesh for driving the release.
Bests,
Sammi
On Mon, Mar 16, 2020 at 10:27 AM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Ayush Saxena <ay...@gmail.com>.
+1(non binding)
*Built from source
*Verified Checksums
*Ran some basic Shell Commands.
Thanx Dinesh for driving the release.
-Ayush
On Mon, 16 Mar 2020 at 07:57, Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Thank you Dinesh for putting up the RCs.
+1 binding.
Verified the following:
- Built from source
- Deployed to 5 node docker cluster and ran sanity tests.
- Ran smoke tests
Thanks
Hanisha
> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by "Elek, Marton" <el...@apache.org>.
+1
* signatures checked
* sha512 checked
* can be built from the source (without using my local mvn cache:
using apache/ozone-build docker image)
* created docker image with the provided Dockerfile
* Deployed to Kubernetes together with Yarn and Hdfs
* tested with 100G teragen (one pipeline, storage/execution were
separated)
Thank you Dinesh for the continuous effort for this release.
Marton
On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by "Elek, Marton" <el...@apache.org>.
+1
* signatures checked
* sha512 checked
* can be built from the source (without using my local mvn cache:
using apache/ozone-build docker image)
* created docker image with the provided Dockerfile
* Deployed to Kubernetes together with Yarn and Hdfs
* tested with 100G teragen (one pipeline, storage/execution were
separated)
Thank you Dinesh for the continuous effort for this release.
Marton
On 3/16/20 3:27 AM, Dinesh Chitlangia wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Sammi Chen <sa...@apache.org>.
+1 binding.
- Verified hashes and signatures
- Built from source
- Verfied that the last commit of release binary matches the tag
- Start a ozone cluster with docker compose
- Run ozone sh and scmcli commands
- Run freon to create 100k keys with validation
Thanks Dinesh for driving the release.
Bests,
Sammi
On Mon, Mar 16, 2020 at 10:27 AM Dinesh Chitlangia <di...@gmail.com>
wrote:
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia
>
Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2
Posted by Hanisha Koneru <hk...@cloudera.com.INVALID>.
Thank you Dinesh for putting up the RCs.
+1 binding.
Verified the following:
- Built from source
- Deployed to 5 node docker cluster and ran sanity tests.
- Ran smoke tests
Thanks
Hanisha
> On Mar 15, 2020, at 7:27 PM, Dinesh Chitlangia <di...@gmail.com> wrote:
>
> Hi Folks,
>
> We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta.
>
> The RC artifacts are at:
> https://home.apache.org/~dineshc/ozone-0.5.0-rc2/
>
> The public key used for signing the artifacts can be found at:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> The maven artifacts are staged at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1262
>
> The RC tag in git is at:
> https://github.com/apache/hadoop-ozone/tree/ozone-0.5.0-beta-RC2
>
> This release contains 800+ fixes/improvements [1].
> Thanks to everyone who put in the effort to make this happen.
>
> *The vote will run for 7 days, ending on March 22nd 2020 at 11:59 pm PST.*
>
> Note: This release is beta quality, it’s not recommended to use in
> production but we believe that it’s stable enough to try out the feature
> set and collect feedback.
>
>
> [1] https://s.apache.org/ozone-0.5.0-fixed-issues
>
> Thanks,
> Dinesh Chitlangia