You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@knox.apache.org by Kevin Risden <kr...@apache.org> on 2018/12/10 20:40:18 UTC
[VOTE] Release Apache Knox 1.2.0 RC 4
Release candidate #4 for the Apache Knox 1.2.0 release is available at:
https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
The release candidate is a zip archive of the sources in:
https://git-wip-us.apache.org/repos/asf/knox.git
Branch v1.2.0 (git checkout -b v1.2.0)
Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
The KEYS file for signature validation is available at:
https://dist.apache.org/repos/dist/release/knox/KEYS
Please vote on releasing this package as Apache Knox 1.2.0.
The vote is open for the next 72 hours and passes if a majority of at
least three +1 Apache Knox PMC votes are cast.
[ ] +1 Release this package as Apache Knox 1.2.0
[ ] -1 Do not release this package because...
Kevin Risden
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by "Watson, Billy" <Bi...@disney.com>.
It looks like I have fixes for all of those and more. I’ll comment on that ticket at my earliest convenience.
Thanks,
Billy Watson
From: Kevin Risden <kr...@apache.org>
Reply-To: "user@knox.apache.org" <us...@knox.apache.org>
Date: Thursday, December 13, 2018 at 11:57 AM
To: "user@knox.apache.org" <us...@knox.apache.org>
Cc: "dev@knox.apache.org" <de...@knox.apache.org>
Subject: Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Billy - Yea we would target 1.3.0 likely unless it is a regression that we can't ship with.
Knox 1.2.0 has a lot of fixes for YARN and JobHistoryUI - See https://issues.apache.org/jira/browse/KNOX-1207<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FKNOX-1207&data=02%7C01%7CBilly.Watson%40disney.com%7C3fbaa1b1e358420e9ecf08d6611c0558%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636803170316475968&sdata=ZN9LQ1Qjy0V2cURAuroX3%2BSMY1YAXegLR2Eyj57%2FJxM%3D&reserved=0>
If you have fixes for YARNUIV2, can you see if they fix the items laid out here - https://issues.apache.org/jira/browse/KNOX-1589<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FKNOX-1589&data=02%7C01%7CBilly.Watson%40disney.com%7C3fbaa1b1e358420e9ecf08d6611c0558%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636803170316475968&sdata=DiaFD6KI4EgIRQYBKVnz88uz3zLnCs2iSr2ZoW4Ux1A%3D&reserved=0>
Kevin Risden
On Thu, Dec 13, 2018 at 11:53 AM Watson, Billy <Bi...@disney.com>> wrote:
I have a bunch of fixes for knox yarn, yarnuiv2, jobhistoryui, etc. Is it too late to get those into 1.2.0 since you’re at RC stages?
Billy Watson
From:
Kevin Risden
<kr...@apache.org>>
Reply-To: "user@knox.apache.org<ma...@knox.apache.org>" <us...@knox.apache.org>>
Date: Monday, December 10, 2018 at 3:49 PM
To: "dev@knox.apache.org<ma...@knox.apache.org>" <de...@knox.apache.org>>, "user@knox.apache.org<ma...@knox.apache.org>" <us...@knox.apache.org>>
Subject: Re: [VOTE] Release Apache Knox 1.2.0 RC 4
+1
Tested the following:
• src zip - mvn verify -Ppackage,release
• knoxshell - able to connect to Knox and execute a few examples
• Ran rc against https://github.com/risdenk/knox-performance-tests<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Frisdenk%2Fknox-performance-tests&data=02%7C01%7CBilly.Watson%40disney.com%7C3fbaa1b1e358420e9ecf08d6611c0558%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636803170316485973&sdata=%2FpskOkSsPJyi%2FV2gt%2BRu5xINBdOh3%2BQegelRCscEQW4%3D&reserved=0> to test unsecure webhdfs, hbase, hive
• Manual testing of UIs with Kerberos
• Zeppelin UI with websocket enabled
• Manual testing of Knox against Kerberized cluster
• knoxsso Pac4j backed by Okta
• hadoopauth provider
• token service and Bearer tokens
• default topology url
• topology port mapping
• ambari discovery
• hadoop group provider
• metrics
• ranger integration - via /ext loading
• Knoxsso misconfiguration doesn't result in stacktrace
Kevin Risden
On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden <kr...@apache.org>> wrote:
Release candidate #4 for the Apache Knox 1.2.0 release is available at:
https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fknox%2Fknox-1.2.0%2F&data=02%7C01%7CBilly.Watson%40disney.com%7C3fbaa1b1e358420e9ecf08d6611c0558%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636803170316485973&sdata=iY%2FF4HkAe4hpBHvSs6%2FEzf%2FdTmE3A6B1MAalnDajhJY%3D&reserved=0>
The release candidate is a zip archive of the sources in:
https://git-wip-us.apache.org/repos/asf/knox.git<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit-wip-us.apache.org%2Frepos%2Fasf%2Fknox.git&data=02%7C01%7CBilly.Watson%40disney.com%7C3fbaa1b1e358420e9ecf08d6611c0558%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636803170316495982&sdata=9P9ju2qe1LpHywRy7pzOUaF2hqljq3mhAFnMlIRXpLE%3D&reserved=0>
Branch v1.2.0 (git checkout -b v1.2.0)
Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
The KEYS file for signature validation is available at: https://dist.apache.org/repos/dist/release/knox/KEYS<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fknox%2FKEYS&data=02%7C01%7CBilly.Watson%40disney.com%7C3fbaa1b1e358420e9ecf08d6611c0558%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636803170316505987&sdata=ulV2PlyT2OnZNcYupLBvRi%2BrQuiCg5ACbhgLEjUfa%2Fs%3D&reserved=0>
Please vote on releasing this package as Apache Knox 1.2.0.
The vote is open for the next 72 hours and passes if a majority of at
least three +1 Apache Knox PMC votes are cast.
[ ] +1 Release this package as Apache Knox 1.2.0
[ ] -1 Do not release this package because...
Kevin Risden
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by Kevin Risden <kr...@apache.org>.
Billy - Yea we would target 1.3.0 likely unless it is a regression that we
can't ship with.
Knox 1.2.0 has a lot of fixes for YARN and JobHistoryUI - See
https://issues.apache.org/jira/browse/KNOX-1207
If you have fixes for YARNUIV2, can you see if they fix the items laid out
here - https://issues.apache.org/jira/browse/KNOX-1589
Kevin Risden
On Thu, Dec 13, 2018 at 11:53 AM Watson, Billy <Bi...@disney.com>
wrote:
> I have a bunch of fixes for knox yarn, yarnuiv2, jobhistoryui, etc. Is it
> too late to get those into 1.2.0 since you’re at RC stages?
>
>
>
> *Billy Watson*
>
>
>
>
>
>
> *From:*
> *Kevin Risden*
>
>
>
>
> * <krisden@apache.org <kr...@apache.org>> Reply-To:
> "user@knox.apache.org <us...@knox.apache.org>" <user@knox.apache.org
> <us...@knox.apache.org>> Date: Monday, December 10, 2018 at 3:49 PM To:
> "dev@knox.apache.org <de...@knox.apache.org>" <dev@knox.apache.org
> <de...@knox.apache.org>>, "user@knox.apache.org <us...@knox.apache.org>"
> <user@knox.apache.org <us...@knox.apache.org>> Subject: Re: [VOTE] Release
> Apache Knox 1.2.0 RC 4 *
>
> * +1 Tested the following: · src zip - mvn verify -Ppackage,release
> · knoxshell - able to connect to Knox and execute a few examples · Ran rc
> against https://github.com/risdenk/knox-performance-tests
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Frisdenk%2Fknox-performance-tests&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610028222&sdata=F0o1oCOldpYUug7riBxSwFJwn3rmFk8mWaoxM3ZFctY%3D&reserved=0> to
> test unsecure webhdfs, hbase, hive · Manual testing of UIs with Kerberos
> · Zeppelin UI with websocket enabled · Manual testing of Knox against
> Kerberized cluster · knoxsso Pac4j backed by Okta · hadoopauth provider
> · token service and Bearer tokens · default topology url · topology port
> mapping · ambari discovery · hadoop group provider · metrics · ranger
> integration - via /ext loading · Knoxsso misconfiguration doesn't result
> in stacktrace Kevin Risden On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden
> <krisden@apache.org <kr...@apache.org>> wrote: Release candidate #4 for
> the Apache Knox 1.2.0 release is available at:
> https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fknox%2Fknox-1.2.0%2F&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610028222&sdata=ryoJqjoBUis3W0xKVA9V4hEAD2EMriIsjnqjqhsAtDo%3D&reserved=0>
> The release candidate is a zip archive of the sources in:
> https://git-wip-us.apache.org/repos/asf/knox.git
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit-wip-us.apache.org%2Frepos%2Fasf%2Fknox.git&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610038227&sdata=ti4Yy1n%2BrxZ%2BvpPD1pqcM726f8P3aPTrYWxtnsO1Sm4%3D&reserved=0>
> Branch v1.2.0 (git checkout -b v1.2.0) Tag is v1.2.0-rc4 (git checkout -b
> v1.2.0-rc4) The KEYS file for signature validation is available
> at: https://dist.apache.org/repos/dist/release/knox/KEYS
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fknox%2FKEYS&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610048236&sdata=Tj0YnW%2BLwuygHka0NHSV6w0YmsaJM%2BS0lCrTv7j15RU%3D&reserved=0>
> Please vote on releasing this package as Apache Knox 1.2.0. The vote is
> open for the next 72 hours and passes if a majority of at least three +1
> Apache Knox PMC votes are cast. [ ] +1 Release this package as Apache
> Knox 1.2.0 [ ] -1 Do not release this package because... Kevin Risden *
>
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by Kevin Risden <kr...@apache.org>.
Billy - Yea we would target 1.3.0 likely unless it is a regression that we
can't ship with.
Knox 1.2.0 has a lot of fixes for YARN and JobHistoryUI - See
https://issues.apache.org/jira/browse/KNOX-1207
If you have fixes for YARNUIV2, can you see if they fix the items laid out
here - https://issues.apache.org/jira/browse/KNOX-1589
Kevin Risden
On Thu, Dec 13, 2018 at 11:53 AM Watson, Billy <Bi...@disney.com>
wrote:
> I have a bunch of fixes for knox yarn, yarnuiv2, jobhistoryui, etc. Is it
> too late to get those into 1.2.0 since you’re at RC stages?
>
>
>
> *Billy Watson*
>
>
>
>
>
>
> *From:*
> *Kevin Risden*
>
>
>
>
> * <krisden@apache.org <kr...@apache.org>> Reply-To:
> "user@knox.apache.org <us...@knox.apache.org>" <user@knox.apache.org
> <us...@knox.apache.org>> Date: Monday, December 10, 2018 at 3:49 PM To:
> "dev@knox.apache.org <de...@knox.apache.org>" <dev@knox.apache.org
> <de...@knox.apache.org>>, "user@knox.apache.org <us...@knox.apache.org>"
> <user@knox.apache.org <us...@knox.apache.org>> Subject: Re: [VOTE] Release
> Apache Knox 1.2.0 RC 4 *
>
> * +1 Tested the following: · src zip - mvn verify -Ppackage,release
> · knoxshell - able to connect to Knox and execute a few examples · Ran rc
> against https://github.com/risdenk/knox-performance-tests
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Frisdenk%2Fknox-performance-tests&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610028222&sdata=F0o1oCOldpYUug7riBxSwFJwn3rmFk8mWaoxM3ZFctY%3D&reserved=0> to
> test unsecure webhdfs, hbase, hive · Manual testing of UIs with Kerberos
> · Zeppelin UI with websocket enabled · Manual testing of Knox against
> Kerberized cluster · knoxsso Pac4j backed by Okta · hadoopauth provider
> · token service and Bearer tokens · default topology url · topology port
> mapping · ambari discovery · hadoop group provider · metrics · ranger
> integration - via /ext loading · Knoxsso misconfiguration doesn't result
> in stacktrace Kevin Risden On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden
> <krisden@apache.org <kr...@apache.org>> wrote: Release candidate #4 for
> the Apache Knox 1.2.0 release is available at:
> https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fknox%2Fknox-1.2.0%2F&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610028222&sdata=ryoJqjoBUis3W0xKVA9V4hEAD2EMriIsjnqjqhsAtDo%3D&reserved=0>
> The release candidate is a zip archive of the sources in:
> https://git-wip-us.apache.org/repos/asf/knox.git
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit-wip-us.apache.org%2Frepos%2Fasf%2Fknox.git&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610038227&sdata=ti4Yy1n%2BrxZ%2BvpPD1pqcM726f8P3aPTrYWxtnsO1Sm4%3D&reserved=0>
> Branch v1.2.0 (git checkout -b v1.2.0) Tag is v1.2.0-rc4 (git checkout -b
> v1.2.0-rc4) The KEYS file for signature validation is available
> at: https://dist.apache.org/repos/dist/release/knox/KEYS
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fknox%2FKEYS&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610048236&sdata=Tj0YnW%2BLwuygHka0NHSV6w0YmsaJM%2BS0lCrTv7j15RU%3D&reserved=0>
> Please vote on releasing this package as Apache Knox 1.2.0. The vote is
> open for the next 72 hours and passes if a majority of at least three +1
> Apache Knox PMC votes are cast. [ ] +1 Release this package as Apache
> Knox 1.2.0 [ ] -1 Do not release this package because... Kevin Risden *
>
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by "Watson, Billy" <Bi...@disney.com>.
I have a bunch of fixes for knox yarn, yarnuiv2, jobhistoryui, etc. Is it too late to get those into 1.2.0 since you’re at RC stages?
Billy Watson
From: Kevin Risden <kr...@apache.org>
Reply-To: "user@knox.apache.org" <us...@knox.apache.org>
Date: Monday, December 10, 2018 at 3:49 PM
To: "dev@knox.apache.org" <de...@knox.apache.org>, "user@knox.apache.org" <us...@knox.apache.org>
Subject: Re: [VOTE] Release Apache Knox 1.2.0 RC 4
+1
Tested the following:
· src zip - mvn verify -Ppackage,release
· knoxshell - able to connect to Knox and execute a few examples
· Ran rc against https://github.com/risdenk/knox-performance-tests<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Frisdenk%2Fknox-performance-tests&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610028222&sdata=F0o1oCOldpYUug7riBxSwFJwn3rmFk8mWaoxM3ZFctY%3D&reserved=0> to test unsecure webhdfs, hbase, hive
· Manual testing of UIs with Kerberos
· Zeppelin UI with websocket enabled
· Manual testing of Knox against Kerberized cluster
· knoxsso Pac4j backed by Okta
· hadoopauth provider
· token service and Bearer tokens
· default topology url
· topology port mapping
· ambari discovery
· hadoop group provider
· metrics
· ranger integration - via /ext loading
· Knoxsso misconfiguration doesn't result in stacktrace
Kevin Risden
On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden <kr...@apache.org>> wrote:
Release candidate #4 for the Apache Knox 1.2.0 release is available at:
https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fknox%2Fknox-1.2.0%2F&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610028222&sdata=ryoJqjoBUis3W0xKVA9V4hEAD2EMriIsjnqjqhsAtDo%3D&reserved=0>
The release candidate is a zip archive of the sources in:
https://git-wip-us.apache.org/repos/asf/knox.git<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit-wip-us.apache.org%2Frepos%2Fasf%2Fknox.git&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610038227&sdata=ti4Yy1n%2BrxZ%2BvpPD1pqcM726f8P3aPTrYWxtnsO1Sm4%3D&reserved=0>
Branch v1.2.0 (git checkout -b v1.2.0)
Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
The KEYS file for signature validation is available at: https://dist.apache.org/repos/dist/release/knox/KEYS<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Frelease%2Fknox%2FKEYS&data=02%7C01%7CBilly.Watson%40disney.com%7C74475999c7364c90edeb08d65ee0f4fe%7C56b731a8a2ac4c32bf6b616810e913c6%7C1%7C0%7C636800717610048236&sdata=Tj0YnW%2BLwuygHka0NHSV6w0YmsaJM%2BS0lCrTv7j15RU%3D&reserved=0>
Please vote on releasing this package as Apache Knox 1.2.0.
The vote is open for the next 72 hours and passes if a majority of at
least three +1 Apache Knox PMC votes are cast.
[ ] +1 Release this package as Apache Knox 1.2.0
[ ] -1 Do not release this package because...
Kevin Risden
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by Kevin Risden <kr...@apache.org>.
+1
Tested the following:
- src zip - mvn verify -Ppackage,release
- knoxshell - able to connect to Knox and execute a few examples
- Ran rc against https://github.com/risdenk/knox-performance-tests to
test unsecure webhdfs, hbase, hive
- Manual testing of UIs with Kerberos
- Zeppelin UI with websocket enabled
- Manual testing of Knox against Kerberized cluster
- knoxsso Pac4j backed by Okta
- hadoopauth provider
- token service and Bearer tokens
- default topology url
- topology port mapping
- ambari discovery
- hadoop group provider
- metrics
- ranger integration - via /ext loading
- Knoxsso misconfiguration doesn't result in stacktrace
Kevin Risden
On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden <kr...@apache.org> wrote:
> Release candidate #4 for the Apache Knox 1.2.0 release is available at:
>
> https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
>
> The release candidate is a zip archive of the sources in:
>
> https://git-wip-us.apache.org/repos/asf/knox.git
> Branch v1.2.0 (git checkout -b v1.2.0)
> Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
>
> The KEYS file for signature validation is available at:
> https://dist.apache.org/repos/dist/release/knox/KEYS
>
> Please vote on releasing this package as Apache Knox 1.2.0.
> The vote is open for the next 72 hours and passes if a majority of at
> least three +1 Apache Knox PMC votes are cast.
>
> [ ] +1 Release this package as Apache Knox 1.2.0
> [ ] -1 Do not release this package because...
>
> Kevin Risden
>
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by Kevin Risden <kr...@apache.org>.
The VOTE for 1.2.0 RC 4 passes with:
3 binding +1's
0 -1's
I will be working on promoting 1.2.0 RC4 to an official release shortly.
Thank you for taking the time to test this release and contributing to the
Apache Knox community!
Kevin Risden
On Sun, Dec 16, 2018 at 1:42 PM larry mccay <lm...@apache.org> wrote:
> Thanks, Kevin!
>
> +1 (binding)
> * Downloaded and built from source and ran tests
> * Checked LICENSE and NOTICE files
> * Verified signatures for Knox source, Knox and Knoxshell release
> packages
> * Used nodejs client to test webhdfs through knox [1]
> * Used KnoxLine SQL client wiki example to test Hive from groovy based
> scripting [2]
> * Ran KnoxShell samples
> * Tested KnoxSession class refactoring of Hadoop class
> * Tested programmatic truststore setting for KnoxShell clients
> * Proxied Ambari UI
> * Tested async puts to webhdfs via knoxshell from 10 to 4000 files - nearly
> linear scalability [3]
> * Tested Admin API and UI
>
> NOTE: Knox Manager Version in the UI is still at 1.0.0 - this is not a
> blocker but should be fixed in next release - unless it is indeed behind
> the gateway version for some reason.
>
> 1. https://github.com/lmccay/knoxfs
> 2.
>
> https://cwiki.apache.org/confluence/display/KNOX/SQL+Client+Example+using+KnoxShell+in+Apache+Knox
> 3. see async-puts.groovy script below:
>
> import org.apache.knox.gateway.shell.KnoxSession
> import org.apache.knox.gateway.shell.hdfs.Hdfs
> import org.apache.knox.gateway.shell.Credentials
>
> gateway = "https://localhost:8443/gateway/sandbox"
> dataFile = "README"
>
> count = this.args[0] as Integer
>
> credentials = new Credentials()
> credentials.add("ClearInput", "Enter username: ", "user")
> .add("HiddenInput", "Enter pas" + "sword: ", "pass")
> credentials.collect()
>
> username = credentials.get("user").string()
> pass = credentials.get("pass").string()
>
> dataDir = "/user/" + username + "/example"
>
> session = KnoxSession.login( gateway, username, pass )
>
> Hdfs.rm( session ).file( dataDir ).recursive().now()
>
> long start = System.currentTimeMillis();
>
> List<java.util.concurrent.Future<java.util.concurrent.FutureTask>> futures
> = new ArrayList<>();
> for (int i = 0; i < count; i++) {
> futures.add(Hdfs.put( session ).file( dataFile ).to( dataDir + "/" +
> dataFile + i ).overwrite( false ).later() {
> code = it.statusCode
> print "."
> if (code != 201) {
> println "UNEXPECTED RESULT!!!!!!!! " + code
> }
> })
> }
>
> session.waitFor((java.util.concurrent.Future<java.util.concurrent.FutureTask>[])futures.toArray())
> long end = System.currentTimeMillis();
>
> System.out.println("Took : " + ((end - start) / 1000));
>
> session.shutdown()
>
> On Thu, Dec 13, 2018 at 3:43 PM Sandeep Moré <mo...@gmail.com>
> wrote:
>
> > Thank you Kevin,
> >
> > +1 (binding)
> > * Downloaded and built from source
> > * Checked LICENSE and NOTICE files
> > * Verified GPG/SHA signatures for Knox source, Knox and Knoxshell release
> > packages
> > * Installed pseudo-distributed instance (Mac OS X )
> > * Ran through knox tests
> > * Checked websocket functionality
> > * Checked java script compression (Ambari UI)
> > * Checked Topology Port Mapping feature
> > * Checked KnoxShell samples
> >
> > Best,
> > Sandeep
> >
> > On Mon, Dec 10, 2018 at 3:40 PM
> Kevin Risden
> <kr...@apache.org> wrote:
> >
> > > Release candidate #4 for the Apache Knox 1.2.0 release is available at:
> > >
> > > https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
> > >
> > > The release candidate is a zip archive of the sources in:
> > >
> > > https://git-wip-us.apache.org/repos/asf/knox.git
> > > Branch v1.2.0 (git checkout -b v1.2.0)
> > > Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
> > >
> > > The KEYS file for signature validation is available at:
> > > https://dist.apache.org/repos/dist/release/knox/KEYS
> > >
> > > Please vote on releasing this package as Apache Knox 1.2.0.
> > > The vote is open for the next 72 hours and passes if a majority of at
> > > least three +1 Apache Knox PMC votes are cast.
> > >
> > > [ ] +1 Release this package as Apache Knox 1.2.0
> > > [ ] -1 Do not release this package because...
> > >
> > > Kevin Risden
> > >
> >
>
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by larry mccay <lm...@apache.org>.
Thanks, Kevin!
+1 (binding)
* Downloaded and built from source and ran tests
* Checked LICENSE and NOTICE files
* Verified signatures for Knox source, Knox and Knoxshell release
packages
* Used nodejs client to test webhdfs through knox [1]
* Used KnoxLine SQL client wiki example to test Hive from groovy based
scripting [2]
* Ran KnoxShell samples
* Tested KnoxSession class refactoring of Hadoop class
* Tested programmatic truststore setting for KnoxShell clients
* Proxied Ambari UI
* Tested async puts to webhdfs via knoxshell from 10 to 4000 files - nearly
linear scalability [3]
* Tested Admin API and UI
NOTE: Knox Manager Version in the UI is still at 1.0.0 - this is not a
blocker but should be fixed in next release - unless it is indeed behind
the gateway version for some reason.
1. https://github.com/lmccay/knoxfs
2.
https://cwiki.apache.org/confluence/display/KNOX/SQL+Client+Example+using+KnoxShell+in+Apache+Knox
3. see async-puts.groovy script below:
import org.apache.knox.gateway.shell.KnoxSession
import org.apache.knox.gateway.shell.hdfs.Hdfs
import org.apache.knox.gateway.shell.Credentials
gateway = "https://localhost:8443/gateway/sandbox"
dataFile = "README"
count = this.args[0] as Integer
credentials = new Credentials()
credentials.add("ClearInput", "Enter username: ", "user")
.add("HiddenInput", "Enter pas" + "sword: ", "pass")
credentials.collect()
username = credentials.get("user").string()
pass = credentials.get("pass").string()
dataDir = "/user/" + username + "/example"
session = KnoxSession.login( gateway, username, pass )
Hdfs.rm( session ).file( dataDir ).recursive().now()
long start = System.currentTimeMillis();
List<java.util.concurrent.Future<java.util.concurrent.FutureTask>> futures
= new ArrayList<>();
for (int i = 0; i < count; i++) {
futures.add(Hdfs.put( session ).file( dataFile ).to( dataDir + "/" +
dataFile + i ).overwrite( false ).later() {
code = it.statusCode
print "."
if (code != 201) {
println "UNEXPECTED RESULT!!!!!!!! " + code
}
})
}
session.waitFor((java.util.concurrent.Future<java.util.concurrent.FutureTask>[])futures.toArray())
long end = System.currentTimeMillis();
System.out.println("Took : " + ((end - start) / 1000));
session.shutdown()
On Thu, Dec 13, 2018 at 3:43 PM Sandeep Moré <mo...@gmail.com> wrote:
> Thank you Kevin,
>
> +1 (binding)
> * Downloaded and built from source
> * Checked LICENSE and NOTICE files
> * Verified GPG/SHA signatures for Knox source, Knox and Knoxshell release
> packages
> * Installed pseudo-distributed instance (Mac OS X )
> * Ran through knox tests
> * Checked websocket functionality
> * Checked java script compression (Ambari UI)
> * Checked Topology Port Mapping feature
> * Checked KnoxShell samples
>
> Best,
> Sandeep
>
> On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden <kr...@apache.org> wrote:
>
> > Release candidate #4 for the Apache Knox 1.2.0 release is available at:
> >
> > https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
> >
> > The release candidate is a zip archive of the sources in:
> >
> > https://git-wip-us.apache.org/repos/asf/knox.git
> > Branch v1.2.0 (git checkout -b v1.2.0)
> > Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
> >
> > The KEYS file for signature validation is available at:
> > https://dist.apache.org/repos/dist/release/knox/KEYS
> >
> > Please vote on releasing this package as Apache Knox 1.2.0.
> > The vote is open for the next 72 hours and passes if a majority of at
> > least three +1 Apache Knox PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Knox 1.2.0
> > [ ] -1 Do not release this package because...
> >
> > Kevin Risden
> >
>
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by Sandeep Moré <mo...@gmail.com>.
Thank you Kevin,
+1 (binding)
* Downloaded and built from source
* Checked LICENSE and NOTICE files
* Verified GPG/SHA signatures for Knox source, Knox and Knoxshell release
packages
* Installed pseudo-distributed instance (Mac OS X )
* Ran through knox tests
* Checked websocket functionality
* Checked java script compression (Ambari UI)
* Checked Topology Port Mapping feature
* Checked KnoxShell samples
Best,
Sandeep
On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden <kr...@apache.org> wrote:
> Release candidate #4 for the Apache Knox 1.2.0 release is available at:
>
> https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
>
> The release candidate is a zip archive of the sources in:
>
> https://git-wip-us.apache.org/repos/asf/knox.git
> Branch v1.2.0 (git checkout -b v1.2.0)
> Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
>
> The KEYS file for signature validation is available at:
> https://dist.apache.org/repos/dist/release/knox/KEYS
>
> Please vote on releasing this package as Apache Knox 1.2.0.
> The vote is open for the next 72 hours and passes if a majority of at
> least three +1 Apache Knox PMC votes are cast.
>
> [ ] +1 Release this package as Apache Knox 1.2.0
> [ ] -1 Do not release this package because...
>
> Kevin Risden
>
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by Kevin Risden <kr...@apache.org>.
+1
Tested the following:
- src zip - mvn verify -Ppackage,release
- knoxshell - able to connect to Knox and execute a few examples
- Ran rc against https://github.com/risdenk/knox-performance-tests to
test unsecure webhdfs, hbase, hive
- Manual testing of UIs with Kerberos
- Zeppelin UI with websocket enabled
- Manual testing of Knox against Kerberized cluster
- knoxsso Pac4j backed by Okta
- hadoopauth provider
- token service and Bearer tokens
- default topology url
- topology port mapping
- ambari discovery
- hadoop group provider
- metrics
- ranger integration - via /ext loading
- Knoxsso misconfiguration doesn't result in stacktrace
Kevin Risden
On Mon, Dec 10, 2018 at 3:40 PM Kevin Risden <kr...@apache.org> wrote:
> Release candidate #4 for the Apache Knox 1.2.0 release is available at:
>
> https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
>
> The release candidate is a zip archive of the sources in:
>
> https://git-wip-us.apache.org/repos/asf/knox.git
> Branch v1.2.0 (git checkout -b v1.2.0)
> Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
>
> The KEYS file for signature validation is available at:
> https://dist.apache.org/repos/dist/release/knox/KEYS
>
> Please vote on releasing this package as Apache Knox 1.2.0.
> The vote is open for the next 72 hours and passes if a majority of at
> least three +1 Apache Knox PMC votes are cast.
>
> [ ] +1 Release this package as Apache Knox 1.2.0
> [ ] -1 Do not release this package because...
>
> Kevin Risden
>
Re: [VOTE] Release Apache Knox 1.2.0 RC 4
Posted by Jeffrey Rodriguez <je...@gmail.com>.
Build RC4 Knox 1.2.0, run tests and apps.
+1 Release this package as Apache Knox 1.2.0
Regards,
Jeffrey E Rodriguez
On Mon, Dec 10, 2018 at 12:40 PM Kevin Risden <kr...@apache.org> wrote:
> Release candidate #4 for the Apache Knox 1.2.0 release is available at:
>
> https://dist.apache.org/repos/dist/dev/knox/knox-1.2.0/
>
> The release candidate is a zip archive of the sources in:
>
> https://git-wip-us.apache.org/repos/asf/knox.git
> Branch v1.2.0 (git checkout -b v1.2.0)
> Tag is v1.2.0-rc4 (git checkout -b v1.2.0-rc4)
>
> The KEYS file for signature validation is available at:
> https://dist.apache.org/repos/dist/release/knox/KEYS
>
> Please vote on releasing this package as Apache Knox 1.2.0.
> The vote is open for the next 72 hours and passes if a majority of at
> least three +1 Apache Knox PMC votes are cast.
>
> [ ] +1 Release this package as Apache Knox 1.2.0
> [ ] -1 Do not release this package because...
>
> Kevin Risden
>