You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Zhou, Richard" <ri...@intel.com> on 2015/04/20 08:01:48 UTC
[VOTE] Release Sqoop version 1.99.6 rc 1
Hi all Sqoop developers,
This is the release candidate 1 of Sqoop 2, version 1.99.6. There are 3 purposes of this release:
- Role Based Access Control ( https://issues.apache.org/jira/browse/SQOOP-1763 )
- Making the Rest API backwards compatible ( https://issues.apache.org/jira/browse/SQOOP-2162 )
- Fixing Sqoop2 upgrade path ( https://issues.apache.org/jira/browse/SQOOP-1841 )
*** Please cast your vote by Friday 2015-4-23 ***
The list of fixed issues:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin
The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
http://people.apache.org/~abe/sqoop/releases/1.99.6/rc1/
The tag to be voted upon:
https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc1
The KEYS file:
http://www.apache.org/dist/sqoop/KEYS
Thanks Abe for the great support to make it happen.
Regards
Richard
Re: [VOTE] Release Sqoop version 1.99.6 rc 1
Posted by Venkat Ranganathan <vr...@hortonworks.com>.
Good catch on the package name
I would vote for the package name to authorization instead of Authorization
Venkat
On 4/24/15, 6:49 PM, "Abraham Elmahrek" <ab...@cloudera.com> wrote:
>Yeah maybe Gwen :).
>
>Hey Richard, I noticed 1 thing while looking into authorization. The
>package name has a capital "A" in it (i.e. org
>.apache.sqoop.security.Authorization). I think we should change it for
>consistency. But I'd like to hear what the rest of the community thinks as
>well.
>
>-Abe
>
>On Thu, Apr 23, 2015 at 12:54 PM, Jarek Jarcec Cecho <ja...@apache.org>
>wrote:
>
>> +1
>>
>> * Verified checksums and signature files
>> * Verified third party jars in binary artifact
>> * Checked top level files (NOTICE, ...)
>> * Run tests
>>
>> Jarcec
>>
>> > On Apr 19, 2015, at 11:01 PM, Zhou, Richard <ri...@intel.com>
>> wrote:
>> >
>> > Hi all Sqoop developers,
>> >
>> > This is the release candidate 1 of Sqoop 2, version 1.99.6. There are 3
>> purposes of this release:
>> >
>> > - Role Based Access Control (
>> https://issues.apache.org/jira/browse/SQOOP-1763 )
>> > - Making the Rest API backwards compatible (
>> https://issues.apache.org/jira/browse/SQOOP-2162 )
>> > - Fixing Sqoop2 upgrade path (
>> https://issues.apache.org/jira/browse/SQOOP-1841 )
>> >
>> > *** Please cast your vote by Friday 2015-4-23 ***
>> >
>> > The list of fixed issues:
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin
>> >
>> > The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
>> > http://people.apache.org/~abe/sqoop/releases/1.99.6/rc1/
>> >
>> > The tag to be voted upon:
>> >
>> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc1
>> >
>> > The KEYS file:
>> > http://www.apache.org/dist/sqoop/KEYS
>> >
>> > Thanks Abe for the great support to make it happen.
>> >
>> >
>> > Regards
>> > Richard
>> >
>>
>>
Re: [VOTE] Release Sqoop version 1.99.6 rc 1
Posted by Abraham Elmahrek <ab...@cloudera.com>.
Yeah maybe Gwen :).
Hey Richard, I noticed 1 thing while looking into authorization. The
package name has a capital "A" in it (i.e. org
.apache.sqoop.security.Authorization). I think we should change it for
consistency. But I'd like to hear what the rest of the community thinks as
well.
-Abe
On Thu, Apr 23, 2015 at 12:54 PM, Jarek Jarcec Cecho <ja...@apache.org>
wrote:
> +1
>
> * Verified checksums and signature files
> * Verified third party jars in binary artifact
> * Checked top level files (NOTICE, ...)
> * Run tests
>
> Jarcec
>
> > On Apr 19, 2015, at 11:01 PM, Zhou, Richard <ri...@intel.com>
> wrote:
> >
> > Hi all Sqoop developers,
> >
> > This is the release candidate 1 of Sqoop 2, version 1.99.6. There are 3
> purposes of this release:
> >
> > - Role Based Access Control (
> https://issues.apache.org/jira/browse/SQOOP-1763 )
> > - Making the Rest API backwards compatible (
> https://issues.apache.org/jira/browse/SQOOP-2162 )
> > - Fixing Sqoop2 upgrade path (
> https://issues.apache.org/jira/browse/SQOOP-1841 )
> >
> > *** Please cast your vote by Friday 2015-4-23 ***
> >
> > The list of fixed issues:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin
> >
> > The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
> > http://people.apache.org/~abe/sqoop/releases/1.99.6/rc1/
> >
> > The tag to be voted upon:
> >
> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc1
> >
> > The KEYS file:
> > http://www.apache.org/dist/sqoop/KEYS
> >
> > Thanks Abe for the great support to make it happen.
> >
> >
> > Regards
> > Richard
> >
>
>
Re: [VOTE] Release Sqoop version 1.99.6 rc 1
Posted by Jarek Jarcec Cecho <ja...@apache.org>.
+1
* Verified checksums and signature files
* Verified third party jars in binary artifact
* Checked top level files (NOTICE, ...)
* Run tests
Jarcec
> On Apr 19, 2015, at 11:01 PM, Zhou, Richard <ri...@intel.com> wrote:
>
> Hi all Sqoop developers,
>
> This is the release candidate 1 of Sqoop 2, version 1.99.6. There are 3 purposes of this release:
>
> - Role Based Access Control ( https://issues.apache.org/jira/browse/SQOOP-1763 )
> - Making the Rest API backwards compatible ( https://issues.apache.org/jira/browse/SQOOP-2162 )
> - Fixing Sqoop2 upgrade path ( https://issues.apache.org/jira/browse/SQOOP-1841 )
>
> *** Please cast your vote by Friday 2015-4-23 ***
>
> The list of fixed issues:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin
>
> The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
> http://people.apache.org/~abe/sqoop/releases/1.99.6/rc1/
>
> The tag to be voted upon:
> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc1
>
> The KEYS file:
> http://www.apache.org/dist/sqoop/KEYS
>
> Thanks Abe for the great support to make it happen.
>
>
> Regards
> Richard
>
Re: [VOTE] Release Sqoop version 1.99.6 rc 1
Posted by Gwen Shapira <gs...@cloudera.com>.
Nice test script!
Maybe put it in the wiki :)
People love having script examples to copy-paste.
On Wed, Apr 22, 2015 at 1:21 AM, Abraham Elmahrek <ab...@cloudera.com> wrote:
> Hey guys,
>
> +1 LGTM:
>
> - Verified signatures
> - Verified checksums
> - Verified tag
> - Build and unit tests work fine
> - Manually tested new authorization work
> - Ran the script below successfuly
> *mysql.sqoop*
>
> set option --name verbose --value true
>
> // Create generic MySQL link
> create link --cid 4 --name mysql --link-linkConfig-connectionString
> jdbc:mysql://.../test --link-linkConfig-username sqoop
> --link-linkConfig-password sqoop --link-linkConfig-jdbcDriver
> com.mysql.jdbc.Driver
>
> // Create HDFS link
> create link --cid 3 --name hdfs --link-linkConfig-uri hdfs://...:8020/
>
> // Create Kite hdfs link
> create link --cid 1 --name kitehdfs --link-linkConfig-authority ...:8020
>
> // Create Kite hive link
> create link --cid 1 --name kitehive --link-linkConfig-authority ...:9083
>
> // Create MySQL to HDFS Job
> create job --from 1 --to 2 --name mysql2hdfs
> --from-fromJobConfig-tableName fl --to-toJobConfig-outputFormat TEXT_FILE
> --to-toJobConfig-compression NONE --to-toJobConfig-outputDirectory
> /tmp/sqoop2/hdfs/text
>
> // Create HDFS to MySQL Job
> create job --from 2 --to 1 --name hdfs2mysql
> --from-fromJobConfig-inputDirectory /tmp/sqoop2/hdfs/text
> --to-toJobConfig-tableName fl
>
> // Create MySQL to Kite - HDFS Job
> create job --from 1 --to 3 --name mysql2kitehdfsavro
> --from-fromJobConfig-tableName test --to-toJobConfig-uri
> dataset:hdfs:/tmp/sqoop2/kite/avro --to-toJobConfig-fileFormat AVRO
>
> // Create MySQL to Kite - HDFS Job
> create job --from 1 --to 3 --name mysql2kitehdfsparquet
> --from-fromJobConfig-tableName test --to-toJobConfig-uri
> dataset:hdfs:/tmp/sqoop2/kite/parquet --to-toJobConfig-fileFormat PARQUET
>
> // Create MySQL to Kite - Hive Job
> create job --from 1 --to 4 --name mysql2kitehiveavro
> --from-fromJobConfig-tableName test --to-toJobConfig-uri
> dataset:hive:tmp/avro --to-toJobConfig-fileFormat AVRO
>
> // Create MySQL to Kite - Hive Job
> create job --from 1 --to 4 --name mysql2kitehiveparquet
> --from-fromJobConfig-tableName test --to-toJobConfig-uri
> dataset:hive:tmp/parquet --to-toJobConfig-fileFormat PARQUET
>
> // Create Kive - Hive to MySQL
> create job --from 4 --to 1 --name kitehiveavro2mysql
> --from-fromJobConfig-uri dataset:hive:tmp/avro --to-toJobConfig-tableName
> test
>
> // Create Kive - Hive to MySQL
> create job --from 4 --to 1 --name kitehiveparquet2mysql
> --from-fromJobConfig-uri dataset:hive:tmp/parquet
> --to-toJobConfig-tableName test
>
> // Create Kive - HDFS to MySQL
> create job --from 3 --to 1 --name kitehdfsavro2mysql
> --from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/avro
> --to-toJobConfig-tableName test
>
> // Create Kive - HDFS to MySQL
> create job --from 3 --to 1 --name kitehdfsparquet2mysql
> --from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/parquet
> --to-toJobConfig-tableName test
>
> On Sun, Apr 19, 2015 at 11:01 PM, Zhou, Richard <ri...@intel.com>
> wrote:
>
>> Hi all Sqoop developers,
>>
>> This is the release candidate 1 of Sqoop 2, version 1.99.6. There are 3
>> purposes of this release:
>>
>> - Role Based Access Control (
>> https://issues.apache.org/jira/browse/SQOOP-1763 )
>> - Making the Rest API backwards compatible (
>> https://issues.apache.org/jira/browse/SQOOP-2162 )
>> - Fixing Sqoop2 upgrade path (
>> https://issues.apache.org/jira/browse/SQOOP-1841 )
>>
>> *** Please cast your vote by Friday 2015-4-23 ***
>>
>> The list of fixed issues:
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin
>>
>> The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
>> http://people.apache.org/~abe/sqoop/releases/1.99.6/rc1/
>>
>> The tag to be voted upon:
>>
>> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc1
>>
>> The KEYS file:
>> http://www.apache.org/dist/sqoop/KEYS
>>
>> Thanks Abe for the great support to make it happen.
>>
>>
>> Regards
>> Richard
>>
>>
Re: [VOTE] Release Sqoop version 1.99.6 rc 1
Posted by Abraham Elmahrek <ab...@cloudera.com>.
Hey guys,
+1 LGTM:
- Verified signatures
- Verified checksums
- Verified tag
- Build and unit tests work fine
- Manually tested new authorization work
- Ran the script below successfuly
*mysql.sqoop*
set option --name verbose --value true
// Create generic MySQL link
create link --cid 4 --name mysql --link-linkConfig-connectionString
jdbc:mysql://.../test --link-linkConfig-username sqoop
--link-linkConfig-password sqoop --link-linkConfig-jdbcDriver
com.mysql.jdbc.Driver
// Create HDFS link
create link --cid 3 --name hdfs --link-linkConfig-uri hdfs://...:8020/
// Create Kite hdfs link
create link --cid 1 --name kitehdfs --link-linkConfig-authority ...:8020
// Create Kite hive link
create link --cid 1 --name kitehive --link-linkConfig-authority ...:9083
// Create MySQL to HDFS Job
create job --from 1 --to 2 --name mysql2hdfs
--from-fromJobConfig-tableName fl --to-toJobConfig-outputFormat TEXT_FILE
--to-toJobConfig-compression NONE --to-toJobConfig-outputDirectory
/tmp/sqoop2/hdfs/text
// Create HDFS to MySQL Job
create job --from 2 --to 1 --name hdfs2mysql
--from-fromJobConfig-inputDirectory /tmp/sqoop2/hdfs/text
--to-toJobConfig-tableName fl
// Create MySQL to Kite - HDFS Job
create job --from 1 --to 3 --name mysql2kitehdfsavro
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hdfs:/tmp/sqoop2/kite/avro --to-toJobConfig-fileFormat AVRO
// Create MySQL to Kite - HDFS Job
create job --from 1 --to 3 --name mysql2kitehdfsparquet
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hdfs:/tmp/sqoop2/kite/parquet --to-toJobConfig-fileFormat PARQUET
// Create MySQL to Kite - Hive Job
create job --from 1 --to 4 --name mysql2kitehiveavro
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hive:tmp/avro --to-toJobConfig-fileFormat AVRO
// Create MySQL to Kite - Hive Job
create job --from 1 --to 4 --name mysql2kitehiveparquet
--from-fromJobConfig-tableName test --to-toJobConfig-uri
dataset:hive:tmp/parquet --to-toJobConfig-fileFormat PARQUET
// Create Kive - Hive to MySQL
create job --from 4 --to 1 --name kitehiveavro2mysql
--from-fromJobConfig-uri dataset:hive:tmp/avro --to-toJobConfig-tableName
test
// Create Kive - Hive to MySQL
create job --from 4 --to 1 --name kitehiveparquet2mysql
--from-fromJobConfig-uri dataset:hive:tmp/parquet
--to-toJobConfig-tableName test
// Create Kive - HDFS to MySQL
create job --from 3 --to 1 --name kitehdfsavro2mysql
--from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/avro
--to-toJobConfig-tableName test
// Create Kive - HDFS to MySQL
create job --from 3 --to 1 --name kitehdfsparquet2mysql
--from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/parquet
--to-toJobConfig-tableName test
On Sun, Apr 19, 2015 at 11:01 PM, Zhou, Richard <ri...@intel.com>
wrote:
> Hi all Sqoop developers,
>
> This is the release candidate 1 of Sqoop 2, version 1.99.6. There are 3
> purposes of this release:
>
> - Role Based Access Control (
> https://issues.apache.org/jira/browse/SQOOP-1763 )
> - Making the Rest API backwards compatible (
> https://issues.apache.org/jira/browse/SQOOP-2162 )
> - Fixing Sqoop2 upgrade path (
> https://issues.apache.org/jira/browse/SQOOP-1841 )
>
> *** Please cast your vote by Friday 2015-4-23 ***
>
> The list of fixed issues:
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin
>
> The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
> http://people.apache.org/~abe/sqoop/releases/1.99.6/rc1/
>
> The tag to be voted upon:
>
> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc1
>
> The KEYS file:
> http://www.apache.org/dist/sqoop/KEYS
>
> Thanks Abe for the great support to make it happen.
>
>
> Regards
> Richard
>
>