You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by Abraham Elmahrek <ab...@cloudera.com> on 2015/05/01 07:08:11 UTC

Re: [VOTE] Release Sqoop version 1.99.6 rc 2

+1. Good job Richard.

   - Verified tag
   - Build and unit tests work fine
   - Manually tested new authorization work
   - Ran the script below successfuly
   *mysql.sqoop*

   set option --name verbose --value true

   // Create generic MySQL link
   create link --cid 4 --name mysql --link-linkConfig-connectionString
   jdbc:mysql://.../test --link-linkConfig-username sqoop
   --link-linkConfig-password sqoop --link-linkConfig-jdbcDriver
   com.mysql.jdbc.Driver

   // Create HDFS link
   create link --cid 3 --name hdfs --link-linkConfig-uri hdfs://...:8020/

   // Create Kite hdfs link
   create link --cid 1 --name kitehdfs --link-linkConfig-authority ...:8020

   // Create Kite hive link
   create link --cid 1 --name kitehive --link-linkConfig-authority ...:9083

   // Create MySQL to HDFS Job
   create job --from 1 --to 2 --name mysql2hdfs
   --from-fromJobConfig-tableName fl --to-toJobConfig-outputFormat TEXT_FILE
   --to-toJobConfig-compression NONE --to-toJobConfig-outputDirectory
   /tmp/sqoop2/hdfs/text

   // Create HDFS to MySQL Job
   create job --from 2 --to 1 --name hdfs2mysql
   --from-fromJobConfig-inputDirectory /tmp/sqoop2/hdfs/text
   --to-toJobConfig-tableName fl

   // Create MySQL to Kite - HDFS Job
   create job --from 1 --to 3 --name mysql2kitehdfsavro
   --from-fromJobConfig-tableName test --to-toJobConfig-uri
   dataset:hdfs:/tmp/sqoop2/kite/avro --to-toJobConfig-fileFormat AVRO

   // Create MySQL to Kite - HDFS Job
   create job --from 1 --to 3 --name mysql2kitehdfsparquet
   --from-fromJobConfig-tableName test --to-toJobConfig-uri
   dataset:hdfs:/tmp/sqoop2/kite/parquet --to-toJobConfig-fileFormat PARQUET

   // Create MySQL to Kite - Hive Job
   create job --from 1 --to 4 --name mysql2kitehiveavro
   --from-fromJobConfig-tableName test --to-toJobConfig-uri
   dataset:hive:tmp/avro --to-toJobConfig-fileFormat AVRO

   // Create MySQL to Kite - Hive Job
   create job --from 1 --to 4 --name mysql2kitehiveparquet
   --from-fromJobConfig-tableName test --to-toJobConfig-uri
   dataset:hive:tmp/parquet --to-toJobConfig-fileFormat PARQUET

   // Create Kive - Hive to MySQL
   create job --from 4 --to 1 --name kitehiveavro2mysql
   --from-fromJobConfig-uri dataset:hive:tmp/avro --to-toJobConfig-tableName
   test

   // Create Kive - Hive to MySQL
   create job --from 4 --to 1 --name kitehiveparquet2mysql
   --from-fromJobConfig-uri dataset:hive:tmp/parquet
   --to-toJobConfig-tableName test

   // Create Kive - HDFS to MySQL
   create job --from 3 --to 1 --name kitehdfsavro2mysql
   --from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/avro
   --to-toJobConfig-tableName test

   // Create Kive - HDFS to MySQL
   create job --from 3 --to 1 --name kitehdfsparquet2mysql
   --from-fromJobConfig-uri dataset:hdfs:/tmp/sqoop2/kite/parquet
   --to-toJobConfig-tableName test


On Wed, Apr 29, 2015 at 12:44 PM, Venkat Ranganathan <
vranganathan@hortonworks.com> wrote:

> +1
>
> Verified checksums and signature files
> Built and ran tests
>
> Venkat
> ________________________________________
> From: Jarek Jarcec Cecho <ja...@gmail.com> on behalf of Jarek Jarcec
> Cecho <ja...@apache.org>
> Sent: Wednesday, April 29, 2015 10:36 AM
> To: dev@sqoop.apache.org
> Subject: Re: [VOTE] Release Sqoop version 1.99.6 rc 2
>
> +1
>
> * Verified checksums and signature files
> * Verified third party jars in binary artifact
> * Checked top level files (NOTICE, ...)
> * Run tests
>
> Jarcec
>
> > On Apr 29, 2015, at 12:45 AM, Zhou, Richard <ri...@intel.com>
> wrote:
> >
> > Hi all Sqoop developers,
> >
> > This is the release candidate 2 of Sqoop 2, version 1.99.6. There are 3
> purposes of this release:
> >
> >  - Role Based Access Control (
> https://issues.apache.org/jira/browse/SQOOP-1763 )
> >  - Making the Rest API backwards compatible (
> https://issues.apache.org/jira/browse/SQOOP-2162 )
> >  - Fixing Sqoop2 upgrade path (
> https://issues.apache.org/jira/browse/SQOOP-1841 )
> >
> > *** Please cast your vote by Friday 2015-5-1 ***
> >
> > The list of fixed issues:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12328967&styleName=Text&projectId=12311320&Create=Create&atl_token=A5KQ-2QAV-T4JA-FDED%7Cfacf4add2faf24a264f9ea680204bc568b1401b0%7Clin
> >
> > The tarball (*.tar.gz), signature (*.asc), checksum (*.md5, *.sha):
> > http://people.apache.org/~abe/sqoop/releases/1.99.6/rc2/
> >
> > The tag to be voted upon:
> >
> https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=tag;h=refs/tags/release-1.99.6-rc2
> >
> > The KEYS file:
> > http://www.apache.org/dist/sqoop/KEYS
> >
> > Thanks Abe for the great support to make it happen.
> >
> > Regards
> > Richard
>
>