You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by Abraham Elmahrek <ab...@cloudera.com> on 2015/03/26 09:37:55 UTC
Review Request 32530: SQOOP-2238: Sqoop2: Parquet jars missing
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32530/
-----------------------------------------------------------
Review request for Sqoop.
Bugs: SQOOP-2238
https://issues.apache.org/jira/browse/SQOOP-2238
Repository: sqoop-sqoop2
Description
-------
commit 831cba45e7a53abf6af1e44bb8370424f1a9b820
Author: Abraham Elmahrek <ab...@apache.org>
Date: Thu Mar 26 01:21:21 2015 -0700
SQOOP-2238: Sqoop2: Parquet jars missing
:100644 100644 06f18e7... fd3017b... M connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteFromInitializer.java
:100644 100644 39a2989... e27c0b8... M connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToInitializer.java
Diffs
-----
connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteFromInitializer.java 06f18e7
connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToInitializer.java 39a2989
Diff: https://reviews.apache.org/r/32530/diff/
Testing
-------
tested manually:
create link --cid 4 --name mysql --link-linkConfig-connectionString jdbc:mysql://example.com/test --link-linkConfig-username sqoop --link-linkConfig-password sqoop --link-linkConfig-jdbcDriver com.mysql.jdbc.Driver
create link --cid 1 --name kitehive --link-linkConfig-authority example.com:9083
create link --cid 1 --name kitehdfs --link-linkConfig-authority example.com:8020
create job --from 1 --to 2 --name mysql2kitehdfsparquet --from-fromJobConfig-tableName test --to-toJobConfig-uri dataset:hdfs:/tmp/sqoop/hdfs --to-toJobConfig-fileFormat PARQUET
create job --from 1 --to 3 --name mysql2kitehiveparquet --from-fromJobConfig-tableName test --to-toJobConfig-uri dataset:hive:tmp/test --to-toJobConfig-fileFormat PARQUET
start job --jid 1
start job --jid 2
Can't create integration tests for hive/parquet or hdfs/parquet yet. I've filed https://issues.apache.org/jira/browse/SQOOP-2269 for hive.
Thanks,
Abraham Elmahrek
Re: Review Request 32530: SQOOP-2238: Sqoop2: Parquet jars missing
Posted by Qian Xu <qi...@intel.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32530/#review78009
-----------------------------------------------------------
Ship it!
Ship It!
- Qian Xu
On March 26, 2015, 4:37 p.m., Abraham Elmahrek wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/32530/
> -----------------------------------------------------------
>
> (Updated March 26, 2015, 4:37 p.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2238
> https://issues.apache.org/jira/browse/SQOOP-2238
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> commit 831cba45e7a53abf6af1e44bb8370424f1a9b820
> Author: Abraham Elmahrek <ab...@apache.org>
> Date: Thu Mar 26 01:21:21 2015 -0700
>
> SQOOP-2238: Sqoop2: Parquet jars missing
>
> :100644 100644 06f18e7... fd3017b... M connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteFromInitializer.java
> :100644 100644 39a2989... e27c0b8... M connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToInitializer.java
>
>
> Diffs
> -----
>
> connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteFromInitializer.java 06f18e7
> connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteToInitializer.java 39a2989
>
> Diff: https://reviews.apache.org/r/32530/diff/
>
>
> Testing
> -------
>
> tested manually:
> create link --cid 4 --name mysql --link-linkConfig-connectionString jdbc:mysql://example.com/test --link-linkConfig-username sqoop --link-linkConfig-password sqoop --link-linkConfig-jdbcDriver com.mysql.jdbc.Driver
> create link --cid 1 --name kitehive --link-linkConfig-authority example.com:9083
> create link --cid 1 --name kitehdfs --link-linkConfig-authority example.com:8020
> create job --from 1 --to 2 --name mysql2kitehdfsparquet --from-fromJobConfig-tableName test --to-toJobConfig-uri dataset:hdfs:/tmp/sqoop/hdfs --to-toJobConfig-fileFormat PARQUET
> create job --from 1 --to 3 --name mysql2kitehiveparquet --from-fromJobConfig-tableName test --to-toJobConfig-uri dataset:hive:tmp/test --to-toJobConfig-fileFormat PARQUET
> start job --jid 1
> start job --jid 2
>
> Can't create integration tests for hive/parquet or hdfs/parquet yet. I've filed https://issues.apache.org/jira/browse/SQOOP-2269 for hive.
>
>
> Thanks,
>
> Abraham Elmahrek
>
>