You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by Qian Xu <sx...@googlemail.com> on 2014/09/08 16:58:12 UTC

Review Request 25444: SQOOP-1394: Export data from HDFS back to an RDMS

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25444/
-----------------------------------------------------------

Review request for Sqoop.


Bugs: SQOOP-1394
    https://issues.apache.org/jira/browse/SQOOP-1394


Repository: sqoop-trunk


Description
-------

Export a set of Parquet files from HDFS to a database table. The table must exist in target database. Sqoop will recognize file format by parsing file header. In other words, no extra argument for command line interface is required. 

Example invocation:
```sqoop export --connect JDBC_URI --table TABLE --export-dir /path/to/file
```

Lmitations:
* Like other file formats support, BlobRef is not supported.
* Files are read via Kite SDK. Currently Kite requires `.metadata` present. 


Diffs
-----

  src/java/org/apache/sqoop/mapreduce/ExportJobBase.java 54c27ee 
  src/java/org/apache/sqoop/mapreduce/JdbcExportJob.java fee78e0 
  src/java/org/apache/sqoop/mapreduce/ParquetExportMapper.java PRE-CREATION 
  src/test/com/cloudera/sqoop/TestParquetExport.java PRE-CREATION 

Diff: https://reviews.apache.org/r/25444/diff/


Testing
-------

New test cases are included. All tests passed. 
Manually tested couple of user cases.


Thanks,

Qian Xu


Re: Review Request 25444: SQOOP-1394: Export data from HDFS back to an RDMS

Posted by Jarek Cecho <ja...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/25444/#review52711
-----------------------------------------------------------

Ship it!


Ship It!

- Jarek Cecho


On Sept. 8, 2014, 2:58 p.m., Qian Xu wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/25444/
> -----------------------------------------------------------
> 
> (Updated Sept. 8, 2014, 2:58 p.m.)
> 
> 
> Review request for Sqoop.
> 
> 
> Bugs: SQOOP-1394
>     https://issues.apache.org/jira/browse/SQOOP-1394
> 
> 
> Repository: sqoop-trunk
> 
> 
> Description
> -------
> 
> Export a set of Parquet files from HDFS to a database table. The table must exist in target database. Sqoop will recognize file format by parsing file header. In other words, no extra argument for command line interface is required. 
> 
> Example invocation:
> ```sqoop export --connect JDBC_URI --table TABLE --export-dir /path/to/file
> ```
> 
> Lmitations:
> * Like other file formats support, BlobRef is not supported.
> * Files are read via Kite SDK. Currently Kite requires `.metadata` present. 
> 
> 
> Diffs
> -----
> 
>   src/java/org/apache/sqoop/mapreduce/ExportJobBase.java 54c27ee 
>   src/java/org/apache/sqoop/mapreduce/JdbcExportJob.java fee78e0 
>   src/java/org/apache/sqoop/mapreduce/ParquetExportMapper.java PRE-CREATION 
>   src/test/com/cloudera/sqoop/TestParquetExport.java PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/25444/diff/
> 
> 
> Testing
> -------
> 
> New test cases are included. All tests passed. 
> Manually tested couple of user cases.
> 
> 
> Thanks,
> 
> Qian Xu
> 
>