You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2013/02/10 22:49:14 UTC
[jira] [Commented] (SQOOP-864) Sqoop2: Introduce ETL context
objects
[ https://issues.apache.org/jira/browse/SQOOP-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13575542#comment-13575542 ]
Hudson commented on SQOOP-864:
------------------------------
Integrated in Sqoop2-hadoop100 #174 (See [https://builds.apache.org/job/Sqoop2-hadoop100/174/])
SQOOP-864: Introduce ETL context objects (Revision ed9c514361b508b739c76df31d7719660f095bd3)
Result = SUCCESS
cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ed9c514361b508b739c76df31d7719660f095bd3
Files :
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExportDestroyer.java
* core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsExportPartitioner.java
* common/src/main/java/org/apache/sqoop/job/etl/InitializerContext.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsLoad.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportExtractor.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestImportInitializer.java
* spi/src/main/java/org/apache/sqoop/job/etl/Initializer.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestImportPartitioner.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExportLoader.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportPartitioner.java
* common/src/main/java/org/apache/sqoop/etl/io/DataWriter.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopDestroyerExecutor.java
* spi/src/main/java/org/apache/sqoop/job/io/DataReader.java
* common/src/main/java/org/apache/sqoop/etl/io/DataReader.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExportInitializer.java
* spi/src/main/java/org/apache/sqoop/job/etl/Partitioner.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopInputFormat.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMapReduce.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExportInitializer.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportInitializer.java
* spi/src/main/java/org/apache/sqoop/job/io/DataWriter.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/mr/TestSqoopOutputFormatLoadExecutor.java
* common/src/main/java/org/apache/sqoop/job/etl/LoaderContext.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceImportLoader.java
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportDestroyer.java
* execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsExtract.java
* spi/src/main/java/org/apache/sqoop/job/etl/Destroyer.java
* common/src/main/java/org/apache/sqoop/job/etl/DestroyerContext.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExportLoader.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopOutputFormatLoadExecutor.java
* spi/src/main/java/org/apache/sqoop/job/etl/Extractor.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextExportExtractor.java
* common/src/main/java/org/apache/sqoop/job/etl/PartitionerContext.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestImportExtractor.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextImportLoader.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceExportExtractor.java
* common/src/main/java/org/apache/sqoop/job/etl/ExtractorContext.java
* spi/src/main/java/org/apache/sqoop/job/etl/Loader.java
* execution/mapreduce/src/main/java/org/apache/sqoop/job/mr/SqoopMapper.java
* common/src/main/java/org/apache/sqoop/job/etl/ActorContext.java
> Sqoop2: Introduce ETL context objects
> -------------------------------------
>
> Key: SQOOP-864
> URL: https://issues.apache.org/jira/browse/SQOOP-864
> Project: Sqoop
> Issue Type: Improvement
> Affects Versions: 1.99.1
> Reporter: Jarek Jarcec Cecho
> Assignee: Jarek Jarcec Cecho
> Fix For: 1.99.2
>
> Attachments: bugSQOOP-864.patch, bugSQOOP-864.patch, bugSQOOP-864.patch
>
>
> I've came to a need to add new parameter into Extractor.extract and Loader.load methods. I've realized that doing so will break backward compatibility as both classes are part of public API for connectors. Right now it's not an issue as that API not stable yet, but it would be nice to create more generic approach that will allow us to extend it in the future without breaking backward compatibility.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira