You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by David Robson <da...@quest.com> on 2015/09/30 06:28:38 UTC

Review Request 38881: Add Oracle connector to Sqoop 2

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/
-----------------------------------------------------------

Review request for Sqoop.


Repository: sqoop-sqoop2


Description
-------

Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.


Diffs
-----

  connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
  connector/pom.xml 1b69180 
  pom.xml ef3f5f4 
  server/pom.xml 59663fa 
  test/pom.xml 8218477 
  test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java a0ef78a 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ExportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ImportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleConnectionFactoryTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleQueriesTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestCase.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestConstants.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BigDecimalGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryDoubleGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryFloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BlobGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BytesGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/CharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/FloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/HadoopFiles.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalDaySecondGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalYearMonthGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/NCharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleData.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleDataDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTableDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestDataGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestUtils.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/RowIdGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/TimestampGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/URIGenerator.java PRE-CREATION 
  test/src/test/resources/oracle/create_users.sql PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.pbk PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.psk PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part_iot.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_special_chars.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_subpart.xml PRE-CREATION 

Diff: https://reviews.apache.org/r/38881/diff/


Testing
-------

Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.


Thanks,

David Robson


Re: Review Request 38881: Add Oracle connector to Sqoop 2

Posted by Jarek Cecho <ja...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/#review101123
-----------------------------------------------------------


Hi David,
thank you for porting the code! I wasn't able to go through entire code yet, but I figured that it's better to share the notes that I have so far :)

1) We're keeping the test/ module for integration tests with the whole server running as an external component and on minicluster. Component specific integration tests or for tests with external dependencies, should be in it's component specific package. We're using special groups to mark those tests as not running by default. For example for postgresql:

https://github.com/apache/sqoop/blob/sqoop2/repository/repository-postgresql/src/test/java/org/apache/sqoop/integration/repository/postgresql/TestConnectorHandling.java#L33

And then handling in the appropriate pom.xml file:
https://github.com/apache/sqoop/blob/sqoop2/repository/repository-postgresql/pom.xml#L75

2) I'm more then happy to commit not fully finished (but working!) version of the connector and then tune it in subsequent JIRAs. We've chose this approach for most of the connectors and since Sqoop 2 is not mature yet, it's working fine for us at this point.


connector/connector-oracle-jdbc/pom.xml (lines 41 - 44)
<https://reviews.apache.org/r/38881/#comment158456>

    Generally we don't like inter-dependencies on connectors. If there is a reason for this dependency (reusing some code), then we should refactore the shared code to connector-sdk module.



connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java (lines 62 - 69)
<https://reviews.apache.org/r/38881/#comment158460>

    You'll be better of with using standard validator NotEmpty:
    
    https://github.com/apache/sqoop/blob/sqoop2/common/src/main/java/org/apache/sqoop/validation/validators/NotEmpty.java
    
    Soon-ish the standard validators will be enforced on client side as well which will provide a slightly better user experience :)



connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfig.java (line 36)
<https://reviews.apache.org/r/38881/#comment158467>

    I know that the reference for this class is the Generic JDBC Connector, but I reall hate the naming convenction we've used there and now it's hard to rename. Can we call this class ConnectionConfig or something? Since most of the inputs are for connection.
    
    The Confings should contain only inputs that belongs together logically - if we have an input that is not describing connection, we should move it to different Config. Looking at it it seems that most of the inputs are for connection (and or session), the only question that I have I guess is whether actionName and actionName is indeed relevant to "connection". But that is up to you :)
    
    The same arguments (let's use better name and perhaps split the single Configs to multiple ones) applies to other Config classes for this connector.



connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfig.java (line 59)
<https://reviews.apache.org/r/38881/#comment158472>

    Since we're expecting multiple statements here, would it make sense to convert this type to List<String> instead?


Jarcec

- Jarek Cecho


On Sept. 30, 2015, 4:30 a.m., David Robson wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38881/
> -----------------------------------------------------------
> 
> (Updated Sept. 30, 2015, 4:30 a.m.)
> 
> 
> Review request for Sqoop.
> 
> 
> Bugs: SQOOP-2595
>     https://issues.apache.org/jira/browse/SQOOP-2595
> 
> 
> Repository: sqoop-sqoop2
> 
> 
> Description
> -------
> 
> Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.
> 
> 
> Diffs
> -----
> 
>   connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfig.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
>   connector/pom.xml 1b69180 
>   pom.xml ef3f5f4 
>   server/pom.xml 59663fa 
>   test/pom.xml 8218477 
>   test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java a0ef78a 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ExportTest.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ImportTest.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleConnectionFactoryTest.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleQueriesTest.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestCase.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestConstants.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BigDecimalGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryDoubleGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryFloatGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BlobGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BytesGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/CharGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/FloatGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/HadoopFiles.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalDaySecondGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalYearMonthGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/NCharGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleData.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleDataDefinition.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTableDefinition.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestDataGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestUtils.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/RowIdGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/TimestampGenerator.java PRE-CREATION 
>   test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/URIGenerator.java PRE-CREATION 
>   test/src/test/resources/oracle/create_users.sql PRE-CREATION 
>   test/src/test/resources/oracle/pkg_tst_product_gen.pbk PRE-CREATION 
>   test/src/test/resources/oracle/pkg_tst_product_gen.psk PRE-CREATION 
>   test/src/test/resources/oracle/table_tst_product.xml PRE-CREATION 
>   test/src/test/resources/oracle/table_tst_product_part.xml PRE-CREATION 
>   test/src/test/resources/oracle/table_tst_product_part_iot.xml PRE-CREATION 
>   test/src/test/resources/oracle/table_tst_product_special_chars.xml PRE-CREATION 
>   test/src/test/resources/oracle/table_tst_product_subpart.xml PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/38881/diff/
> 
> 
> Testing
> -------
> 
> Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.
> 
> 
> Thanks,
> 
> David Robson
> 
>


Re: Review Request 38881: Add Oracle connector to Sqoop 2

Posted by Jarek Cecho <ja...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/#review105264
-----------------------------------------------------------

Ship it!


Ship It!

- Jarek Cecho


On Nov. 5, 2015, 3:09 a.m., David Robson wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/38881/
> -----------------------------------------------------------
> 
> (Updated Nov. 5, 2015, 3:09 a.m.)
> 
> 
> Review request for Sqoop.
> 
> 
> Bugs: SQOOP-2595
>     https://issues.apache.org/jira/browse/SQOOP-2595
> 
> 
> Repository: sqoop-sqoop2
> 
> 
> Description
> -------
> 
> Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.
> 
> 
> Diffs
> -----
> 
>   connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ConnectionConfig.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
>   connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleConnectionFactoryTest.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleQueriesTest.java PRE-CREATION 
>   connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleTestCase.java PRE-CREATION 
>   connector/pom.xml 1b69180 
>   pom.xml ab505f4 
>   server/pom.xml ca068e0 
> 
> Diff: https://reviews.apache.org/r/38881/diff/
> 
> 
> Testing
> -------
> 
> Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.
> 
> 
> Thanks,
> 
> David Robson
> 
>


Re: Review Request 38881: Add Oracle connector to Sqoop 2

Posted by David Robson <da...@quest.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/
-----------------------------------------------------------

(Updated Nov. 5, 2015, 3:09 a.m.)


Review request for Sqoop.


Changes
-------

Fix whitespaces and compilation problem with latest branch


Bugs: SQOOP-2595
    https://issues.apache.org/jira/browse/SQOOP-2595


Repository: sqoop-sqoop2


Description
-------

Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.


Diffs (updated)
-----

  connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ConnectionConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleConnectionFactoryTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleQueriesTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleTestCase.java PRE-CREATION 
  connector/pom.xml 1b69180 
  pom.xml ab505f4 
  server/pom.xml ca068e0 

Diff: https://reviews.apache.org/r/38881/diff/


Testing
-------

Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.


Thanks,

David Robson


Re: Review Request 38881: Add Oracle connector to Sqoop 2

Posted by David Robson <da...@quest.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/
-----------------------------------------------------------

(Updated Nov. 5, 2015, 2:09 a.m.)


Review request for Sqoop.


Changes
-------

Remove integration tests to add in a follow up JIRA


Bugs: SQOOP-2595
    https://issues.apache.org/jira/browse/SQOOP-2595


Repository: sqoop-sqoop2


Description
-------

Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.


Diffs (updated)
-----

  connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ConnectionConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleConnectionFactoryTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleQueriesTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleTestCase.java PRE-CREATION 
  connector/pom.xml 1b69180 
  pom.xml ab505f4 
  server/pom.xml ca068e0 

Diff: https://reviews.apache.org/r/38881/diff/


Testing
-------

Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.


Thanks,

David Robson


Re: Review Request 38881: Add Oracle connector to Sqoop 2

Posted by David Robson <da...@quest.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/
-----------------------------------------------------------

(Updated Oct. 12, 2015, 6:30 a.m.)


Review request for Sqoop.


Changes
-------

Updated so patch applies on latest branch.
Also the Oracle tests take a long time if java.security.egd is not set so I added it to HadoopMiniClusterRunner.


Bugs: SQOOP-2595
    https://issues.apache.org/jira/browse/SQOOP-2595


Repository: sqoop-sqoop2


Description
-------

Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.


Diffs (updated)
-----

  connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ConnectionConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleConnectionFactoryTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleQueriesTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleTestCase.java PRE-CREATION 
  connector/pom.xml 1b69180 
  pom.xml ab505f4 
  server/pom.xml ca068e0 
  test/pom.xml ad8cd11 
  test/src/main/java/org/apache/sqoop/test/hadoop/HadoopMiniClusterRunner.java 2c0c4e6 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ExportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ImportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestCase.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestConstants.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BigDecimalGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryDoubleGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryFloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BlobGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BytesGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/CharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/FloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/HadoopFiles.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalDaySecondGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalYearMonthGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/NCharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleData.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleDataDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTableDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestDataGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestUtils.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/RowIdGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/TimestampGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/URIGenerator.java PRE-CREATION 
  test/src/test/resources/oracle/create_users.sql PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.pbk PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.psk PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part_iot.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_special_chars.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_subpart.xml PRE-CREATION 

Diff: https://reviews.apache.org/r/38881/diff/


Testing
-------

Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.


Thanks,

David Robson


Re: Review Request 38881: Add Oracle connector to Sqoop 2

Posted by David Robson <da...@quest.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/
-----------------------------------------------------------

(Updated Oct. 9, 2015, 4:04 a.m.)


Review request for Sqoop.


Changes
-------

Updated with Jarcec's suggestions. The only thing I haven't done was the suggestion about initializationStatements. I agree this should be done but I was planning to raise a follow up JIRA to re-work the various parameters to make the connector easier to use so I'd like to do it as part of that if that's OK.


Bugs: SQOOP-2595
    https://issues.apache.org/jira/browse/SQOOP-2595


Repository: sqoop-sqoop2


Description
-------

Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.


Diffs (updated)
-----

  connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ConnectionConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleConnectionFactoryTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleQueriesTest.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/integration/OracleTestCase.java PRE-CREATION 
  connector/pom.xml 1b69180 
  pom.xml ef3f5f4 
  server/pom.xml 59663fa 
  test/pom.xml 8218477 
  test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java a0ef78a 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ExportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ImportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestCase.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestConstants.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BigDecimalGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryDoubleGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryFloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BlobGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BytesGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/CharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/FloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/HadoopFiles.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalDaySecondGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalYearMonthGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/NCharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleData.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleDataDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTableDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestDataGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestUtils.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/RowIdGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/TimestampGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/URIGenerator.java PRE-CREATION 
  test/src/test/resources/oracle/create_users.sql PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.pbk PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.psk PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part_iot.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_special_chars.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_subpart.xml PRE-CREATION 

Diff: https://reviews.apache.org/r/38881/diff/


Testing
-------

Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.


Thanks,

David Robson


Re: Review Request 38881: Add Oracle connector to Sqoop 2

Posted by David Robson <da...@quest.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/38881/
-----------------------------------------------------------

(Updated Sept. 30, 2015, 4:30 a.m.)


Review request for Sqoop.


Bugs: SQOOP-2595
    https://issues.apache.org/jira/browse/SQOOP-2595


Repository: sqoop-sqoop2


Description
-------

Have migrated the code from the Oracle direct connector to Sqoop 2. There is still work to be done but it is working so I would like to get some feedback on the work so far. As the code is limited to one connector I am hoping we can commit it then fix issues in follow up JIRAs as it will make it a bit easier to break the tasks down.


Diffs
-----

  connector/connector-oracle-jdbc/pom.xml PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcCommonInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnector.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorConstants.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcConnectorUpgrader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcExtractor.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcFromInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcLoader.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToDestroyer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/OracleJdbcToInitializer.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/FromJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/LinkConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfig.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/configuration/ToJobConfiguration.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleActiveInstance.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleConnectionFactory.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunk.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkExtent.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleDataChunkPartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleGenerics.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleQueries.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleSqlTypesUtils.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumn.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTableColumns.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartition.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleTablePartitions.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleUtilities.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/oracle/util/OracleVersion.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/oracle-jdbc-connector-config.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/main/resources/sqoopconnector.properties PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcPartitioner.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleJdbcUrl.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleTable.java PRE-CREATION 
  connector/connector-oracle-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/oracle/TestOracleUtilities.java PRE-CREATION 
  connector/pom.xml 1b69180 
  pom.xml ef3f5f4 
  server/pom.xml 59663fa 
  test/pom.xml 8218477 
  test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java a0ef78a 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ExportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/ImportTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleConnectionFactoryTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleQueriesTest.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestCase.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/OracleTestConstants.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BigDecimalGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryDoubleGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BinaryFloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BlobGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/BytesGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/CharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/FloatGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/HadoopFiles.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalDaySecondGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/IntervalYearMonthGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/NCharGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleData.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleDataDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTableDefinition.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestDataGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/OracleTestUtils.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/RowIdGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/TimestampGenerator.java PRE-CREATION 
  test/src/test/java/org/apache/sqoop/integration/connector/jdbc/oracle/util/URIGenerator.java PRE-CREATION 
  test/src/test/resources/oracle/create_users.sql PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.pbk PRE-CREATION 
  test/src/test/resources/oracle/pkg_tst_product_gen.psk PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_part_iot.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_special_chars.xml PRE-CREATION 
  test/src/test/resources/oracle/table_tst_product_subpart.xml PRE-CREATION 

Diff: https://reviews.apache.org/r/38881/diff/


Testing
-------

Have done lots of manual testing and migrated some of the automated tests. Some of them I am having issues with which I will follow up.


Thanks,

David Robson