You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by Abraham Fine <ab...@cloudera.com> on 2015/12/10 03:28:08 UTC
Review Request 41180: SQOOP-2727
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs
-----
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java fa26c14
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine
Re: Review Request 41180: SQOOP-2727
Posted by Jarek Cecho <ja...@apache.org>.
> On Dec. 10, 2015, 11:09 a.m., Jarek Cecho wrote:
> > Overall looks good to me. I have couple of comments inline. It seems that there is findbugs warning and test coverage decrease significantly - perhaps we should improve unit test coverage for the new code?
I've also rerun the precommit hook to see if the failure is relevant.
- Jarek
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/#review109736
-----------------------------------------------------------
On Dec. 10, 2015, 2:28 a.m., Abraham Fine wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41180/
> -----------------------------------------------------------
>
> (Updated Dec. 10, 2015, 2:28 a.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2727
> https://issues.apache.org/jira/browse/SQOOP-2727
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
>
>
> Diffs
> -----
>
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java fa26c14
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
> connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
> connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
>
> Diff: https://reviews.apache.org/r/41180/diff/
>
>
> Testing
> -------
>
> yup
>
>
> Thanks,
>
> Abraham Fine
>
>
Re: Review Request 41180: SQOOP-2727
Posted by Jarek Cecho <ja...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/#review109736
-----------------------------------------------------------
Overall looks good to me. I have couple of comments inline. It seems that there is findbugs warning and test coverage decrease significantly - perhaps we should improve unit test coverage for the new code?
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java (lines 34 - 35)
<https://reviews.apache.org/r/41180/#comment169363>
Good example of tests that we should add is the logic in readFields/writeWields - since we have now quite a lot of logic there what about writing a test cases for the serializatin/deserialization?
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java (line 56)
<https://reviews.apache.org/r/41180/#comment169362>
Shouldn't we add a space or something here when creating multi condition partition?
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java (lines 20 - 37)
<https://reviews.apache.org/r/41180/#comment169364>
Seems as not relevant change? (just moving lines around that doesn't do anything)
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java (lines 20 - 35)
<https://reviews.apache.org/r/41180/#comment169365>
Again seem as not relevant import-reordering?
Jarcec
- Jarek Cecho
On Dec. 10, 2015, 2:28 a.m., Abraham Fine wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41180/
> -----------------------------------------------------------
>
> (Updated Dec. 10, 2015, 2:28 a.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2727
> https://issues.apache.org/jira/browse/SQOOP-2727
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
>
>
> Diffs
> -----
>
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java fa26c14
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
> connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
> connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
>
> Diff: https://reviews.apache.org/r/41180/diff/
>
>
> Testing
> -------
>
> yup
>
>
> Thanks,
>
> Abraham Fine
>
>
Re: Review Request 41180: SQOOP-2727
Posted by Jarek Cecho <ja...@apache.org>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/#review110728
-----------------------------------------------------------
Ship it!
Ship It!
- Jarek Cecho
On Dec. 16, 2015, 6:23 a.m., Abraham Fine wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/41180/
> -----------------------------------------------------------
>
> (Updated Dec. 16, 2015, 6:23 a.m.)
>
>
> Review request for Sqoop.
>
>
> Bugs: SQOOP-2727
> https://issues.apache.org/jira/browse/SQOOP-2727
>
>
> Repository: sqoop-sqoop2
>
>
> Description
> -------
>
> Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
>
>
> Diffs
> -----
>
> common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java 3b0b568
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java 41be8bb
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
> connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
> connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
> connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
> connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
> test/src/test/java/org/apache/sqoop/integration/connector/jdbc/generic/TableStagedRDBMSTest.java 2565c3f
>
> Diff: https://reviews.apache.org/r/41180/diff/
>
>
> Testing
> -------
>
> yup
>
>
> Thanks,
>
> Abraham Fine
>
>
Re: Review Request 41180: SQOOP-2727
Posted by Abraham Fine <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
(Updated Dec. 16, 2015, 6:23 a.m.)
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs (updated)
-----
common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java 3b0b568
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java 41be8bb
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
test/src/test/java/org/apache/sqoop/integration/connector/jdbc/generic/TableStagedRDBMSTest.java 2565c3f
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine
Re: Review Request 41180: SQOOP-2727
Posted by Abraham Fine <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
(Updated Dec. 16, 2015, 4:24 a.m.)
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs (updated)
-----
common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java 3b0b568
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java 41be8bb
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
test/src/test/java/org/apache/sqoop/integration/connector/jdbc/generic/TableStagedRDBMSTest.java 2565c3f
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine
Re: Review Request 41180: SQOOP-2727
Posted by Abraham Fine <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
(Updated Dec. 16, 2015, 1:47 a.m.)
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs (updated)
-----
common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java 3b0b568
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java 41be8bb
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
test/src/test/java/org/apache/sqoop/integration/connector/jdbc/generic/TableStagedRDBMSTest.java 2565c3f
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine
Re: Review Request 41180: SQOOP-2727
Posted by Abraham Fine <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
(Updated Dec. 15, 2015, 7:22 p.m.)
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs (updated)
-----
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine
Re: Review Request 41180: SQOOP-2727
Posted by Abraham Fine <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
(Updated Dec. 15, 2015, 6:09 a.m.)
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs (updated)
-----
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java fa26c14
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine
Re: Review Request 41180: SQOOP-2727
Posted by Abraham Fine <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
(Updated Dec. 15, 2015, 5:06 a.m.)
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs (updated)
-----
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java fa26c14
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine
Re: Review Request 41180: SQOOP-2727
Posted by Abraham Fine <ab...@cloudera.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/41180/
-----------------------------------------------------------
(Updated Dec. 14, 2015, 11:35 p.m.)
Review request for Sqoop.
Bugs: SQOOP-2727
https://issues.apache.org/jira/browse/SQOOP-2727
Repository: sqoop-sqoop2
Description
-------
Sqoop2: Use PreparedStatements for constructing GenericJDBCPartitions
Diffs (updated)
-----
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExecutor.java ff33a4b
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcExtractor.java edb2754
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcFromInitializer.java fa26c14
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartition.java 65400ef
connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcPartitioner.java 2a42ed4
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestExtractor.java 3b52128
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestGenericJdbcPartition.java PRE-CREATION
connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestPartitioner.java 3a767ab
Diff: https://reviews.apache.org/r/41180/diff/
Testing
-------
yup
Thanks,
Abraham Fine