You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "PIERETTI ANTOINE (Created) (JIRA)" <ji...@apache.org> on 2011/12/09 15:14:41 UTC
[jira] [Created] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Update Avro files using OraOop and Oracle Database
--------------------------------------------------
Key: SQOOP-406
URL: https://issues.apache.org/jira/browse/SQOOP-406
Project: Sqoop
Issue Type: Bug
Affects Versions: 1.4.0-incubating
Environment: Linux
Sqoop : 1.4.0
Oraoop : oraoop-1.4.0.149
Hadoop : hadoop-core-0.20.2-cdh3u2
Reporter: PIERETTI ANTOINE
Hi,
I am trying to update an Oracle Database, from Avro Files.
As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
But at the begining of the file, the avro schema is described, so the update statement failed.
I try to implement the AvroExportMapper, wich seem works.
Regards,
Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "Jarek Jarcec Cecho (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13167095#comment-13167095 ]
Jarek Jarcec Cecho commented on SQOOP-406:
------------------------------------------
Hi Pieretti,
it seems that you've already manage to fix this issue by implementing AvroExportMapper. Would you be so kind and upload your work to review board (https://reviews.apache.org) so that we can review your changes and eventually commit them into sqoop? If you're ok with doing so of course.
Jarcec
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13190088#comment-13190088 ]
jiraposter@reviews.apache.org commented on SQOOP-406:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3195/#review4507
-----------------------------------------------------------
Thanks for the patch! There are some style violations. Could you please fix them? You can find the style violations in "build/checkstyle-errors.html" after running "ant checkstyle".
- Bilung
On 2011-12-14 13:29:10, pieretti antoine wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/3195/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-12-14 13:29:10)
bq.
bq.
bq. Review request for Sqoop.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Quick fix permits updating avro files. It should be better to mutualized / inheritance code with JdbcExport and other JobBase
bq.
bq.
bq. This addresses bug SQOOP-406.
bq. https://issues.apache.org/jira/browse/SQOOP-406
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java 1214229
bq.
bq. Diff: https://reviews.apache.org/r/3195/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq.
bq. Thanks,
bq.
bq. pieretti
bq.
bq.
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "Bilung Lee (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bilung Lee updated SQOOP-406:
-----------------------------
Status: Patch Available (was: Open)
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "Arvind Prabhakar (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar reassigned SQOOP-406:
--------------------------------------
Assignee: Pieretti Antoine
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
> Assignee: Pieretti Antoine
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13169337#comment-13169337 ]
jiraposter@reviews.apache.org commented on SQOOP-406:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3195/
-----------------------------------------------------------
Review request for Sqoop.
Summary
-------
Quick fix permits updating avro files. It should be better to mutualized / inheritance code with JdbcExport and other JobBase
This addresses bug SQOOP-406.
https://issues.apache.org/jira/browse/SQOOP-406
Diffs
-----
src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java 1214229
Diff: https://reviews.apache.org/r/3195/diff
Testing
-------
Thanks,
pieretti
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "Bilung Lee (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bilung Lee updated SQOOP-406:
-----------------------------
Status: Open (was: Patch Available)
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating, 1.4.1-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
> Assignee: Pieretti Antoine
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "Jarek Jarcec Cecho (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarek Jarcec Cecho updated SQOOP-406:
-------------------------------------
Affects Version/s: 1.4.1-incubating
Fix Version/s: (was: 1.4.1-incubating)
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating, 1.4.1-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
> Assignee: Pieretti Antoine
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-406) Update Avro files using OraOop and
Oracle Database
Posted by "Jarek Jarcec Cecho (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarek Jarcec Cecho updated SQOOP-406:
-------------------------------------
Fix Version/s: 1.4.1-incubating
> Update Avro files using OraOop and Oracle Database
> --------------------------------------------------
>
> Key: SQOOP-406
> URL: https://issues.apache.org/jira/browse/SQOOP-406
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Environment: Linux
> Sqoop : 1.4.0
> Oraoop : oraoop-1.4.0.149
> Hadoop : hadoop-core-0.20.2-cdh3u2
> Reporter: Pieretti Antoine
> Assignee: Pieretti Antoine
> Fix For: 1.4.1-incubating
>
>
> Hi,
> I am trying to update an Oracle Database, from Avro Files.
> As in JdbcUpdateExportJob only SequenceFileExportMapper and TextExportMapper are available , the update Job try to parse the file using TextExportMapper.
> But at the begining of the file, the avro schema is described, so the update statement failed.
> I try to implement the AvroExportMapper, wich seem works.
> Regards,
> Antoine
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira