You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sqoop.apache.org by "Arvind Prabhakar (Created) (JIRA)" <ji...@apache.org> on 2011/12/28 05:57:30 UTC
[jira] [Created] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
------------------------------------------------------------------
Key: SQOOP-418
URL: https://issues.apache.org/jira/browse/SQOOP-418
Project: Sqoop
Issue Type: Bug
Reporter: Arvind Prabhakar
Assignee: Arvind Prabhakar
When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
Posted by "Arvind Prabhakar (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176448#comment-13176448 ]
Arvind Prabhakar commented on SQOOP-418:
----------------------------------------
This is because in recent version of MySQL 5.5.x the concept of metadata locking was introduced which causes DDL operations to timeout if the table in question has an unclosed transaction that ran a DML operation.
The implementation of DBRecordReader in Sqoop is such that if a failure occurs, it will raise the exception without closing the associated statement/connection it was working with. This condition is triggered by the MySQLAuthTest which then hangs until timeout.
> MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
> ------------------------------------------------------------------
>
> Key: SQOOP-418
> URL: https://issues.apache.org/jira/browse/SQOOP-418
> Project: Sqoop
> Issue Type: Bug
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
>
> When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
Posted by "Jarek Jarcec Cecho (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jarek Jarcec Cecho updated SQOOP-418:
-------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Patch committed, thank you very much Arvind!
Jarcec
> MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
> ------------------------------------------------------------------
>
> Key: SQOOP-418
> URL: https://issues.apache.org/jira/browse/SQOOP-418
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: 1.4.1-incubating
>
> Attachments: SQOOP-418.patch
>
>
> When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176453#comment-13176453 ]
jiraposter@reviews.apache.org commented on SQOOP-418:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3316/
-----------------------------------------------------------
Review request for Sqoop and Jarek Cecho.
Summary
-------
Added clean-up logic to the DBRecordReader so that in case of failure the appropriate statement/connection is closed gracefully.
Also added a couple of build properties which are needed to suppress Kerberos warnings when running on Mac OS. For more information see https://issues.apache.org/jira/browse/HADOOP-7489
This addresses bug SQOOP-418.
https://issues.apache.org/jira/browse/SQOOP-418
Diffs
-----
/build.xml 1222526
/src/java/org/apache/sqoop/mapreduce/db/DBRecordReader.java 1222526
Diff: https://reviews.apache.org/r/3316/diff
Testing
-------
Ran all unit and third party tests.
Thanks,
Arvind
> MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
> ------------------------------------------------------------------
>
> Key: SQOOP-418
> URL: https://issues.apache.org/jira/browse/SQOOP-418
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: 1.4.1-incubating
>
> Attachments: SQOOP-418.patch
>
>
> When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
Posted by "Arvind Prabhakar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar updated SQOOP-418:
-----------------------------------
Fix Version/s: 1.4.1-incubating
Affects Version/s: 1.4.0-incubating
Status: Patch Available (was: Open)
> MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
> ------------------------------------------------------------------
>
> Key: SQOOP-418
> URL: https://issues.apache.org/jira/browse/SQOOP-418
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: 1.4.1-incubating
>
> Attachments: SQOOP-418.patch
>
>
> When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176510#comment-13176510 ]
Hudson commented on SQOOP-418:
------------------------------
Integrated in Sqoop-ant-jdk-1.6 #72 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6/72/])
SQOOP-418. MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
(Arvind Prabhakar via Jarek Jarcec Cecho)
jarcec : http://svn.apache.org/viewvc/?view=rev&rev=1225123
Files :
* /incubator/sqoop/trunk/build.xml
* /incubator/sqoop/trunk/src/java/org/apache/sqoop/mapreduce/db/DBRecordReader.java
> MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
> ------------------------------------------------------------------
>
> Key: SQOOP-418
> URL: https://issues.apache.org/jira/browse/SQOOP-418
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: 1.4.1-incubating
>
> Attachments: SQOOP-418.patch
>
>
> When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
Posted by "jiraposter@reviews.apache.org (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13176495#comment-13176495 ]
jiraposter@reviews.apache.org commented on SQOOP-418:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3316/#review4132
-----------------------------------------------------------
Ship it!
Hi Arvind,
changes looks good, thank you very much for finding and fixing that bug! I've noticed that you've already attached the patch to corresponding JIRA, so I'll commit it shortly.
Jarcec
- Jarek
On 2011-12-28 05:13:32, Arvind Prabhakar wrote:
bq.
bq. -----------------------------------------------------------
bq. This is an automatically generated e-mail. To reply, visit:
bq. https://reviews.apache.org/r/3316/
bq. -----------------------------------------------------------
bq.
bq. (Updated 2011-12-28 05:13:32)
bq.
bq.
bq. Review request for Sqoop and Jarek Cecho.
bq.
bq.
bq. Summary
bq. -------
bq.
bq. Added clean-up logic to the DBRecordReader so that in case of failure the appropriate statement/connection is closed gracefully.
bq.
bq. Also added a couple of build properties which are needed to suppress Kerberos warnings when running on Mac OS. For more information see https://issues.apache.org/jira/browse/HADOOP-7489
bq.
bq.
bq. This addresses bug SQOOP-418.
bq. https://issues.apache.org/jira/browse/SQOOP-418
bq.
bq.
bq. Diffs
bq. -----
bq.
bq. /build.xml 1222526
bq. /src/java/org/apache/sqoop/mapreduce/db/DBRecordReader.java 1222526
bq.
bq. Diff: https://reviews.apache.org/r/3316/diff
bq.
bq.
bq. Testing
bq. -------
bq.
bq. Ran all unit and third party tests.
bq.
bq.
bq. Thanks,
bq.
bq. Arvind
bq.
bq.
> MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
> ------------------------------------------------------------------
>
> Key: SQOOP-418
> URL: https://issues.apache.org/jira/browse/SQOOP-418
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: 1.4.1-incubating
>
> Attachments: SQOOP-418.patch
>
>
> When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (SQOOP-418) MySQLAuthTest hangs when run against
MySQL 5.5.3 or higher version
Posted by "Arvind Prabhakar (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SQOOP-418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arvind Prabhakar updated SQOOP-418:
-----------------------------------
Attachment: SQOOP-418.patch
> MySQLAuthTest hangs when run against MySQL 5.5.3 or higher version
> ------------------------------------------------------------------
>
> Key: SQOOP-418
> URL: https://issues.apache.org/jira/browse/SQOOP-418
> Project: Sqoop
> Issue Type: Bug
> Affects Versions: 1.4.0-incubating
> Reporter: Arvind Prabhakar
> Assignee: Arvind Prabhakar
> Fix For: 1.4.1-incubating
>
> Attachments: SQOOP-418.patch
>
>
> When running MySQLAuthTest against MySQL version 5.5.3 or higher, the test will hang and eventually fail due to timeout.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira