You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2010/03/24 18:55:27 UTC
[jira] Created: (HIVE-1275) TestHBaseCliDriver hangs
TestHBaseCliDriver hangs
------------------------
Key: HIVE-1275
URL: https://issues.apache.org/jira/browse/HIVE-1275
Project: Hadoop Hive
Issue Type: Bug
Reporter: Namit Jain
Assignee: John Sichi
By the way, when I ran the test suite, TestHBaseCliDriver is hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849371#action_12849371 ]
Paul Yang commented on HIVE-1275:
---------------------------------
Output from test log:
{code}
[junit] diff -a -I file: -I /tmp/ -I invalidscheme: -I lastUpdateTime -I lastAccessTime -\
I owner -I transient_lastDdlTime -I java.lang.RuntimeException -I at org -I at sun -I at java\
-I at junit -I Caused by: -I [.][.][.] [0-9]* more /data/users/pyang/task2/trunk/VENDOR.hive\
/trunk/build/hbase-handler/test/logs/hbase-handler/hbase_joins.q.out /data/users/pyang/task2/\
trunk/VENDOR.hive/trunk/hbase-handler/src/test/results/hbase_joins.q.out
[junit] Done query: hbase_joins.q
[junit] Running org.apache.hadoop.hive.cli.TestHBaseCliDriver
[junit] Tests run: 1, Failures: 0, Errors: 1, Time elapsed: 0 sec
[junit] Test org.apache.hadoop.hive.cli.TestHBaseCliDriver FAILED (timeout)
[junit] Running org.apache.hadoop.hive.hbase.TestHBaseSerDe
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.365 sec
[junit] Running org.apache.hadoop.hive.hbase.TestLazyHBaseObject
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 0.393 sec
BUILD FAILED
/data/users/pyang/task2/trunk/VENDOR.hive/trunk/build.xml:164: The following error occurred w\
hile executing this line:
/data/users/pyang/task2/trunk/VENDOR.hive/trunk/build.xml:103: The following error occurred w\
hile executing this line:
/data/users/pyang/task2/trunk/VENDOR.hive/trunk/build-common.xml:427: Tests failed!
Total time: 351 minutes 19 seconds
{code}
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1275:
-----------------------------
Component/s: HBase Handler
Affects Version/s: 0.6.0
Fix Version/s: 0.6.0
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: Namit Jain
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> TestHBaseCliDriver hangs after running hbase_joins.q
> This can be reproduced by running
> {code}
> ant test -Dtestcase=TestHBaseCliDriver
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1275:
-----------------------------
Attachment: HIVE-1275.1.patch
This fixes the problem and re-enables the tests.
I used JUnit3's TestSetup extension for creating a fixture which spans testcases, allowing us to avoid bouncing HBase+Zookeeper in between each testcase.
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: Namit Jain
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1275.1.patch, jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> TestHBaseCliDriver hangs after running hbase_joins.q
> This can be reproduced by running
> {code}
> ant test -Dtestcase=TestHBaseCliDriver
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-1275:
-----------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed. Thanks John
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: Namit Jain
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1275.1.patch, jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> TestHBaseCliDriver hangs after running hbase_joins.q
> This can be reproduced by running
> {code}
> ant test -Dtestcase=TestHBaseCliDriver
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849381#action_12849381 ]
John Sichi commented on HIVE-1275:
----------------------------------
It's hanging on startup, after it fails to connect to the new master, and then tries to shut it down.
Can you see if you have any old Java processes lying around on the server, and if so, kill -9 them?
A few times during development, I ran into such situations where an old failed process was hanging around tying up the port.
I'll try to find a way to
(a) make it fail fast in such a case
(b) randomize the port number used
(c) provide some find/cleanup utilities for old processes; not sure if we would want to automate this
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1275:
----------------------------
Description: By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too. (was: By the way, when I ran the test suite, TestHBaseCliDriver is hangs. This happens on a clean checkout too.)
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849420#action_12849420 ]
John Sichi commented on HIVE-1275:
----------------------------------
Will do.
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849909#action_12849909 ]
Namit Jain commented on HIVE-1275:
----------------------------------
+1
will commit if the tests pass
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: Namit Jain
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1275.1.patch, jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> TestHBaseCliDriver hangs after running hbase_joins.q
> This can be reproduced by running
> {code}
> ant test -Dtestcase=TestHBaseCliDriver
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849415#action_12849415 ]
Namit Jain commented on HIVE-1275:
----------------------------------
It hanged for me again - can we disable the test while we are figuring out what to do ?
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1275:
----------------------------
Attachment: jstack2
jstack1
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849323#action_12849323 ]
John Sichi commented on HIVE-1275:
----------------------------------
Paul, can you reproduce it and attach a jstack here?
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
>
> By the way, when I ran the test suite, TestHBaseCliDriver is hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849465#action_12849465 ]
John Sichi commented on HIVE-1275:
----------------------------------
I see...it has to do with running two different HBase .q testcases in the same process, due to the shutdown/restart sequence. I'm not sure why that passed for me before (and for Namit when running the pre-commit tests); those passes must have been a timing-based fluke.
I'll see if I can arrange for a single minicluster fixture to be used across multiple testcases.
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: Namit Jain
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> TestHBaseCliDriver hangs after running hbase_joins.q
> This can be reproduced by running
> {code}
> ant test -Dtestcase=TestHBaseCliDriver
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1275:
-----------------------------
Status: Patch Available (was: Open)
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: Namit Jain
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: HIVE-1275.1.patch, jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> TestHBaseCliDriver hangs after running hbase_joins.q
> This can be reproduced by running
> {code}
> ant test -Dtestcase=TestHBaseCliDriver
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
John Sichi updated HIVE-1275:
-----------------------------
Component/s: HBase Handler
Affects Version/s: 0.6.0
Fix Version/s: 0.6.0
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Components: HBase Handler
> Affects Versions: 0.6.0
> Reporter: Namit Jain
> Assignee: John Sichi
> Fix For: 0.6.0
>
> Attachments: jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1275:
----------------------------
Component/s: (was: HBase Handler)
Description:
TestHBaseCliDriver hangs after running hbase_joins.q
This can be reproduced by running
{code}
ant test -Dtestcase=TestHBaseCliDriver
{code}
was:By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
Affects Version/s: (was: 0.6.0)
Fix Version/s: (was: 0.6.0)
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> TestHBaseCliDriver hangs after running hbase_joins.q
> This can be reproduced by running
> {code}
> ant test -Dtestcase=TestHBaseCliDriver
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849427#action_12849427 ]
Paul Yang commented on HIVE-1275:
---------------------------------
I also tried using a fresh dev server running CentOS. Fresh checkout from the open source, but I'm still getting the hanging behavior. + no other java processes. I'lll attach jstack's from this run as well.
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "John Sichi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12849440#action_12849440 ]
John Sichi commented on HIVE-1275:
----------------------------------
Created HIVE-1279 for disablement; let's keep HIVE-1275 open for permanent resolution.
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1275) TestHBaseCliDriver hangs
Posted by "Paul Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Paul Yang updated HIVE-1275:
----------------------------
Attachment: jstack.centos.2
jstack.centos.1
> TestHBaseCliDriver hangs
> ------------------------
>
> Key: HIVE-1275
> URL: https://issues.apache.org/jira/browse/HIVE-1275
> Project: Hadoop Hive
> Issue Type: Bug
> Reporter: Namit Jain
> Assignee: John Sichi
> Attachments: jstack.centos.1, jstack.centos.2, jstack1, jstack2
>
>
> By the way, when I ran the test suite, TestHBaseCliDriver hangs. This happens on a clean checkout too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.