You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Eli Collins (Created) (JIRA)" <ji...@apache.org> on 2012/03/09 05:38:08 UTC

[jira] [Created] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
-------------------------------------------------------------

                 Key: HADOOP-8157
                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
             Project: Hadoop Common
          Issue Type: Test
    Affects Versions: 0.24.0
            Reporter: Eli Collins


Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225873#comment-13225873 ] 

Todd Lipcon commented on HADOOP-8157:
-------------------------------------

This failure is super-goofy. My hunch is it's something to do with non-threadsafe use of classloaders or some other bad synchronization, but I don't have much to go on. Any ideas?
                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235109#comment-13235109 ] 

Hadoop QA commented on HADOOP-8157:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12519315/hadoop-8157.txt
  against trunk revision .

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no new tests are needed for this patch.
                        Also please list what manual steps were performed to verify this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 eclipse:eclipse.  The patch built with eclipse:eclipse.

    +1 findbugs.  The patch does not introduce any new Findbugs (version 1.3.9) warnings.

    +1 release audit.  The applied patch does not increase the total number of release audit warnings.

    +1 core tests.  The patch passed unit tests in .

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/741//testReport/
Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/741//console

This message is automatically generated.
                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235034#comment-13235034 ] 

Eli Collins commented on HADOOP-8157:
-------------------------------------

+1   Nice find, patch lgtm
                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235280#comment-13235280 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Common-0.23-Commit #713 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/713/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303633)

     Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303633
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Todd Lipcon (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon updated HADOOP-8157:
--------------------------------

    Attachment: hadoop-8157.txt

I believe the problem is this:
The cache added by HADOOP-6502 used a "null" value in the map as a negative cache entry for a class not found. However, it uses a WeakHashMap to avoid leaking references. The semantics of WeakHashMap are such that we could hit the following scenario:

- check "containsKey()" for a given key, see it was there
- GC runs and clears that key from the map
- call "get" and return null.
- Now we think it was a negative cache entry and throw ClassNotFoundException

The fix here is to stop using nulls to cache the "not found" result. Instead, we insert a special sentinel value as a negative cache entry.

Unfortunately it's diffcult to reproduce this on my box, but we've seen TestRPCCallBenchmark fail on Hudson a lot without this patch. So if we commit this, and we stop seeing the failures, we'll know we fixed the bug.
                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235019#comment-13235019 ] 

Todd Lipcon commented on HADOOP-8157:
-------------------------------------

I think I understand this bug. It's probably due to an error in HADOOP-6502. Patch and explanation en route.
                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235286#comment-13235286 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk-Commit #1923 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1923/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303634)

     Result = ABORTED
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303634
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235279#comment-13235279 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Commit #704 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/704/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303633)

     Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303633
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235557#comment-13235557 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Hdfs-0.23-Build #205 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/205/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303633)

     Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303633
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235276#comment-13235276 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Common-trunk-Commit #1914 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1914/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303634)

     Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303634
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy updated HADOOP-8157:
----------------------------------

    Fix Version/s:     (was: 0.24.0)
    
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235583#comment-13235583 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Mapreduce-trunk #1027 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1027/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303634)

     Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303634
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235551#comment-13235551 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Hdfs-trunk #992 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/992/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303634)

     Result = FAILURE
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303634
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235278#comment-13235278 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Hdfs-trunk-Commit #1988 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1988/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303634)

     Result = SUCCESS
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303634
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225830#comment-13225830 ] 

Eli Collins commented on HADOOP-8157:
-------------------------------------

Full stacktrace:

{noformat}
java.lang.RuntimeException: Deferred
	at org.apache.hadoop.test.MultithreadedTestUtil$TestContext.checkException(MultithreadedTestUtil.java:129)
	at org.apache.hadoop.test.MultithreadedTestUtil$TestContext.waitFor(MultithreadedTestUtil.java:120)
	at org.apache.hadoop.ipc.RPCCallBenchmark.run(RPCCallBenchmark.java:274)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:83)
	at org.apache.hadoop.ipc.TestRPCCallBenchmark.testBenchmarkWithWritable(TestRPCCallBenchmark.java:30)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
	at org.junit.internal.runners.statements.FailOnTimeout$1.run(FailOnTimeout.java:28)
Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String
	at org.apache.hadoop.ipc.Client.call(Client.java:1159)
	at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:225)
	at $Proxy8.echo(Unknown Source)
	at org.apache.hadoop.ipc.RPCCallBenchmark$4.doEcho(RPCCallBenchmark.java:398)
	at org.apache.hadoop.ipc.RPCCallBenchmark$2.doAnAction(RPCCallBenchmark.java:358)
	at org.apache.hadoop.test.MultithreadedTestUtil$RepeatingTestThread.doWork(MultithreadedTestUtil.java:219)
	at org.apache.hadoop.test.MultithreadedTestUtil$TestingThread.run(MultithreadedTestUtil.java:187)
{noformat}

Standard out:
{noformat}
2012-03-09 04:25:00,114 WARN  ipc.Server (Server.java:processData(1562)) - Unable to read call parameters for client 67.195.138.24on connection protocol org.apache.hadoop.ipc.TestRPC$TestProtocol for rpcKind RPC_WRITABLE
java.lang.RuntimeException: readObject can't find class java.lang.String
	at org.apache.hadoop.io.ObjectWritable.loadClass(ObjectWritable.java:372)
	at org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:223)
	at org.apache.hadoop.ipc.WritableRpcEngine$Invocation.readFields(WritableRpcEngine.java:156)
	at org.apache.hadoop.ipc.Server$Connection.processData(Server.java:1560)
	at org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1515)
	at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1369)
	at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:684)
	at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:483)
	at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:458)
Caused by: java.lang.ClassNotFoundException: Class java.lang.String not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1151)
	at org.apache.hadoop.io.ObjectWritable.loadClass(ObjectWritable.java:368)
	... 8 more
2012-03-09 04:25:00,121 ERROR test.MultithreadedTestUtil (MultithreadedTestUtil.java:threadFailed(140)) - Failed!
java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String
	at org.apache.hadoop.ipc.Client.call(Client.java:1159)
	at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:225)
	at $Proxy8.echo(Unknown Source)
	at org.apache.hadoop.ipc.RPCCallBenchmark$4.doEcho(RPCCallBenchmark.java:398)
	at org.apache.hadoop.ipc.RPCCallBenchmark$2.doAnAction(RPCCallBenchmark.java:358)
	at org.apache.hadoop.test.MultithreadedTestUtil$RepeatingTestThread.doWork(MultithreadedTestUtil.java:219)
	at org.apache.hadoop.test.MultithreadedTestUtil$TestingThread.run(MultithreadedTestUtil.java:187)
2012-03-09 04:25:00,123 INFO  ipc.Server (Server.java:stop(1909)) - Stopping server on 12345
2012-03-09 04:25:00,124 WARN  ipc.Server (Server.java:processResponse(953)) - IPC Server Responder, call 
{noformat}

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Todd Lipcon (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon updated HADOOP-8157:
--------------------------------

          Resolution: Fixed
       Fix Version/s: 0.23.2
                      0.24.0
    Target Version/s: 0.24.0, 0.23.3  (was: 0.23.3, 0.24.0)
        Hadoop Flags: Reviewed
              Status: Resolved  (was: Patch Available)

Committed to 0.23 and trunk
                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Todd Lipcon (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon updated HADOOP-8157:
--------------------------------

    Target Version/s: 0.24.0, 0.23.3
              Status: Patch Available  (was: Open)
    
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235565#comment-13235565 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Build #233 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/233/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303633)

     Result = FAILURE
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303633
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235288#comment-13235288 ] 

Hudson commented on HADOOP-8157:
--------------------------------

Integrated in Hadoop-Mapreduce-0.23-Commit #721 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/721/])
    HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon. (Revision 1303633)

     Result = ABORTED
todd : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1303633
Files : 
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java

                
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>             Fix For: 0.24.0, 0.23.2
>
>         Attachments: hadoop-8157.txt
>
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (HADOOP-8157) TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE

Posted by "Todd Lipcon (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-8157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon reassigned HADOOP-8157:
-----------------------------------

    Assignee: Todd Lipcon
    
> TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE
> -------------------------------------------------------------
>
>                 Key: HADOOP-8157
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8157
>             Project: Hadoop Common
>          Issue Type: Test
>    Affects Versions: 0.24.0
>            Reporter: Eli Collins
>            Assignee: Todd Lipcon
>
> Saw TestRPCCallBenchmark#testBenchmarkWithWritable fail with the following on jenkins:
> Caused by: java.lang.RuntimeException: IPC server unable to read call parameters: readObject can't find class java.lang.String

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira