You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bookkeeper.apache.org by "Flavio Junqueira (Created) (JIRA)" <ji...@apache.org> on 2012/01/29 11:42:10 UTC

[jira] [Created] (BOOKKEEPER-156) BookieJournalRollingTest failing

BookieJournalRollingTest failing 
---------------------------------

                 Key: BOOKKEEPER-156
                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
             Project: Bookkeeper
          Issue Type: Bug
    Affects Versions: 4.0.0
            Reporter: Flavio Junqueira
             Fix For: 4.1.0


The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BOOKKEEPER-156) BookieJournalRollingTest failing

Posted by "Flavio Junqueira (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197910#comment-13197910 ] 

Flavio Junqueira commented on BOOKKEEPER-156:
---------------------------------------------

I'm not sure if this a problem anymore. I ran it in a computer with little memory and apparently it caused the same problem in other tests as well. After killing some apps and getting memory back, I can't reproduce the problem. But, if we should be using #startNewBookie instead, then I suggest we make the change. What do you think?
                
> BookieJournalRollingTest failing 
> ---------------------------------
>
>                 Key: BOOKKEEPER-156
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
>             Project: Bookkeeper
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Flavio Junqueira
>             Fix For: 4.1.0
>
>         Attachments: org.apache.bookkeeper.test.BookieJournalRollingTest-output.txt
>
>
> The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BOOKKEEPER-156) BookieJournalRollingTest failing

Posted by "Sijie Guo (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197875#comment-13197875 ] 

Sijie Guo commented on BOOKKEEPER-156:
--------------------------------------

hmm, it seems that 3 bookie are up but bkc can't read enough bookies.

in BaseTestCase#startNewBookie, it waits until the bookie znode is available. but it didn't in BaseTestCase#restartBookies.

<code>
    protected void startNewBookie(int port)
            throws IOException, InterruptedException, KeeperException {
        File f = File.createTempFile("bookie", "test");
        tmpDirs.add(f);
        f.delete();
        f.mkdir();

        ServerConfiguration conf = newServerConfiguration(port, HOSTPORT, f, new File[] { f }); 

        BookieServer server = new BookieServer(conf);
        server.start();
        bs.add(server);

        while(bkc.getZkHandle().exists("/ledgers/available/" + InetAddress.getLocalHost().getHostAddress() + ":" + port,    false) == null) {
            Thread.sleep(500);
        }   

        bkc.readBookiesBlocking();
        LOG.info("New bookie on port " + port + " has been created.");
    } 
</code>

change #restartBookies to use #startNewBookie may resolve this issue.
                
> BookieJournalRollingTest failing 
> ---------------------------------
>
>                 Key: BOOKKEEPER-156
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
>             Project: Bookkeeper
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Flavio Junqueira
>             Fix For: 4.1.0
>
>         Attachments: org.apache.bookkeeper.test.BookieJournalRollingTest-output.txt
>
>
> The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (BOOKKEEPER-156) BookieJournalRollingTest failing

Posted by "Flavio Junqueira (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/BOOKKEEPER-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Flavio Junqueira updated BOOKKEEPER-156:
----------------------------------------

    Attachment: org.apache.bookkeeper.test.BookieJournalRollingTest-output.txt

Adding log output for a run that failed.
                
> BookieJournalRollingTest failing 
> ---------------------------------
>
>                 Key: BOOKKEEPER-156
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
>             Project: Bookkeeper
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Flavio Junqueira
>             Fix For: 4.1.0
>
>         Attachments: org.apache.bookkeeper.test.BookieJournalRollingTest-output.txt
>
>
> The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Issue Comment Edited] (BOOKKEEPER-156) BookieJournalRollingTest failing

Posted by "Sijie Guo (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13197875#comment-13197875 ] 

Sijie Guo edited comment on BOOKKEEPER-156 at 2/1/12 2:42 PM:
--------------------------------------------------------------

hmm, it seems that 3 bookie are up but bkc can't read enough bookies.

in BaseTestCase#startNewBookie, it waits until the bookie znode is available. but it didn't in BaseTestCase#restartBookies.

{code}
    protected void startNewBookie(int port)
            throws IOException, InterruptedException, KeeperException {
        File f = File.createTempFile("bookie", "test");
        tmpDirs.add(f);
        f.delete();
        f.mkdir();

        ServerConfiguration conf = newServerConfiguration(port, HOSTPORT, f, new File[] { f }); 

        BookieServer server = new BookieServer(conf);
        server.start();
        bs.add(server);

        while(bkc.getZkHandle().exists("/ledgers/available/" + InetAddress.getLocalHost().getHostAddress() + ":" + port,    false) == null) {
            Thread.sleep(500);
        }   

        bkc.readBookiesBlocking();
        LOG.info("New bookie on port " + port + " has been created.");
    } 
{code}

change #restartBookies to use #startNewBookie may resolve this issue.
                
      was (Author: hustlmsp):
    hmm, it seems that 3 bookie are up but bkc can't read enough bookies.

in BaseTestCase#startNewBookie, it waits until the bookie znode is available. but it didn't in BaseTestCase#restartBookies.

<code>
    protected void startNewBookie(int port)
            throws IOException, InterruptedException, KeeperException {
        File f = File.createTempFile("bookie", "test");
        tmpDirs.add(f);
        f.delete();
        f.mkdir();

        ServerConfiguration conf = newServerConfiguration(port, HOSTPORT, f, new File[] { f }); 

        BookieServer server = new BookieServer(conf);
        server.start();
        bs.add(server);

        while(bkc.getZkHandle().exists("/ledgers/available/" + InetAddress.getLocalHost().getHostAddress() + ":" + port,    false) == null) {
            Thread.sleep(500);
        }   

        bkc.readBookiesBlocking();
        LOG.info("New bookie on port " + port + " has been created.");
    } 
</code>

change #restartBookies to use #startNewBookie may resolve this issue.
                  
> BookieJournalRollingTest failing 
> ---------------------------------
>
>                 Key: BOOKKEEPER-156
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
>             Project: Bookkeeper
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Flavio Junqueira
>             Fix For: 4.1.0
>
>         Attachments: org.apache.bookkeeper.test.BookieJournalRollingTest-output.txt
>
>
> The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BOOKKEEPER-156) BookieJournalRollingTest failing

Posted by "Flavio Junqueira (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13195729#comment-13195729 ] 

Flavio Junqueira commented on BOOKKEEPER-156:
---------------------------------------------

I haven't turned on logging, so I only have the exception thrown for now:

{noformat}
-------------------------------------------------------------------------------
Test set: org.apache.bookkeeper.test.BookieJournalRollingTest
-------------------------------------------------------------------------------
Tests run: 4, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 46.702 sec <<< FAILURE!
testJournalRollingWithoutSyncup[0](org.apache.bookkeeper.test.BookieJournalRollingTest)  Time elapsed: 1.887 sec  <<< ERROR!
org.apache.bookkeeper.client.BKException$ZKException
        at org.apache.bookkeeper.client.BKException.create(BKException.java:64)
        at org.apache.bookkeeper.client.BookKeeper.createLedger(BookKeeper.java:293)
        at org.apache.bookkeeper.client.BookKeeper.createLedger(BookKeeper.java:260)
        at org.apache.bookkeeper.test.BookieJournalRollingTest.writeLedgerEntries(BookieJournalRollingTest.java:79)
        at org.apache.bookkeeper.test.BookieJournalRollingTest.testJournalRollingWithoutSyncup(BookieJournalRollingTest.java:206)
{noformat}

The creation of the ledger is failing, but this is not giving the exact error code. I'll run it again with logging on to see if we can get the error code. I suspect that it could be because the bookie servers have not started (restartBookies call) by the time we try to create the ledger in that test. 


                
> BookieJournalRollingTest failing 
> ---------------------------------
>
>                 Key: BOOKKEEPER-156
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
>             Project: Bookkeeper
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Flavio Junqueira
>             Fix For: 4.1.0
>
>
> The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (BOOKKEEPER-156) BookieJournalRollingTest failing

Posted by "Sijie Guo (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/BOOKKEEPER-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sijie Guo updated BOOKKEEPER-156:
---------------------------------

    Attachment: BK-156.diff

I agree to make the change which make the test more robust. 

Attach a patch of this change.
                
> BookieJournalRollingTest failing 
> ---------------------------------
>
>                 Key: BOOKKEEPER-156
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
>             Project: Bookkeeper
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Flavio Junqueira
>             Fix For: 4.1.0
>
>         Attachments: BK-156.diff, org.apache.bookkeeper.test.BookieJournalRollingTest-output.txt
>
>
> The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (BOOKKEEPER-156) BookieJournalRollingTest failing

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/BOOKKEEPER-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203486#comment-13203486 ] 

Hudson commented on BOOKKEEPER-156:
-----------------------------------

Integrated in bookkeeper-trunk #349 (See [https://builds.apache.org/job/bookkeeper-trunk/349/])
    BOOKKEEPER-156: BookieJournalRollingTest failing (Sijie Guo via ivank)

ivank : 
Files : 
* /zookeeper/bookkeeper/trunk/CHANGES.txt
* /zookeeper/bookkeeper/trunk/bookkeeper-server/src/test/java/org/apache/bookkeeper/test/BaseTestCase.java

                
> BookieJournalRollingTest failing 
> ---------------------------------
>
>                 Key: BOOKKEEPER-156
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-156
>             Project: Bookkeeper
>          Issue Type: Bug
>    Affects Versions: 4.0.0
>            Reporter: Flavio Junqueira
>            Assignee: Ivan Kelly
>             Fix For: 4.1.0
>
>         Attachments: BK-156.diff, org.apache.bookkeeper.test.BookieJournalRollingTest-output.txt
>
>
> The test fails for me intermittently. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira