You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "Kristopher Blair (JIRA)" <ji...@apache.org> on 2012/06/19 18:29:42 UTC

[jira] [Created] (ACCUMULO-648) init process hangs after entering instance name

Kristopher Blair created ACCUMULO-648:
-----------------------------------------

             Summary: init process hangs after entering instance name
                 Key: ACCUMULO-648
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
             Project: Accumulo
          Issue Type: Bug
          Components: scripts
         Environment: Running Ubuntu 12.04
Running Hadoop 0.20.2
Running Zookeeper 3.4.3
Running Accumulo 1.3.4
            Reporter: Kristopher Blair
            Assignee: John Vines
            Priority: Blocker


I start zookeeper with zoo-start.sh

I can get to the zookeeper command line with zkCli.sh

However, I run accumulo.sh init and then enter an instance name of kgbCloudbase

the init then hangs indefinitely.

I've went into the conf folder and granted 

permission java.security.AllPermission;


Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "Kristopher Blair (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400001#comment-13400001 ] 

Kristopher Blair commented on ACCUMULO-648:
-------------------------------------------

We have resolved the issue.

It seems that cloudbase 1.3.4 is not compatible with Zookeeper 3.4.3

I swapped in Zookeeper 3.3.3 and it was able to init successfully. 

The jstack basically showed the Main class trying to connect to Zookeeper. The issue itself is identical to the issue of Zookeeper not being up and running at time of init. The incompatibilty is within the connection to Zookeeper 3.4.3. 

Once again, it connects fine to Zookeeper 3.3.3


                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "Kristopher Blair (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397781#comment-13397781 ] 

Kristopher Blair commented on ACCUMULO-648:
-------------------------------------------

I switched to Accumulo 1.4.0 and everything runs fine.

I would still like to know why cloudbase 1.3.4 hangs on setting the instance name, though. The group I work for deals with cloudbase not accumulo, so it would still be very beneficial to get it working.
                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "Kristopher Blair (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397820#comment-13397820 ] 

Kristopher Blair commented on ACCUMULO-648:
-------------------------------------------

cloudbase-env.sh

All the file names are the same, just substitute "cloudbase" for "accumulo" were applicable.
                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "Kristopher Blair (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397599#comment-13397599 ] 

Kristopher Blair commented on ACCUMULO-648:
-------------------------------------------

I actually resovled my Hadoop errors.

It was because of problems with IPv6 addressing. I disabled IPv6 and Hadoop is running good.


However, my Accumulo/Cloudbase still hangs after I enter the instance name.

So, I'm kinda back to my original problem.
                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "John Vines (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396964#comment-13396964 ] 

John Vines commented on ACCUMULO-648:
-------------------------------------

Is hadoop running? I would double check both by making sure your namenode and datanode processes are running, as well as trying to do some hadoop fs command to make sure you can talk to it.
Did you mean Cloudbase 1.3.4 or Accumulo 1.3.5?
Did you set HADOOP_HOME and ZOOKEEPER_HOME in your accumulo-env.sh? If so, do 'accumulo classpath' and make sure the hadoop jars, zookeeper jars, and hadoop conf dir are listed.

                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "John Vines (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399525#comment-13399525 ] 

John Vines commented on ACCUMULO-648:
-------------------------------------

So when you were trying to init, and it hung, did a stack trace pop up when you ctrl+C'ed it? If not, next time can you jstack the process and share please? Thanks
                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (ACCUMULO-648) Test/Fix compatability with Zookeeper-3.4.x

Posted by "John Vines (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Vines resolved ACCUMULO-648.
---------------------------------

       Resolution: Cannot Reproduce
    Fix Version/s:     (was: 1.5.0)

Fresh pull of Accumulo-1.4.1 with Zookeeper 3.4.3 had no issues initializing and running. This may have been an issue with Accumulo-1.3.x, but it is not present in 1.4.x and the current trunk.
                
> Test/Fix compatability with Zookeeper-3.4.x
> -------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "Kristopher Blair (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397609#comment-13397609 ] 

Kristopher Blair commented on ACCUMULO-648:
-------------------------------------------

and yes when I do "accumulo classpath" the hadoop, zookeeper, and hadoop conf dirs are lists and my accumulo-env.sh enviroment variables are set properly.
                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "Eric Newton (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400044#comment-13400044 ] 

Eric Newton commented on ACCUMULO-648:
--------------------------------------

Wow, that's really surprising. We've never had an issue with zookeeper communications, across versions, ever.  I'll try zk 3.4.3 on Monday and let you know how I make out.
                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "John Vines (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397806#comment-13397806 ] 

John Vines commented on ACCUMULO-648:
-------------------------------------

Out of curiosity, when you were using cloudbase 1.3.4, did you have accumulo-env.sh or cloudbase-env.sh?
                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (ACCUMULO-648) Test/Fix compatability with Zookeeper-3.4.x

Posted by "John Vines (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

John Vines updated ACCUMULO-648:
--------------------------------

    Fix Version/s: 1.5.0
          Summary: Test/Fix compatability with Zookeeper-3.4.x  (was: init process hangs after entering instance name)

We need to test zookeeper-3.4, at least for 1.5, possibly for 1.4.2?
                
> Test/Fix compatability with Zookeeper-3.4.x
> -------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>             Fix For: 1.5.0
>
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (ACCUMULO-648) init process hangs after entering instance name

Posted by "Kristopher Blair (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/ACCUMULO-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397574#comment-13397574 ] 

Kristopher Blair commented on ACCUMULO-648:
-------------------------------------------

My NameNode and JobTracker don't startup, then my DataNode fails due to not being able to connect to the NameNode.

It is Cloudbase 1.3.4, but my understanding is that they are the same project.

My variables are set. I think the problems with my Hadoop are the root cause of my Cloudbase/Accumulo problems.

Would you know anything about Hadoop errors ?

The logs say the same exception for both the NameNode and JobTracker:

FATAL org.apache.hadoop.mapred.JobTracker: java.net.BindException: Address already in use

and 

ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.net.BindException: Address already in use

I've changed my configured port around repeatedly, I've killed all java processes, I've tried starting the dameons up individually, I've tried whatever is on the port just before attempting to start it up...... nothing seems to work. I was using Hadoop 0.20.2, but I deleted that and installed Hadoop 0.20.203.0.

I know this isn't the right forum for Hadoop, but if you have any suggestions it would be appreciated.


                
> init process hangs after entering instance name
> -----------------------------------------------
>
>                 Key: ACCUMULO-648
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-648
>             Project: Accumulo
>          Issue Type: Bug
>          Components: scripts
>         Environment: Running Ubuntu 12.04
> Running Hadoop 0.20.2
> Running Zookeeper 3.4.3
> Running Accumulo 1.3.4
>            Reporter: Kristopher Blair
>            Assignee: John Vines
>            Priority: Blocker
>              Labels: accumulo, hangs, init
>
> I start zookeeper with zoo-start.sh
> I can get to the zookeeper command line with zkCli.sh
> However, I run accumulo.sh init and then enter an instance name of kgbCloudbase
> the init then hangs indefinitely.
> I've went into the conf folder and granted 
> permission java.security.AllPermission;
> Can anybody help debug why this is hanging ?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira