You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@accumulo.apache.org by Steve Kruse <sk...@adaptivemethods.com> on 2014/01/15 20:39:20 UTC

accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Hello,



I'm new to accumulo and I am trying to get it up and running.  I currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone t= hrough the installation steps on the following page and I now am running in= to a problem when I try to start accumulo up.  The error I receive is the f=

ollowing:



Thread "org.apache.accumulo.server.master.state.SetGoalState" died null java.lang.reflect.InvocationTargetException

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=

od)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=

AccessorImpl.java:39)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=

ngMethodAccessorImpl.java:25)

                at java.lang.reflect.Method.invoke(Method.java:597)

                at org.apache.accumulo.start.Main$1.run(Main.java:101)

                at java.lang.Thread.run(Thread.java:619)

Caused by: java.lang.RuntimeException: Accumulo not initialized, there is n= o instance id at /accumulo/instance_id

                at org.apache.accumulo.core.client.ZooKeeperInstance.getIns=

tanceIDFromHdfs(ZooKeeperInstance.java:293)

                at org.apache.accumulo.server.client.HdfsZooInstance._getIn=

stanceID(HdfsZooInstance.java:126)

                at org.apache.accumulo.server.client.HdfsZooInstance.getIns=

tanceID(HdfsZooInstance.java:119)

                at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=

il.java:24)

                at org.apache.accumulo.server.master.state.SetGoalState.mai=

n(SetGoalState.java:46)

                ... 6 more



I have tried to run accumulo init several times but I still get the same re= sult every single time.  Any help would be much appreciated.

Thanks,

Steve

H. Stephen Kruse
Software Engineer
Adaptive Methods
5860 Trinity Parkway, Suite 200
Centreville, VA 20121
phone: (703) 968-6132
email: skruse@adaptivemethods.com


Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by John Vines <vi...@apache.org>.
Are you truncating the output message? Because there should be a message
about the root user being initialized I think...


On Wed, Jan 15, 2014 at 2:55 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> I am using 1.5.0.  I run accumulo init and it seems to correctly create
> the instance and I can see it in zookeeper.  Here is the init output, I
> have run it several times, so I tell it to delete the old instance.
>
> raduser@cvaraddemo01>./accumulo init
> log4j:WARN No appenders could be found for logger
> (org.apache.accumulo.start.classloader.AccumuloClassLoader).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
>
>
> Warning!!! Your instance secret is still set to the default, this is not
> secure. We highly recommend you change it.
>
>
> You can change the instance secret in accumulo by using:
>    bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword
> newPassword.
> You will also need to edit your secret in your configuration file by
> adding the property instance.secret to your conf/accumulo-site.xml. Without
> this accumulo will not operate correctly
> Instance name : sis
> Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
> Enter initial password for root (this may not be applicable for your
> security setup): ********
> Confirm initial password for root: ********
>
> Thanks,
> Steve
>
> -----Original Message-----
> From: Christopher [mailto:ctubbsii@apache.org]
> Sent: Wednesday, January 15, 2014 2:52 PM
> To: user@accumulo.apache.org
> Subject: Re: accumulo startup issue: Accumulo not initialized, there is no
> instance id at /accumulo/instance_id
>
> Which version of Accumulo are you using? And, does the HDFS directory
> already exist for Accumulo? If so, Accumulo expects to be able to create
> this directory itself when you init.
>
> --
> Christopher L Tubbs II
> http://gravatar.com/ctubbsii
>
>
> On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
> > Hello,
> >
> >
> >
> > I'm new to accumulo and I am trying to get it up and running.  I
> > currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and
> > running.  I have gone t= hrough the installation steps on the
> > following page and I now am running in= to a problem when I try to
> > start accumulo up.  The error I receive is the f=
> >
> > ollowing:
> >
> >
> >
> > Thread "org.apache.accumulo.server.master.state.SetGoalState" died
> > null java.lang.reflect.InvocationTargetException
> >
> >                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Meth=
> >
> > od)
> >
> >                 at
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
> >
> > AccessorImpl.java:39)
> >
> >                 at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
> >
> > ngMethodAccessorImpl.java:25)
> >
> >                 at java.lang.reflect.Method.invoke(Method.java:597)
> >
> >                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
> >
> >                 at java.lang.Thread.run(Thread.java:619)
> >
> > Caused by: java.lang.RuntimeException: Accumulo not initialized, there
> > is n= o instance id at /accumulo/instance_id
> >
> >                 at
> > org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
> >
> > tanceIDFromHdfs(ZooKeeperInstance.java:293)
> >
> >                 at
> > org.apache.accumulo.server.client.HdfsZooInstance._getIn=
> >
> > stanceID(HdfsZooInstance.java:126)
> >
> >                 at
> > org.apache.accumulo.server.client.HdfsZooInstance.getIns=
> >
> > tanceID(HdfsZooInstance.java:119)
> >
> >                 at
> > org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
> >
> > il.java:24)
> >
> >                 at
> > org.apache.accumulo.server.master.state.SetGoalState.mai=
> >
> > n(SetGoalState.java:46)
> >
> >                 ... 6 more
> >
> >
> >
> > I have tried to run accumulo init several times but I still get the
> > same re= sult every single time.  Any help would be much appreciated.
> >
> >
> >
> > Thanks,
> >
> >
> >
> > Steve
> >
> >
> >
> > H. Stephen Kruse
> >
> > Software Engineer
> >
> > Adaptive Methods
> >
> > 5860 Trinity Parkway, Suite 200
> >
> > Centreville, VA 20121
> >
> > phone: (703) 968-6132
> >
> > email: skruse@adaptivemethods.com
> >
> >
>
>
> --
> BEGIN-ANTISPAM-VOTING-LINKS
> ------------------------------------------------------
>
> Teach CanIt if this mail (ID 0aLejPGUD) is spam:
> Spam:
> https://antispam.roaringpenguin.com/canit/b.php?i=0aLejPGUD&m=eb74db996b7b&t=20140115&c=s
> Not spam:
> https://antispam.roaringpenguin.com/canit/b.php?i=0aLejPGUD&m=eb74db996b7b&t=20140115&c=n
> Forget vote:
> https://antispam.roaringpenguin.com/canit/b.php?i=0aLejPGUD&m=eb74db996b7b&t=20140115&c=f
> ------------------------------------------------------
> END-ANTISPAM-VOTING-LINKS
>
>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
I am using 1.5.0.  I run accumulo init and it seems to correctly create the instance and I can see it in zookeeper.  Here is the init output, I have run it several times, so I tell it to delete the old instance.

raduser@cvaraddemo01>./accumulo init
log4j:WARN No appenders could be found for logger (org.apache.accumulo.start.classloader.AccumuloClassLoader).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********

Thanks,
Steve

-----Original Message-----
From: Christopher [mailto:ctubbsii@apache.org] 
Sent: Wednesday, January 15, 2014 2:52 PM
To: user@accumulo.apache.org
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Which version of Accumulo are you using? And, does the HDFS directory already exist for Accumulo? If so, Accumulo expects to be able to create this directory itself when you init.

--
Christopher L Tubbs II
http://gravatar.com/ctubbsii


On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com> wrote:
> Hello,
>
>
>
> I'm new to accumulo and I am trying to get it up and running.  I 
> currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and 
> running.  I have gone t= hrough the installation steps on the 
> following page and I now am running in= to a problem when I try to 
> start accumulo up.  The error I receive is the f=
>
> ollowing:
>
>
>
> Thread "org.apache.accumulo.server.master.state.SetGoalState" died 
> null java.lang.reflect.InvocationTargetException
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
> Meth=
>
> od)
>
>                 at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
>
> AccessorImpl.java:39)
>
>                 at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
>
> ngMethodAccessorImpl.java:25)
>
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>
>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>                 at java.lang.Thread.run(Thread.java:619)
>
> Caused by: java.lang.RuntimeException: Accumulo not initialized, there 
> is n= o instance id at /accumulo/instance_id
>
>                 at 
> org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
>
> tanceIDFromHdfs(ZooKeeperInstance.java:293)
>
>                 at 
> org.apache.accumulo.server.client.HdfsZooInstance._getIn=
>
> stanceID(HdfsZooInstance.java:126)
>
>                 at 
> org.apache.accumulo.server.client.HdfsZooInstance.getIns=
>
> tanceID(HdfsZooInstance.java:119)
>
>                 at 
> org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
>
> il.java:24)
>
>                 at 
> org.apache.accumulo.server.master.state.SetGoalState.mai=
>
> n(SetGoalState.java:46)
>
>                 ... 6 more
>
>
>
> I have tried to run accumulo init several times but I still get the 
> same re= sult every single time.  Any help would be much appreciated.
>
>
>
> Thanks,
>
>
>
> Steve
>
>
>
> H. Stephen Kruse
>
> Software Engineer
>
> Adaptive Methods
>
> 5860 Trinity Parkway, Suite 200
>
> Centreville, VA 20121
>
> phone: (703) 968-6132
>
> email: skruse@adaptivemethods.com
>
>


--
BEGIN-ANTISPAM-VOTING-LINKS
------------------------------------------------------

Teach CanIt if this mail (ID 0aLejPGUD) is spam:
Spam:        https://antispam.roaringpenguin.com/canit/b.php?i=0aLejPGUD&m=eb74db996b7b&t=20140115&c=s
Not spam:    https://antispam.roaringpenguin.com/canit/b.php?i=0aLejPGUD&m=eb74db996b7b&t=20140115&c=n
Forget vote: https://antispam.roaringpenguin.com/canit/b.php?i=0aLejPGUD&m=eb74db996b7b&t=20140115&c=f
------------------------------------------------------
END-ANTISPAM-VOTING-LINKS


Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Christopher <ct...@apache.org>.
Which version of Accumulo are you using? And, does the HDFS directory
already exist for Accumulo? If so, Accumulo expects to be able to
create this directory itself when you init.

--
Christopher L Tubbs II
http://gravatar.com/ctubbsii


On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com> wrote:
> Hello,
>
>
>
> I'm new to accumulo and I am trying to get it up and running.  I currently =
> have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone t=
> hrough the installation steps on the following page and I now am running in=
> to a problem when I try to start accumulo up.  The error I receive is the f=
>
> ollowing:
>
>
>
> Thread "org.apache.accumulo.server.master.state.SetGoalState" died null
> java.lang.reflect.InvocationTargetException
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=
>
> od)
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
>
> AccessorImpl.java:39)
>
>                 at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
>
> ngMethodAccessorImpl.java:25)
>
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>
>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>                 at java.lang.Thread.run(Thread.java:619)
>
> Caused by: java.lang.RuntimeException: Accumulo not initialized, there is n=
> o instance id at /accumulo/instance_id
>
>                 at org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
>
> tanceIDFromHdfs(ZooKeeperInstance.java:293)
>
>                 at org.apache.accumulo.server.client.HdfsZooInstance._getIn=
>
> stanceID(HdfsZooInstance.java:126)
>
>                 at org.apache.accumulo.server.client.HdfsZooInstance.getIns=
>
> tanceID(HdfsZooInstance.java:119)
>
>                 at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
>
> il.java:24)
>
>                 at org.apache.accumulo.server.master.state.SetGoalState.mai=
>
> n(SetGoalState.java:46)
>
>                 ... 6 more
>
>
>
> I have tried to run accumulo init several times but I still get the same re=
> sult every single time.  Any help would be much appreciated.
>
>
>
> Thanks,
>
>
>
> Steve
>
>
>
> H. Stephen Kruse
>
> Software Engineer
>
> Adaptive Methods
>
> 5860 Trinity Parkway, Suite 200
>
> Centreville, VA 20121
>
> phone: (703) 968-6132
>
> email: skruse@adaptivemethods.com
>
>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Arshak Navruzyan <ar...@gmail.com>.
Steve,

try this to get your datanode(s) going

hadoop-daemon.sh start datanode

I am curious did you install your Hadoop from rpm?

Also this Sqrrl writeup might be helpful:
http://sqrrl.com/quick-accumulo-install/

Arshak


On Wed, Jan 15, 2014 at 1:42 PM, Sean Busbey <bu...@cloudera.com>wrote:

> On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:
>
>> Sean,
>>
>>
>>
>> The classpath for HDFS was incorrect and that definitely helped when I
>> corrected it.  Now it seems I’m having a hadoop issue where the datanodes
>> are not running.  I’m going to keep plugging away.
>>
>>
>>
>>
>>
> Glad to hear you made progress. Generally, I recommend people run through
> teragen / terasort to validate their HDFS and MR set up before the move on
> to installing Accumulo.
>
> Let us know when you get back to trying to get Accumulo going.
>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Arshak Navruzyan <ar...@gmail.com>.
Steve,

You can force it to reinitialize if you run this first

hadoop fs -rmr /accumulo

This will delete all your data but it doesn't sound like that is a concern
at this point.  You can also do similar cleanup inside Zookeeper.

Arshak


On Thu, Jan 16, 2014 at 10:41 AM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Straightened out HDFS, now having problem getting accumulo to start.  Get
> the following exception in my tracer log repeatedly.
>
>
>
> 2014-01-16 13:06:49,131 [impl.ServerClient] DEBUG: ClientService request
> failed null, retrying ...
>
> org.apache.thrift.transport.TTransportException: Failed to connect to a
> server
>
>         at
> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:437)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:152)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
>
>         at
> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
>
>         at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
>
>         at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
>
>         at
> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:185)
>
>         at
> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:260)
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>         at java.lang.reflect.Method.invoke(Method.java:597)
>
>         at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>         at java.lang.Thread.run(Thread.java:619)
>
>
>
> When I look at my processes, I have a gc and tracer app running.  I also
> can’t seem to run accumulo init again because it says that it’s already
> been initialized.
>
>
>
> Steve
>
>
>
> *From:* Sean Busbey [mailto:busbey+lists@cloudera.com]
> *Sent:* Wednesday, January 15, 2014 4:43 PM
>
> *To:* Accumulo User List
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Sean,
>
>
>
> The classpath for HDFS was incorrect and that definitely helped when I
> corrected it.  Now it seems I’m having a hadoop issue where the datanodes
> are not running.  I’m going to keep plugging away.
>
>
>
>
>
>
>
> Glad to hear you made progress. Generally, I recommend people run through
> teragen / terasort to validate their HDFS and MR set up before the move on
> to installing Accumulo.
>
>
>
> Let us know when you get back to trying to get Accumulo going.
> ------------------------------
>
>
> Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=s>
> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=n>
> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=f>
>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
I tried re-initializing by deleting from hadoop.  That seemed to work but I'm still having problems getting all of the accumulo processes up properly.  I only get some logger warnings in my tserver and master logs.

Thanks,
Steve

From: Arshak Navruzyan [mailto:arshakn@gmail.com]
Sent: Thursday, January 16, 2014 2:01 PM
To: user@accumulo.apache.org
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

There may still be an error that is causing your tserver to crash (if you don't see it in the process list).  You can check the log under the accumulo/log directory there should be a file like tserver_<hostname>.debug.log

On Thu, Jan 16, 2014 at 10:51 AM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
When I run ./start-all.sh I get the following:

raduser@cvaraddemo01>./bin/start-all.sh<mailto:raduser@cvaraddemo01%3e./bin/start-all.sh>
Starting monitor on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tablet servers .... done
2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
Starting tablet server on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting master on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting garbage collector on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tracer on localhost
WARN : Max files open on localhost is 1024, recommend 65536

As you can tell I have everything setup to work locally.  The tablet server seems to be up...

From: Mike Drob [mailto:madrob@cloudera.com<ma...@cloudera.com>]
Sent: Thursday, January 16, 2014 1:45 PM
To: user@accumulo.apache.org<ma...@accumulo.apache.org>

Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

The tracer does performance metrics logging, and stores the data internally in accumulo. It needs a tablet server running to persist everything and will complain until it finds one.
Are your tablet servers and loggers running? I would stop your tracer app until you have everything else up.

On Thu, Jan 16, 2014 at 1:41 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Straightened out HDFS, now having problem getting accumulo to start.  Get the following exception in my tracer log repeatedly.

2014-01-16 13:06:49,131 [impl.ServerClient] DEBUG: ClientService request failed null, retrying ...
org.apache.thrift.transport.TTransportException: Failed to connect to a server
        at org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:437)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:152)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
        at org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
        at org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
        at org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
        at org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
        at org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
        at org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:185)
        at org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:260)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.accumulo.start.Main$1.run(Main.java:101)
        at java.lang.Thread.run(Thread.java:619)

When I look at my processes, I have a gc and tracer app running.  I also can't seem to run accumulo init again because it says that it's already been initialized.

Steve

From: Sean Busbey [mailto:busbey+lists@cloudera.com<ma...@cloudera.com>]
Sent: Wednesday, January 15, 2014 4:43 PM

To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Sean,

The classpath for HDFS was incorrect and that definitely helped when I corrected it.  Now it seems I'm having a hadoop issue where the datanodes are not running.  I'm going to keep plugging away.



Glad to hear you made progress. Generally, I recommend people run through teragen / terasort to validate their HDFS and MR set up before the move on to installing Accumulo.

Let us know when you get back to trying to get Accumulo going.
________________________________

Spam
Not spam
Forget previous vote

________________________________

Spam<about:blank>
Not spam<about:blank>
Forget previous vote<about:blank>

________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH1deL&m=8797d00bf222&t=20140116&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH1deL&m=8797d00bf222&t=20140116&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH1deL&m=8797d00bf222&t=20140116&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Arshak Navruzyan <ar...@gmail.com>.
There may still be an error that is causing your tserver to crash (if you
don't see it in the process list).  You can check the log under the
accumulo/log directory there should be a file like
tserver_<hostname>.debug.log


On Thu, Jan 16, 2014 at 10:51 AM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> When I run ./start-all.sh I get the following:
>
>
>
> raduser@cvaraddemo01>./bin/start-all.sh
>
> Starting monitor on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting tablet servers .... done
>
> 2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
>
> 2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to
> zookeeper
>
> 2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and
> initialized, attemping to talk to HDFS
>
> 2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
>
> Starting tablet server on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting master on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting garbage collector on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting tracer on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
>
>
> As you can tell I have everything setup to work locally.  The tablet
> server seems to be up…
>
>
>
> *From:* Mike Drob [mailto:madrob@cloudera.com]
> *Sent:* Thursday, January 16, 2014 1:45 PM
> *To:* user@accumulo.apache.org
>
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> The tracer does performance metrics logging, and stores the data
> internally in accumulo. It needs a tablet server running to persist
> everything and will complain until it finds one.
>
> Are your tablet servers and loggers running? I would stop your tracer app
> until you have everything else up.
>
>
>
> On Thu, Jan 16, 2014 at 1:41 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Straightened out HDFS, now having problem getting accumulo to start.  Get
> the following exception in my tracer log repeatedly.
>
>
>
> 2014-01-16 13:06:49,131 [impl.ServerClient] DEBUG: ClientService request
> failed null, retrying ...
>
> org.apache.thrift.transport.TTransportException: Failed to connect to a
> server
>
>         at
> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:437)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:152)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
>
>         at
> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
>
>         at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
>
>         at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
>
>         at
> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:185)
>
>         at
> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:260)
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>         at java.lang.reflect.Method.invoke(Method.java:597)
>
>         at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>         at java.lang.Thread.run(Thread.java:619)
>
>
>
> When I look at my processes, I have a gc and tracer app running.  I also
> can’t seem to run accumulo init again because it says that it’s already
> been initialized.
>
>
>
> Steve
>
>
>
> *From:* Sean Busbey [mailto:busbey+lists@cloudera.com]
> *Sent:* Wednesday, January 15, 2014 4:43 PM
>
>
> *To:* Accumulo User List
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Sean,
>
>
>
> The classpath for HDFS was incorrect and that definitely helped when I
> corrected it.  Now it seems I’m having a hadoop issue where the datanodes
> are not running.  I’m going to keep plugging away.
>
>
>
>
>
>
>
> Glad to hear you made progress. Generally, I recommend people run through
> teragen / terasort to validate their HDFS and MR set up before the move on
> to installing Accumulo.
>
>
>
> Let us know when you get back to trying to get Accumulo going.
> ------------------------------
>
>
> Spam
> Not spam
> Forget previous vote
>
>
> ------------------------------
>
>
> Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeGJN2O&m=06d087add1f8&t=20140116&c=s>
> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeGJN2O&m=06d087add1f8&t=20140116&c=n>
> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeGJN2O&m=06d087add1f8&t=20140116&c=f>
>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
No problem:

Jdk – 1.6.0_21
Accumulo – 1.5.0
Hadoop – 2.2.0
Zookeeper – 3.4.5

From: Sean Busbey [mailto:busbey+lists@cloudera.com]
Sent: Friday, January 17, 2014 3:12 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Steve,

Glad to hear everything is working.  Would you mind letting me know your final versions of:

* JDK
* Accumulo
* Hadoop
* Zookeeper

So that I can make sure we have a ticket filed on better documenting the security policy file?

-Sean

On Fri, Jan 17, 2014 at 2:01 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Thanks.  I took out the policy file and all started working…

From: Ott, Charles H. [mailto:CHARLES.H.OTT@leidos.com<ma...@leidos.com>]
Sent: Friday, January 17, 2014 6:11 AM

To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

It sounds like it could be a permissions issue.

Two things to check:

Are you sure the monitor is running as the same user that you used when doing ‘accumulo init’ ?

The reason I ask is because the exception show that access was denied attempting a read/write operation.

Also it could be related to the accumulo.policy file.  If this file is not properly configured the java security policy will prevent the services from running properly.

Perhaps try renameing your accumulo.policy to something like, accumulo.policy.bak and try again.




________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLf8cWzC&m=827c419544e6&t=20140117&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLf8cWzC&m=827c419544e6&t=20140117&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLf8cWzC&m=827c419544e6&t=20140117&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
Steve,

Glad to hear everything is working.  Would you mind letting me know your
final versions of:

* JDK
* Accumulo
* Hadoop
* Zookeeper

So that I can make sure we have a ticket filed on better documenting the
security policy file?

-Sean

On Fri, Jan 17, 2014 at 2:01 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Thanks.  I took out the policy file and all started working…
>
>
>
> *From:* Ott, Charles H. [mailto:CHARLES.H.OTT@leidos.com]
> *Sent:* Friday, January 17, 2014 6:11 AM
>
> *To:* user@accumulo.apache.org
> *Subject:* RE: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> It sounds like it could be a permissions issue.
>
>
>
> Two things to check:
>
>
>
> Are you sure the monitor is running as the same user that you used when
> doing ‘accumulo init’ ?
>
>
>
> The reason I ask is because the exception show that access was denied
> attempting a read/write operation.
>
>
>
> Also it could be related to the accumulo.policy file.  If this file is not
> properly configured the java security policy will prevent the services from
> running properly.
>
>
>
> Perhaps try renameing your accumulo.policy to something like,
> accumulo.policy.bak and try again.
>
>
>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
Thanks.  I took out the policy file and all started working…

From: Ott, Charles H. [mailto:CHARLES.H.OTT@leidos.com]
Sent: Friday, January 17, 2014 6:11 AM
To: user@accumulo.apache.org
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

It sounds like it could be a permissions issue.

Two things to check:

Are you sure the monitor is running as the same user that you used when doing ‘accumulo init’ ?

The reason I ask is because the exception show that access was denied attempting a read/write operation.

Also it could be related to the accumulo.policy file.  If this file is not properly configured the java security policy will prevent the services from running properly.

Perhaps try renameing your accumulo.policy to something like, accumulo.policy.bak and try again.

From: user-return-3603-CHARLES.H.OTT=leidos.com@accumulo.apache.org<ma...@accumulo.apache.org> [mailto:user-return-3603-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Steve Kruse
Sent: Thursday, January 16, 2014 4:00 PM
To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

I’m trying to run accumulo and everything seems to start fine from the console print outs:

raduser@cvaraddemo01>./start-all.sh<mailto:raduser@cvaraddemo01%3e./start-all.sh>
Starting monitor on 172.17.9.151
Starting tablet servers .... done
Starting tablet server on 172.17.9.151
2014-01-16 15:19:28,900 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 15:19:29,484 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 15:19:29,732 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 15:19:29,840 [server.Accumulo] INFO : Connected to HDFS
Starting master on 172.17.9.151
Starting garbage collector on 172.17.9.151
Starting tracer on 172.17.9.151
raduser@cvaraddemo01>ls -la ../logs/


I look at my processes running and only see gc and tracer running.  I look a the logs and found the following exception in the monitor log:

Thread "monitor" died null
java.lang.reflect.InvocationTargetException
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                at java.lang.reflect.Method.invoke(Method.java:597)
                at org.apache.accumulo.start.Main$1.run(Main.java:101)
                at java.lang.Thread.run(Thread.java:619)
Caused by: java.security.AccessControlException: access denied (java.util.PropertyPermission * read,write)
                at java.security.AccessControlContext.checkPermission(AccessControlContext.java:323)
                at java.security.AccessController.checkPermission(AccessController.java:546)
                at java.lang.SecurityManager.checkPermission(SecurityManager.java:532)
                at java.lang.SecurityManager.checkPropertiesAccess(SecurityManager.java:1252)
                at java.lang.System.getProperties(System.java:580)
                at org.apache.commons.configuration.SystemConfiguration.<init>(SystemConfiguration.java:38)
                at org.apache.accumulo.core.conf.Property.getDefaultValue(Property.java:384)
                at org.apache.accumulo.core.conf.DefaultConfiguration.iterator(DefaultConfiguration.java:52)
                at org.apache.accumulo.core.conf.ConfigSanityCheck.validate(ConfigSanityCheck.java:29)
                at org.apache.accumulo.core.conf.DefaultConfiguration.getInstance(DefaultConfiguration.java:37)
                at org.apache.accumulo.core.conf.AccumuloConfiguration.getDefaultConfiguration(AccumuloConfiguration.java:153)
                at org.apache.accumulo.core.conf.AccumuloConfiguration.getSiteConfiguration(AccumuloConfiguration.java:163)
                at org.apache.accumulo.core.security.SecurityUtil.serverLogin(SecurityUtil.java:39)
                at org.apache.accumulo.server.monitor.Monitor.main(Monitor.java:451)
                ... 6 more

I’ve run through the steps I have taken and I believe I have done everything properly.  Any help is much appreciated.

Thanks

From: Steve Kruse [mailto:skruse@adaptivemethods.com]
Sent: Thursday, January 16, 2014 2:08 PM
To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Sean,

Could that be causing the problems I’m having?  I’ll give it a try…

Thanks

From: Sean Busbey [mailto:busbey+lists@cloudera.com]
Sent: Thursday, January 16, 2014 2:04 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

On Thu, Jan 16, 2014 at 12:51 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
When I run ./start-all.sh I get the following:

raduser@cvaraddemo01>./bin/start-all.sh<mailto:raduser@cvaraddemo01%3e./bin/start-all.sh>
Starting monitor on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tablet servers .... done
2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
Starting tablet server on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting master on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting garbage collector on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tracer on localhost
WARN : Max files open on localhost is 1024, recommend 65536



Hey Steve,

You should make sure to correct the maximum number of open files for the user that is running Accumulo.
________________________________


________________________________




________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeXbyaS&m=95c70fda195f&t=20140117&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeXbyaS&m=95c70fda195f&t=20140117&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeXbyaS&m=95c70fda195f&t=20140117&c=f>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by "Ott, Charles H." <CH...@leidos.com>.
It sounds like it could be a permissions issue.  

 

Two things to check:

 

Are you sure the monitor is running as the same user that you used when doing ‘accumulo init’ ?

 

The reason I ask is because the exception show that access was denied attempting a read/write operation.

 

Also it could be related to the accumulo.policy file.  If this file is not properly configured the java security policy will prevent the services from running properly.

 

Perhaps try renameing your accumulo.policy to something like, accumulo.policy.bak and try again.

 

From: user-return-3603-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3603-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Steve Kruse
Sent: Thursday, January 16, 2014 4:00 PM
To: user@accumulo.apache.org
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

 

I’m trying to run accumulo and everything seems to start fine from the console print outs:

 

raduser@cvaraddemo01>./start-all.sh <mailto:raduser@cvaraddemo01%3e./start-all.sh>  

Starting monitor on 172.17.9.151

Starting tablet servers .... done

Starting tablet server on 172.17.9.151

2014-01-16 15:19:28,900 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2014-01-16 15:19:29,484 [server.Accumulo] INFO : Attempting to talk to zookeeper

2014-01-16 15:19:29,732 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS

2014-01-16 15:19:29,840 [server.Accumulo] INFO : Connected to HDFS

Starting master on 172.17.9.151

Starting garbage collector on 172.17.9.151

Starting tracer on 172.17.9.151

raduser@cvaraddemo01>ls -la ../logs/

 

 

I look at my processes running and only see gc and tracer running.  I look a the logs and found the following exception in the monitor log:

 

Thread "monitor" died null

java.lang.reflect.InvocationTargetException

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

                at java.lang.reflect.Method.invoke(Method.java:597)

                at org.apache.accumulo.start.Main$1.run(Main.java:101)

                at java.lang.Thread.run(Thread.java:619)

Caused by: java.security.AccessControlException: access denied (java.util.PropertyPermission * read,write)

                at java.security.AccessControlContext.checkPermission(AccessControlContext.java:323)

                at java.security.AccessController.checkPermission(AccessController.java:546)

                at java.lang.SecurityManager.checkPermission(SecurityManager.java:532)

                at java.lang.SecurityManager.checkPropertiesAccess(SecurityManager.java:1252)

                at java.lang.System.getProperties(System.java:580)

                at org.apache.commons.configuration.SystemConfiguration.<init>(SystemConfiguration.java:38)

                at org.apache.accumulo.core.conf.Property.getDefaultValue(Property.java:384)

                at org.apache.accumulo.core.conf.DefaultConfiguration.iterator(DefaultConfiguration.java:52)

                at org.apache.accumulo.core.conf.ConfigSanityCheck.validate(ConfigSanityCheck.java:29)

                at org.apache.accumulo.core.conf.DefaultConfiguration.getInstance(DefaultConfiguration.java:37)

                at org.apache.accumulo.core.conf.AccumuloConfiguration.getDefaultConfiguration(AccumuloConfiguration.java:153)

                at org.apache.accumulo.core.conf.AccumuloConfiguration.getSiteConfiguration(AccumuloConfiguration.java:163)

                at org.apache.accumulo.core.security.SecurityUtil.serverLogin(SecurityUtil.java:39)

                at org.apache.accumulo.server.monitor.Monitor.main(Monitor.java:451)

                ... 6 more

 

I’ve run through the steps I have taken and I believe I have done everything properly.  Any help is much appreciated.

 

Thanks

 

From: Steve Kruse [mailto:skruse@adaptivemethods.com] 
Sent: Thursday, January 16, 2014 2:08 PM
To: user@accumulo.apache.org
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

 

Sean,

 

Could that be causing the problems I’m having?  I’ll give it a try…

 

Thanks

 

From: Sean Busbey [mailto:busbey+lists@cloudera.com] 
Sent: Thursday, January 16, 2014 2:04 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

 

On Thu, Jan 16, 2014 at 12:51 PM, Steve Kruse <sk...@adaptivemethods.com> wrote:

When I run ./start-all.sh I get the following:

 

raduser@cvaraddemo01>./bin/start-all.sh <mailto:raduser@cvaraddemo01%3e./bin/start-all.sh>  

Starting monitor on localhost

WARN : Max files open on localhost is 1024, recommend 65536

Starting tablet servers .... done

2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to zookeeper

2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS

2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS

Starting tablet server on localhost

WARN : Max files open on localhost is 1024, recommend 65536

Starting master on localhost

WARN : Max files open on localhost is 1024, recommend 65536

Starting garbage collector on localhost

WARN : Max files open on localhost is 1024, recommend 65536

Starting tracer on localhost

WARN : Max files open on localhost is 1024, recommend 65536

 

 

 

Hey Steve,

 

You should make sure to correct the maximum number of open files for the user that is running Accumulo. 

________________________________






________________________________


Spam <https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH8iw3&m=97f8ce7bf58d&t=20140116&c=s> 
Not spam <https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH8iw3&m=97f8ce7bf58d&t=20140116&c=n> 
Forget previous vote <https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH8iw3&m=97f8ce7bf58d&t=20140116&c=f> 


RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
I’m trying to run accumulo and everything seems to start fine from the console print outs:

raduser@cvaraddemo01>./start-all.sh
Starting monitor on 172.17.9.151
Starting tablet servers .... done
Starting tablet server on 172.17.9.151
2014-01-16 15:19:28,900 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 15:19:29,484 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 15:19:29,732 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 15:19:29,840 [server.Accumulo] INFO : Connected to HDFS
Starting master on 172.17.9.151
Starting garbage collector on 172.17.9.151
Starting tracer on 172.17.9.151
raduser@cvaraddemo01>ls -la ../logs/


I look at my processes running and only see gc and tracer running.  I look a the logs and found the following exception in the monitor log:

Thread "monitor" died null
java.lang.reflect.InvocationTargetException
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                at java.lang.reflect.Method.invoke(Method.java:597)
                at org.apache.accumulo.start.Main$1.run(Main.java:101)
                at java.lang.Thread.run(Thread.java:619)
Caused by: java.security.AccessControlException: access denied (java.util.PropertyPermission * read,write)
                at java.security.AccessControlContext.checkPermission(AccessControlContext.java:323)
                at java.security.AccessController.checkPermission(AccessController.java:546)
                at java.lang.SecurityManager.checkPermission(SecurityManager.java:532)
                at java.lang.SecurityManager.checkPropertiesAccess(SecurityManager.java:1252)
                at java.lang.System.getProperties(System.java:580)
                at org.apache.commons.configuration.SystemConfiguration.<init>(SystemConfiguration.java:38)
                at org.apache.accumulo.core.conf.Property.getDefaultValue(Property.java:384)
                at org.apache.accumulo.core.conf.DefaultConfiguration.iterator(DefaultConfiguration.java:52)
                at org.apache.accumulo.core.conf.ConfigSanityCheck.validate(ConfigSanityCheck.java:29)
                at org.apache.accumulo.core.conf.DefaultConfiguration.getInstance(DefaultConfiguration.java:37)
                at org.apache.accumulo.core.conf.AccumuloConfiguration.getDefaultConfiguration(AccumuloConfiguration.java:153)
                at org.apache.accumulo.core.conf.AccumuloConfiguration.getSiteConfiguration(AccumuloConfiguration.java:163)
                at org.apache.accumulo.core.security.SecurityUtil.serverLogin(SecurityUtil.java:39)
                at org.apache.accumulo.server.monitor.Monitor.main(Monitor.java:451)
                ... 6 more

I’ve run through the steps I have taken and I believe I have done everything properly.  Any help is much appreciated.

Thanks

From: Steve Kruse [mailto:skruse@adaptivemethods.com]
Sent: Thursday, January 16, 2014 2:08 PM
To: user@accumulo.apache.org
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Sean,

Could that be causing the problems I’m having?  I’ll give it a try…

Thanks

From: Sean Busbey [mailto:busbey+lists@cloudera.com]
Sent: Thursday, January 16, 2014 2:04 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

On Thu, Jan 16, 2014 at 12:51 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
When I run ./start-all.sh I get the following:

raduser@cvaraddemo01>./bin/start-all.sh<mailto:raduser@cvaraddemo01%3e./bin/start-all.sh>
Starting monitor on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tablet servers .... done
2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
Starting tablet server on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting master on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting garbage collector on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tracer on localhost
WARN : Max files open on localhost is 1024, recommend 65536



Hey Steve,

You should make sure to correct the maximum number of open files for the user that is running Accumulo.
________________________________




________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH8iw3&m=97f8ce7bf58d&t=20140116&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH8iw3&m=97f8ce7bf58d&t=20140116&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH8iw3&m=97f8ce7bf58d&t=20140116&c=f>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
Sean,

Could that be causing the problems I’m having?  I’ll give it a try…

Thanks

From: Sean Busbey [mailto:busbey+lists@cloudera.com]
Sent: Thursday, January 16, 2014 2:04 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

On Thu, Jan 16, 2014 at 12:51 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
When I run ./start-all.sh I get the following:

raduser@cvaraddemo01>./bin/start-all.sh<mailto:raduser@cvaraddemo01%3e./bin/start-all.sh>
Starting monitor on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tablet servers .... done
2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
Starting tablet server on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting master on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting garbage collector on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tracer on localhost
WARN : Max files open on localhost is 1024, recommend 65536



Hey Steve,

You should make sure to correct the maximum number of open files for the user that is running Accumulo.
________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH4WV2&m=9880fc244ee4&t=20140116&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH4WV2&m=9880fc244ee4&t=20140116&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeH4WV2&m=9880fc244ee4&t=20140116&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
On Fri, Jan 17, 2014 at 8:31 AM, Ott, Charles H. <CH...@leidos.com>
 wrote:

> Hey Sean,
>
> It looks like nobody has given any updates on the installation procedures…
> Must be too close to the weekend ;)
>
>
>
> If you could send me an example of what some of your existing
> documentation looks like, I would be able to better create the installation
> procedures in a format that compliments the existing Cloudera docs.
>
>
>
> Thanks,
>
> Charles
>
>
Hi Charles!

Currently, I htink the only examples are the README[1] and the installation
section of the user manual[2].

Neither of these are really great examples (the README has already been
flagged as trying to do too much[3]). Perhaps you could pull some of the
getting started stuff out of the README for this. Unfortunately, I don't
think there's been much progress on deciding how we want our documentation
organized[4].

I think the best idea is probably going to be for you to make something
like a quickstart.md (using Apache CMS markdown[5]). That could go in the
codebase under docs/ and we could publish it on the website.

It's important to note that we'd want instructions that don't favor a
particular vendor. Ideally, we'd want the instructions to cover getting
things set up on top of a stack of just Apache releases.

I filed ACCUMULO-2214 so we can track this off the mailing list[6]. Let me
know once you get started and I'll assign the ticket to you.

-Sean

[1]: http://bit.ly/1dst5dP
[2]: http://accumulo.apache.org/1.5/accumulo_user_manual.html#_installation
[3]: https://issues.apache.org/jira/browse/ACCUMULO-1515
[4]: https://issues.apache.org/jira/browse/ACCUMULO-1490
[5]: http://www.apache.org/dev/cmsref.html#markdown
[6]: https://issues.apache.org/jira/browse/ACCUMULO-2214

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by "Ott, Charles H." <CH...@leidos.com>.
Sure! I’d like to let this sit on the mailing list for a day or so and get some feedback.  Then I could polish it up for documentation purposes.  

 

Email me directl, any kind of template, format, or additional thoughts you have in mind so I don’t get too far off base. 

 

 

 

From: user-return-3600-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3600-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Sean Busbey
Sent: Thursday, January 16, 2014 3:00 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

 

Thanks for the overview Charles!  Any chance I can convince you to polish this up a little and add it to our user documentation as a quickstart guide?

 

(Notes inline below)

 

On Thu, Jan 16, 2014 at 1:50 PM, Ott, Charles H. <CH...@leidos.com> wrote:

Disclaimer, 

 

Not advocating this is the best approach, just what I’m currently doing, put this together pretty quick, but it should be mostly complete for settting up accumulo on cdh hdfs/zk

 

 <snip>

 

echo "Increasing Swapiness Factor to limit use of swap space."

echo "# swappiness for accumulo" >> /etc/sysctl.conf

echo "vm.swappiness = 10" >> /etc/sysctl.conf

 

 

You should set vm.swappiness to 0. Both Hadoop and Accumulo recommend this.

 

 

	 

	<snip>

	#accumulo-site.xml

	<property>

	    <name>general.classpaths</name>

	    <value>

	      $ACCUMULO_HOME/server/target/classes/,

	      $ACCUMULO_HOME/lib/accumulo-server.jar,

	      $ACCUMULO_HOME/core/target/classes/,

	      $ACCUMULO_HOME/lib/accumulo-core.jar,

	      $ACCUMULO_HOME/start/target/classes/,

	      $ACCUMULO_HOME/lib/accumulo-start.jar,

	      $ACCUMULO_HOME/fate/target/classes/,

	      $ACCUMULO_HOME/lib/accumulo-fate.jar,

	      $ACCUMULO_HOME/proxy/target/classes/,

	      $ACCUMULO_HOME/lib/accumulo-proxy.jar,

	      $ACCUMULO_HOME/lib/[^.].*.jar,

	      $ZOOKEEPER_HOME/zookeeper[^.].*.jar,

	      $HADOOP_CONF_DIR,

	      $HADOOP_PREFIX/[^.].*.jar,

	      $HADOOP_PREFIX/lib/[^.].*.jar,

	      $HADOOP_HDFS_HOME/.*.jar,

	      $HADOOP_HDFS_HOME/lib/.*.jar,

	      $HADOOP_MAPREDUCE_HOME/.*.jar,

	      $HADOOP_MAPREDUCE_HOME/lib/.*.jar

	    </value>

	    <description>Classpaths that accumulo checks for updates and class files.

	      When using the Security Manager, please remove the ".../target/classes/" values.

	    </description>

	  </property>

	 

 

This will give you some warnings about multiple slf4j binaries on CDH4.4.0+ . You can fix it by making sure you only match jars with a version number.

 

See an example[1].

 

 

	then of course, always run your Accumulo binaries/scripts using the HDFS account.  I’m sure I’m missing a few steps here and there… 

	 

 

You should avoid running Accumulo as the hdfs super user, both as a matter of proper separation of concerns and as a practical need if you are going to run Accumulo in a production environment with multiple HDFS users.

 

-Sean

 

[1]: https://gist.github.com/busbey/8285352#file-accumulo-site-cdh4-xml-L99 


RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Kesten Broughton <kb...@21ct.com>.
"You should avoid running Accumulo as the hdfs super user, both as a matter of proper separation of concerns and as a practical need if you are going to run Accumulo in a production environment with multiple HDFS users."

Is there a guide on how to do this?  If i try to start accumulo shell as other-than-hdfs I always get errors.
We would like to run as tenant users.

kesten


Kesten Broughton | Software Developer | 21CT

________________________________________
From: Sean Busbey [busbey+lists@cloudera.com]
Sent: Thursday, January 16, 2014 2:00 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Thanks for the overview Charles!  Any chance I can convince you to polish this up a little and add it to our user documentation as a quickstart guide?

(Notes inline below)

On Thu, Jan 16, 2014 at 1:50 PM, Ott, Charles H. <CH...@leidos.com>> wrote:
Disclaimer,

Not advocating this is the best approach, just what I’m currently doing, put this together pretty quick, but it should be mostly complete for settting up accumulo on cdh hdfs/zk

 <snip>

echo "Increasing Swapiness Factor to limit use of swap space."
echo "# swappiness for accumulo" >> /etc/sysctl.conf
echo "vm.swappiness = 10" >> /etc/sysctl.conf


You should set vm.swappiness to 0. Both Hadoop and Accumulo recommend this.



<snip>
#accumulo-site.xml
<property>
    <name>general.classpaths</name>
    <value>
      $ACCUMULO_HOME/server/target/classes/,
      $ACCUMULO_HOME/lib/accumulo-server.jar,
      $ACCUMULO_HOME/core/target/classes/,
      $ACCUMULO_HOME/lib/accumulo-core.jar,
      $ACCUMULO_HOME/start/target/classes/,
      $ACCUMULO_HOME/lib/accumulo-start.jar,
      $ACCUMULO_HOME/fate/target/classes/,
      $ACCUMULO_HOME/lib/accumulo-fate.jar,
      $ACCUMULO_HOME/proxy/target/classes/,
      $ACCUMULO_HOME/lib/accumulo-proxy.jar,
      $ACCUMULO_HOME/lib/[^.].*.jar,
      $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
      $HADOOP_CONF_DIR,
      $HADOOP_PREFIX/[^.].*.jar,
      $HADOOP_PREFIX/lib/[^.].*.jar,
      $HADOOP_HDFS_HOME/.*.jar,
      $HADOOP_HDFS_HOME/lib/.*.jar,
      $HADOOP_MAPREDUCE_HOME/.*.jar,
      $HADOOP_MAPREDUCE_HOME/lib/.*.jar
    </value>
    <description>Classpaths that accumulo checks for updates and class files.
      When using the Security Manager, please remove the ".../target/classes/" values.
    </description>
  </property>


This will give you some warnings about multiple slf4j binaries on CDH4.4.0+ . You can fix it by making sure you only match jars with a version number.

See an example[1].


then of course, always run your Accumulo binaries/scripts using the HDFS account.  I’m sure I’m missing a few steps here and there…


You should avoid running Accumulo as the hdfs super user, both as a matter of proper separation of concerns and as a practical need if you are going to run Accumulo in a production environment with multiple HDFS users.

-Sean

[1]: https://gist.github.com/busbey/8285352#file-accumulo-site-cdh4-xml-L99

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
Thanks for the overview Charles!  Any chance I can convince you to polish
this up a little and add it to our user documentation as a quickstart guide?

(Notes inline below)

On Thu, Jan 16, 2014 at 1:50 PM, Ott, Charles H.
<CH...@leidos.com>wrote:

> Disclaimer,
>
>
>
> Not advocating this is the best approach, just what I’m currently doing,
> put this together pretty quick, but it should be mostly complete for
> settting up accumulo on cdh hdfs/zk
>
>
>
>  <snip>
>
>
>
> echo "Increasing *Swapiness* Factor to limit use of swap space."
>
> echo "# *swappiness* for *accumulo*" >> /etc/sysctl.conf
>
> echo "vm.swappiness = 10" >> /etc/sysctl.conf
>
>
>

You should set vm.swappiness to 0. Both Hadoop and Accumulo recommend this.



>
>
> <snip>
>
> #accumulo-site.xml
>
> <property>
>
>     <name>general.classpaths</name>
>
>     <value>
>
>       $ACCUMULO_HOME/server/target/classes/,
>
>       $ACCUMULO_HOME/lib/accumulo-server.jar,
>
>       $ACCUMULO_HOME/core/target/classes/,
>
>       $ACCUMULO_HOME/lib/accumulo-core.jar,
>
>       $ACCUMULO_HOME/start/target/classes/,
>
>       $ACCUMULO_HOME/lib/accumulo-start.jar,
>
>       $ACCUMULO_HOME/fate/target/classes/,
>
>       $ACCUMULO_HOME/lib/accumulo-fate.jar,
>
>       $ACCUMULO_HOME/proxy/target/classes/,
>
>       $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>
>       $ACCUMULO_HOME/lib/[^.].*.jar,
>
>       $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>
>       $HADOOP_CONF_DIR,
>
>       $HADOOP_PREFIX/[^.].*.jar,
>
>       $HADOOP_PREFIX/lib/[^.].*.jar,
>
>       $HADOOP_HDFS_HOME/.*.jar,
>
>       $HADOOP_HDFS_HOME/lib/.*.jar,
>
>       $HADOOP_MAPREDUCE_HOME/.*.jar,
>
>       $HADOOP_MAPREDUCE_HOME/lib/.*.jar
>
>     </value>
>
>     <description>Classpaths that accumulo checks for updates and class
> files.
>
>       When using the Security Manager, please remove the
> ".../target/classes/" values.
>
>     </description>
>
>   </property>
>
>
>

This will give you some warnings about multiple slf4j binaries on CDH4.4.0+
. You can fix it by making sure you only match jars with a version number.

See an example[1].



> then of course, always run your Accumulo binaries/scripts using the HDFS
> account.  I’m sure I’m missing a few steps here and there…
>
>
>

You should avoid running Accumulo as the hdfs super user, both as a matter
of proper separation of concerns and as a practical need if you are going
to run Accumulo in a production environment with multiple HDFS users.

-Sean

[1]: https://gist.github.com/busbey/8285352#file-accumulo-site-cdh4-xml-L99

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by "Ott, Charles H." <CH...@leidos.com>.
Forgot this part of accumulo-env.sh:


HADOOP_PREFIX="$HADOOP_HOME"

 

Also in the example below, I make the folder to log in /var/log/accumulo… however, in the accumulo-env.sh example I have it pointing to $accumulo_home/logs.  Just change that to wherever your logs are stored.

 

Also you’ll need to run ssh-keygen on the master before pushing the ssh keys to your nodes. (ssh-copy-id).  Also hdfs user will proabably have read-only access to the Hadoop home folder… just make a folder called HDFS_USER_HOMEFOLDER/.ssh and give r/w/x permissions to hdfs on that folder (.ssh) only.  Otherwise ssh-copy-id wont be able to update that folder.

 

In regard to optimization and write ahead logs, that stuff is usually environment/application specific.

 

If anyone has questions or comments on this installation plan let me know, I would love to know what you’re doing differently, and why.

 

 

From: user-return-3599-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3599-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Ott, Charles H.
Sent: Thursday, January 16, 2014 2:50 PM
To: user@accumulo.apache.org
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

 

Disclaimer, 

 

Not advocating this is the best approach, just what I’m currently doing, put this together pretty quick, but it should be mostly complete for settting up accumulo on cdh hdfs/zk

 

 

 

I always do something like this first on CentOS:

 

$ yum install –y ntpd openssh-clients unzip

 

#setup ssh and ntpd as needed

 

$install the jdk RPM

 

# bash this to setup OS specifics

 

echo "Disabling SELINUX for Optimal CDH Compatability..."

sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config

 

echo "Increasing uLimit, aka File Descripter/Handlers for all Users..."

echo "# Adding Support for CDH" >> /etc/security/limits.conf

echo "*              -     nofile              65536" >> /etc/security/limits.conf

 

echo "Disabling IPv6..."

echo "# Disable ipv6" >> /etc/sysctl.conf

echo "net.ipv6.conf.all.disable_ipv6 = 1" >> /etc/sysctl.conf

echo "net.ipv6.conf.default.disable_ipv6 = 1" >> /etc/sysctl.conf

 

echo "Increasing Swapiness Factor to limit use of swap space."

echo "# swappiness for accumulo" >> /etc/sysctl.conf

echo "vm.swappiness = 10" >> /etc/sysctl.conf

 

 

reboot and test OS/services/jdk version…

 

then I usually extract Accumulo to /opt/Accumulo/accumulo-1.5.0

 

Make a sym link, /opt/accumulo/Accumulo-current -> ./accumulo-1.5.0

 

#make dirs. For Accumulo logs, where ever…

mkdir /var/log/accumulo

 

#let HDFS own all your Accumulo folders

chown –R hdfs:hdfs /opt/accumulo

chown –R hdfs:hdfs /var/log/accumulo

 

#update the hdfs password for the next step

user root: passwd hdfs

 

#setup passwordless ssh (test using hdfs afterwards, should be able to ssh <node> w/o entering credentials)

su –hdfs

ssh-copy-id <for all tablet server nodes>

 

#update your iptables

 

 

#env vars
ACCUMULO_HOME=/opt/accumulo/accumulo-1.5.0

JAVA_HOME=/usr/java/default (jdk7 in my last install worked fine)

 

Settings for accumulo-env.sh in /conf:

# cdh4

export HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH/lib/hadoop-hdfs

export HADOOP_MAPREDUCE_HOME=/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce

test -z "$HADOOP_CONF_DIR"       && export HADOOP_CONF_DIR="$HADOOP_PREFIX/etc/hadoop"

test -z "$JAVA_HOME"             && export JAVA_HOME=/usr/java/default

test -z "$ZOOKEEPER_HOME"        && export ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH/lib/zookeeper

test -z "$ACCUMULO_LOG_DIR"      && export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs

 

#update all files as appropriate in /opt/Accumulo/Accumulo-current/conf/*

masters, monitor,slaves,tracers,gc,Accumulo-site.xml, Accumulo-env.sh

 

#accumulo-site.xml

<property>

    <name>general.classpaths</name>

    <value>

      $ACCUMULO_HOME/server/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-server.jar,

      $ACCUMULO_HOME/core/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-core.jar,

      $ACCUMULO_HOME/start/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-start.jar,

      $ACCUMULO_HOME/fate/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-fate.jar,

      $ACCUMULO_HOME/proxy/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-proxy.jar,

      $ACCUMULO_HOME/lib/[^.].*.jar,

      $ZOOKEEPER_HOME/zookeeper[^.].*.jar,

      $HADOOP_CONF_DIR,

      $HADOOP_PREFIX/[^.].*.jar,

      $HADOOP_PREFIX/lib/[^.].*.jar,

      $HADOOP_HDFS_HOME/.*.jar,

      $HADOOP_HDFS_HOME/lib/.*.jar,

      $HADOOP_MAPREDUCE_HOME/.*.jar,

      $HADOOP_MAPREDUCE_HOME/lib/.*.jar

    </value>

    <description>Classpaths that accumulo checks for updates and class files.

      When using the Security Manager, please remove the ".../target/classes/" values.

    </description>

  </property>

 

then of course, always run your Accumulo binaries/scripts using the HDFS account.  I’m sure I’m missing a few steps here and there… 

 

$ACCUMULO_HOME/bin/accumulo init

…

$ACCUMULO_HOME/bin/start-all.sh

 

 

 

From: user-return-3597-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3597-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Sean Busbey
Sent: Thursday, January 16, 2014 2:20 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

 

 

On Thu, Jan 16, 2014 at 1:14 PM, Kesten Broughton <kb...@21ct.com> wrote:

"You should make sure to correct the maximum number of open files for the user that is running Accumulo."

I have the following in all /etc/security/limits.conf in my accumulo cluster

hdfs soft nofile 65536
hdfs hard nofile 65536

However, i see this for all nodes.
WARN : Max files open on 10.0.11.208 is 32768, recommend 65536

Should it be a different user or something?

'the user that is running Accumulo'
sudo hdfs
hdfs$ bin/accumulo -u root

so is hdfs or root the accumulo user?

 

The user in question here is the one who starts the Accumulo server processes. In production environments this should be a user dedicated to Accumulo. FWIW, I usually name this user "accumulo".

 

How do you start up Accumulo? a service script? running $ACCUMULO_HOME/bin/start-all.sh? something else?


RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by "Ott, Charles H." <CH...@leidos.com>.
Disclaimer, 

 

Not advocating this is the best approach, just what I’m currently doing, put this together pretty quick, but it should be mostly complete for settting up accumulo on cdh hdfs/zk

 

 

 

I always do something like this first on CentOS:

 

$ yum install –y ntpd openssh-clients unzip

 

#setup ssh and ntpd as needed

 

$install the jdk RPM

 

# bash this to setup OS specifics

 

echo "Disabling SELINUX for Optimal CDH Compatability..."

sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config

 

echo "Increasing uLimit, aka File Descripter/Handlers for all Users..."

echo "# Adding Support for CDH" >> /etc/security/limits.conf

echo "*              -     nofile              65536" >> /etc/security/limits.conf

 

echo "Disabling IPv6..."

echo "# Disable ipv6" >> /etc/sysctl.conf

echo "net.ipv6.conf.all.disable_ipv6 = 1" >> /etc/sysctl.conf

echo "net.ipv6.conf.default.disable_ipv6 = 1" >> /etc/sysctl.conf

 

echo "Increasing Swapiness Factor to limit use of swap space."

echo "# swappiness for accumulo" >> /etc/sysctl.conf

echo "vm.swappiness = 10" >> /etc/sysctl.conf

 

 

reboot and test OS/services/jdk version…

 

then I usually extract Accumulo to /opt/Accumulo/accumulo-1.5.0

 

Make a sym link, /opt/accumulo/Accumulo-current -> ./accumulo-1.5.0

 

#make dirs. For Accumulo logs, where ever…

mkdir /var/log/accumulo

 

#let HDFS own all your Accumulo folders

chown –R hdfs:hdfs /opt/accumulo

chown –R hdfs:hdfs /var/log/accumulo

 

#update the hdfs password for the next step

user root: passwd hdfs

 

#setup passwordless ssh (test using hdfs afterwards, should be able to ssh <node> w/o entering credentials)

su –hdfs

ssh-copy-id <for all tablet server nodes>

 

#update your iptables

 

 

#env vars
ACCUMULO_HOME=/opt/accumulo/accumulo-1.5.0

JAVA_HOME=/usr/java/default (jdk7 in my last install worked fine)

 

Settings for accumulo-env.sh in /conf:

# cdh4

export HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH/lib/hadoop-hdfs

export HADOOP_MAPREDUCE_HOME=/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce

test -z "$HADOOP_CONF_DIR"       && export HADOOP_CONF_DIR="$HADOOP_PREFIX/etc/hadoop"

test -z "$JAVA_HOME"             && export JAVA_HOME=/usr/java/default

test -z "$ZOOKEEPER_HOME"        && export ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH/lib/zookeeper

test -z "$ACCUMULO_LOG_DIR"      && export ACCUMULO_LOG_DIR=$ACCUMULO_HOME/logs

 

#update all files as appropriate in /opt/Accumulo/Accumulo-current/conf/*

masters, monitor,slaves,tracers,gc,Accumulo-site.xml, Accumulo-env.sh

 

#accumulo-site.xml

<property>

    <name>general.classpaths</name>

    <value>

      $ACCUMULO_HOME/server/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-server.jar,

      $ACCUMULO_HOME/core/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-core.jar,

      $ACCUMULO_HOME/start/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-start.jar,

      $ACCUMULO_HOME/fate/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-fate.jar,

      $ACCUMULO_HOME/proxy/target/classes/,

      $ACCUMULO_HOME/lib/accumulo-proxy.jar,

      $ACCUMULO_HOME/lib/[^.].*.jar,

      $ZOOKEEPER_HOME/zookeeper[^.].*.jar,

      $HADOOP_CONF_DIR,

      $HADOOP_PREFIX/[^.].*.jar,

      $HADOOP_PREFIX/lib/[^.].*.jar,

      $HADOOP_HDFS_HOME/.*.jar,

      $HADOOP_HDFS_HOME/lib/.*.jar,

      $HADOOP_MAPREDUCE_HOME/.*.jar,

      $HADOOP_MAPREDUCE_HOME/lib/.*.jar

    </value>

    <description>Classpaths that accumulo checks for updates and class files.

      When using the Security Manager, please remove the ".../target/classes/" values.

    </description>

  </property>

 

then of course, always run your Accumulo binaries/scripts using the HDFS account.  I’m sure I’m missing a few steps here and there… 

 

$ACCUMULO_HOME/bin/accumulo init

…

$ACCUMULO_HOME/bin/start-all.sh

 

 

 

From: user-return-3597-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3597-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Sean Busbey
Sent: Thursday, January 16, 2014 2:20 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

 

 

On Thu, Jan 16, 2014 at 1:14 PM, Kesten Broughton <kb...@21ct.com> wrote:

"You should make sure to correct the maximum number of open files for the user that is running Accumulo."

I have the following in all /etc/security/limits.conf in my accumulo cluster

hdfs soft nofile 65536
hdfs hard nofile 65536

However, i see this for all nodes.
WARN : Max files open on 10.0.11.208 is 32768, recommend 65536

Should it be a different user or something?

'the user that is running Accumulo'
sudo hdfs
hdfs$ bin/accumulo -u root

so is hdfs or root the accumulo user?

 

The user in question here is the one who starts the Accumulo server processes. In production environments this should be a user dedicated to Accumulo. FWIW, I usually name this user "accumulo".

 

How do you start up Accumulo? a service script? running $ACCUMULO_HOME/bin/start-all.sh? something else?


Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
On Thu, Jan 16, 2014 at 1:14 PM, Kesten Broughton <kb...@21ct.com>wrote:

> "You should make sure to correct the maximum number of open files for the
> user that is running Accumulo."
>
> I have the following in all /etc/security/limits.conf in my accumulo
> cluster
>
> hdfs soft nofile 65536
> hdfs hard nofile 65536
>
> However, i see this for all nodes.
> WARN : Max files open on 10.0.11.208 is 32768, recommend 65536
>
> Should it be a different user or something?
>
> 'the user that is running Accumulo'
> sudo hdfs
> hdfs$ bin/accumulo -u root
>
> so is hdfs or root the accumulo user?
>
>
The user in question here is the one who starts the Accumulo server
processes. In production environments this should be a user dedicated to
Accumulo. FWIW, I usually name this user "accumulo".

How do you start up Accumulo? a service script? running
$ACCUMULO_HOME/bin/start-all.sh? something else?

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Kesten Broughton <kb...@21ct.com>.
"You should make sure to correct the maximum number of open files for the user that is running Accumulo."

I have the following in all /etc/security/limits.conf in my accumulo cluster

hdfs soft nofile 65536
hdfs hard nofile 65536

However, i see this for all nodes.
WARN : Max files open on 10.0.11.208 is 32768, recommend 65536

Should it be a different user or something?

'the user that is running Accumulo'
sudo hdfs
hdfs$ bin/accumulo -u root

so is hdfs or root the accumulo user?

kesten

Kesten Broughton | Software Developer | 21CT

________________________________________
From: Sean Busbey [busbey+lists@cloudera.com]
Sent: Thursday, January 16, 2014 1:04 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

On Thu, Jan 16, 2014 at 12:51 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
When I run ./start-all.sh I get the following:

raduser@cvaraddemo01>./bin/start-all.sh
Starting monitor on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tablet servers .... done
2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
Starting tablet server on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting master on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting garbage collector on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tracer on localhost
WARN : Max files open on localhost is 1024, recommend 65536



Hey Steve,

You should make sure to correct the maximum number of open files for the user that is running Accumulo.

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
On Thu, Jan 16, 2014 at 12:51 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> When I run ./start-all.sh I get the following:
>
>
>
> raduser@cvaraddemo01>./bin/start-all.sh
>
> Starting monitor on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting tablet servers .... done
>
> 2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
>
> 2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to
> zookeeper
>
> 2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and
> initialized, attemping to talk to HDFS
>
> 2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
>
> Starting tablet server on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting master on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting garbage collector on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
> Starting tracer on localhost
>
> WARN : Max files open on localhost is 1024, recommend 65536
>
>
>
>
>
Hey Steve,

You should make sure to correct the maximum number of open files for the
user that is running Accumulo.

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
When I run ./start-all.sh I get the following:

raduser@cvaraddemo01>./bin/start-all.sh
Starting monitor on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tablet servers .... done
2014-01-16 13:38:26,404 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-16 13:38:26,980 [server.Accumulo] INFO : Attempting to talk to zookeeper
2014-01-16 13:38:27,228 [server.Accumulo] INFO : Zookeeper connected and initialized, attemping to talk to HDFS
2014-01-16 13:38:27,321 [server.Accumulo] INFO : Connected to HDFS
Starting tablet server on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting master on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting garbage collector on localhost
WARN : Max files open on localhost is 1024, recommend 65536
Starting tracer on localhost
WARN : Max files open on localhost is 1024, recommend 65536

As you can tell I have everything setup to work locally.  The tablet server seems to be up...

From: Mike Drob [mailto:madrob@cloudera.com]
Sent: Thursday, January 16, 2014 1:45 PM
To: user@accumulo.apache.org
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

The tracer does performance metrics logging, and stores the data internally in accumulo. It needs a tablet server running to persist everything and will complain until it finds one.
Are your tablet servers and loggers running? I would stop your tracer app until you have everything else up.

On Thu, Jan 16, 2014 at 1:41 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Straightened out HDFS, now having problem getting accumulo to start.  Get the following exception in my tracer log repeatedly.

2014-01-16 13:06:49,131 [impl.ServerClient] DEBUG: ClientService request failed null, retrying ...
org.apache.thrift.transport.TTransportException: Failed to connect to a server
        at org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:437)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:152)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
        at org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
        at org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
        at org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
        at org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
        at org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
        at org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:185)
        at org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:260)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.accumulo.start.Main$1.run(Main.java:101)
        at java.lang.Thread.run(Thread.java:619)

When I look at my processes, I have a gc and tracer app running.  I also can't seem to run accumulo init again because it says that it's already been initialized.

Steve

From: Sean Busbey [mailto:busbey+lists@cloudera.com<ma...@cloudera.com>]
Sent: Wednesday, January 15, 2014 4:43 PM

To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Sean,

The classpath for HDFS was incorrect and that definitely helped when I corrected it.  Now it seems I'm having a hadoop issue where the datanodes are not running.  I'm going to keep plugging away.



Glad to hear you made progress. Generally, I recommend people run through teragen / terasort to validate their HDFS and MR set up before the move on to installing Accumulo.

Let us know when you get back to trying to get Accumulo going.
________________________________

Spam<about:blank>
Not spam<about:blank>
Forget previous vote<about:blank>

________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeGJN2O&m=06d087add1f8&t=20140116&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeGJN2O&m=06d087add1f8&t=20140116&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLeGJN2O&m=06d087add1f8&t=20140116&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Mike Drob <ma...@cloudera.com>.
The tracer does performance metrics logging, and stores the data internally
in accumulo. It needs a tablet server running to persist everything and
will complain until it finds one.

Are your tablet servers and loggers running? I would stop your tracer app
until you have everything else up.


On Thu, Jan 16, 2014 at 1:41 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Straightened out HDFS, now having problem getting accumulo to start.  Get
> the following exception in my tracer log repeatedly.
>
>
>
> 2014-01-16 13:06:49,131 [impl.ServerClient] DEBUG: ClientService request
> failed null, retrying ...
>
> org.apache.thrift.transport.TTransportException: Failed to connect to a
> server
>
>         at
> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:437)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:152)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
>
>         at
> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
>
>         at
> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
>
>         at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
>
>         at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
>
>         at
> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:185)
>
>         at
> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:260)
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>         at java.lang.reflect.Method.invoke(Method.java:597)
>
>         at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>         at java.lang.Thread.run(Thread.java:619)
>
>
>
> When I look at my processes, I have a gc and tracer app running.  I also
> can’t seem to run accumulo init again because it says that it’s already
> been initialized.
>
>
>
> Steve
>
>
>
> *From:* Sean Busbey [mailto:busbey+lists@cloudera.com]
> *Sent:* Wednesday, January 15, 2014 4:43 PM
>
> *To:* Accumulo User List
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Sean,
>
>
>
> The classpath for HDFS was incorrect and that definitely helped when I
> corrected it.  Now it seems I’m having a hadoop issue where the datanodes
> are not running.  I’m going to keep plugging away.
>
>
>
>
>
>
>
> Glad to hear you made progress. Generally, I recommend people run through
> teragen / terasort to validate their HDFS and MR set up before the move on
> to installing Accumulo.
>
>
>
> Let us know when you get back to trying to get Accumulo going.
> ------------------------------
>
>
> Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=s>
> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=n>
> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=f>
>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
Straightened out HDFS, now having problem getting accumulo to start.  Get the following exception in my tracer log repeatedly.

2014-01-16 13:06:49,131 [impl.ServerClient] DEBUG: ClientService request failed null, retrying ...
org.apache.thrift.transport.TTransportException: Failed to connect to a server
        at org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:437)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:152)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
        at org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
        at org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
        at org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
        at org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
        at org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
        at org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
        at org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:185)
        at org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:260)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.accumulo.start.Main$1.run(Main.java:101)
        at java.lang.Thread.run(Thread.java:619)

When I look at my processes, I have a gc and tracer app running.  I also can’t seem to run accumulo init again because it says that it’s already been initialized.

Steve

From: Sean Busbey [mailto:busbey+lists@cloudera.com]
Sent: Wednesday, January 15, 2014 4:43 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Sean,

The classpath for HDFS was incorrect and that definitely helped when I corrected it.  Now it seems I’m having a hadoop issue where the datanodes are not running.  I’m going to keep plugging away.



Glad to hear you made progress. Generally, I recommend people run through teragen / terasort to validate their HDFS and MR set up before the move on to installing Accumulo.

Let us know when you get back to trying to get Accumulo going.
________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLelHuyF&m=25623c521f75&t=20140115&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
On Wed, Jan 15, 2014 at 3:36 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Sean,
>
>
>
> The classpath for HDFS was incorrect and that definitely helped when I
> corrected it.  Now it seems I’m having a hadoop issue where the datanodes
> are not running.  I’m going to keep plugging away.
>
>
>
>
>
Glad to hear you made progress. Generally, I recommend people run through
teragen / terasort to validate their HDFS and MR set up before the move on
to installing Accumulo.

Let us know when you get back to trying to get Accumulo going.

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
Sean,

The classpath for HDFS was incorrect and that definitely helped when I corrected it.  Now it seems I’m having a hadoop issue where the datanodes are not running.  I’m going to keep plugging away.

Thanks

From: Sean Busbey [mailto:busbey+lists@cloudera.com]
Sent: Wednesday, January 15, 2014 3:55 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id


You can also get that same error if the jars for HDFS are not in the classpaths defined in accumulo-site.xml, even if HADOOP_CONF_DIR is set properly.

Steve, make sure you edited the general classpaths for using Hadoop 2.
On Jan 15, 2014 2:43 PM, "Eric Newton" <er...@gmail.com>> wrote:
I'm sue you will get a bunch of people responding ... the email delays have made that worse recently.  The key here is this:

 Hadoop Filesystem is file:///<file:///\\>

The hadoop configuration directory (HADOOP_CONF_DIR) is not in your classpath.

You can edit the classpath in conf/accumulo-site.xml, and you can check it like this:

 $ ./bin/accumulo classpath

-Eric


On Wed, Jan 15, 2014 at 3:37 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Sean,

The logging definitely helped.  I’m now getting the following but I’m not sure why.

raduser@cvaraddemo04>./bin/accumulo<mailto:raduser@cvaraddemo04%3e./bin/accumulo> init
2014-01-15 15:32:20,331 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-15 15:32:20,498 [util.Initialize] INFO : Hadoop Filesystem is file:///<file:///\\>
2014-01-15 15:32:20,499 [util.Initialize] INFO : Accumulo data dir is /accumulo
2014-01-15 15:32:20,499 [util.Initialize] INFO : Zookeeper server is 172.17.9.151:2181<http://172.17.9.151:2181>,172.17.9.152:2181<http://172.17.9.152:2181>,172.17.9.153:2181<http://172.17.9.153:2181>,172.17.9.154:2181<http://172.17.9.154:2181>,172.17.9.155:2181<http://172.17.9.155:2181>,172.17.9.156:2181<http://172.17.9.156:2181>
2014-01-15 15:32:20,499 [util.Initialize] INFO : Checking if Zookeeper is available. If this hangs, then you need to make sure zookeeper is running


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********
2014-01-15 15:33:05,994 [util.Initialize] FATAL: Failed to initialize filesystem
java.io.IOException: Mkdirs failed to create /accumulo/instance_id
                at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:438)
                at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
                at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:905)
                at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:886)
                at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:848)
                at org.apache.hadoop.fs.FileSystem.createNewFile(FileSystem.java:1148)
                at org.apache.accumulo.server.util.Initialize.initFileSystem(Initialize.java:220)
                at org.apache.accumulo.server.util.Initialize.initialize(Initialize.java:176)
                at org.apache.accumulo.server.util.Initialize.doInit(Initialize.java:162)
                at org.apache.accumulo.server.util.Initialize.main(Initialize.java:494)
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                at java.lang.reflect.Method.invoke(Method.java:597)
                at org.apache.accumulo.start.Main$1.run(Main.java:101)
                at java.lang.Thread.run(Thread.java:619)
raduser@cvaraddemo04>

Does this mean my hadoop is not setup properly?  Everything seems to be running, I can get to all of the web admin pages and don’t seem to have any errors.  Any help would be great.

Thanks,
Steve

From: Sean Busbey [mailto:busbey+lists@cloudera.com<ma...@cloudera.com>]
Sent: Wednesday, January 15, 2014 3:19 PM
To: Accumulo User List

Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Hi Steve!

It looks like you don't have any log4j settings, so you may not get some error messages reported. You should copy the log4j.properties and *_logger.xml files from one of hte configuration examples into $ACCUMULO_CONF_DIR before running init.

On Wed, Jan 15, 2014 at 2:07 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Arshak,

When I do the following commands I get the following:

raduser@cvaraddemo01>./hadoop<mailto:raduser@cvaraddemo01%3e./hadoop> fs -ls /accumulo/instance_id/
2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/instance_id/': No such file or directory
raduser@cvaraddemo01>./hadoop<mailto:raduser@cvaraddemo01%3e./hadoop> fs -ls /accumulo/sis/
2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/sis/': No such file or directory
raduser@cvaraddemo01>

It doesn’t like it is initializing my instance name in HDFS from what I can tell but as I said I am new to this and I am not getting any errors in the accumulo init script output.

Steve

From: Arshak Navruzyan [mailto:arshakn@gmail.com<ma...@gmail.com>]
Sent: Wednesday, January 15, 2014 2:57 PM

To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Steve,

You can check to see if it's initialized correctly in HDFS with:

hadoop fs -ls /accumulo/instance_id/

If you run it as the user that is trying to start Accumulo, you should see something like this

-rw-------   3 arshakn supergroup          0 2014-01-01 22:37 /accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c

Arshak

On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Hi Mike,

The init seems to work fine.  Here is the output:

raduser@cvaraddemo01>./accumulo<mailto:raduser@cvaraddemo01%3e./accumulo> init
log4j:WARN No appenders could be found for logger (org.apache.accumulo.start.classloader.AccumuloClassLoader).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********


If I go to zookeeper I can actually see my instance sis.

Steve

From: Mike Drob [mailto:madrob@cloudera.com<ma...@cloudera.com>]
Sent: Wednesday, January 15, 2014 2:48 PM
To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

What do you get when you try to run "accumulo init"?

On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:

Hello,



I'm new to accumulo and I am trying to get it up and running.  I currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone t= hrough the installation steps on the following page and I now am running in= to a problem when I try to start accumulo up.  The error I receive is the f=

ollowing:



Thread "org.apache.accumulo.server.master.state.SetGoalState" died null java.lang.reflect.InvocationTargetException

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=

od)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=

AccessorImpl.java:39)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=

ngMethodAccessorImpl.java:25)

                at java.lang.reflect.Method.invoke(Method.java:597)

                at org.apache.accumulo.start.Main$1.run(Main.java:101)

                at java.lang.Thread.run(Thread.java:619)

Caused by: java.lang.RuntimeException: Accumulo not initialized, there is n= o instance id at /accumulo/instance_id

                at org.apache.accumulo.core.client.ZooKeeperInstance.getIns=

tanceIDFromHdfs(ZooKeeperInstance.java:293)

                at org.apache.accumulo.server.client.HdfsZooInstance._getIn=

stanceID(HdfsZooInstance.java:126)

                at org.apache.accumulo.server.client.HdfsZooInstance.getIns=

tanceID(HdfsZooInstance.java:119)

                at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=

il.java:24)

                at org.apache.accumulo.server.master.state.SetGoalState.mai=

n(SetGoalState.java:46)

                ... 6 more



I have tried to run accumulo init several times but I still get the same re= sult every single time.  Any help would be much appreciated.

Thanks,

Steve

H. Stephen Kruse
Software Engineer
Adaptive Methods
5860 Trinity Parkway, Suite 200
Centreville, VA 20121
phone: (703) 968-6132<tel:%28703%29%20968-6132>
email: skruse@adaptivemethods.com<ma...@adaptivemethods.com>



________________________________

Spam<about:blank>
Not spam<about:blank>
Forget previous vote<about:blank>

________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekTCPU&m=b4127cb489f3&t=20140115&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekTCPU&m=b4127cb489f3&t=20140115&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekTCPU&m=b4127cb489f3&t=20140115&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
You can also get that same error if the jars for HDFS are not in the
classpaths defined in accumulo-site.xml, even if HADOOP_CONF_DIR is set
properly.

Steve, make sure you edited the general classpaths for using Hadoop 2.
On Jan 15, 2014 2:43 PM, "Eric Newton" <er...@gmail.com> wrote:

> I'm sue you will get a bunch of people responding ... the email delays
> have made that worse recently.  The key here is this:
>
>  Hadoop Filesystem is file:///
>
>
> The hadoop configuration directory (HADOOP_CONF_DIR) is not in your
> classpath.
>
> You can edit the classpath in conf/accumulo-site.xml, and you can check it
> like this:
>
>  $ ./bin/accumulo classpath
>
> -Eric
>
>
>
> On Wed, Jan 15, 2014 at 3:37 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:
>
>> Sean,
>>
>>
>>
>> The logging definitely helped.  I’m now getting the following but I’m not
>> sure why.
>>
>>
>>
>> raduser@cvaraddemo04>./bin/accumulo init
>>
>> 2014-01-15 15:32:20,331 [util.NativeCodeLoader] WARN : Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>>
>> 2014-01-15 15:32:20,498 [util.Initialize] INFO : Hadoop Filesystem is
>> file:///
>>
>> 2014-01-15 15:32:20,499 [util.Initialize] INFO : Accumulo data dir is
>> /accumulo
>>
>> 2014-01-15 15:32:20,499 [util.Initialize] INFO : Zookeeper server is
>> 172.17.9.151:2181,172.17.9.152:2181,172.17.9.153:2181,172.17.9.154:2181,
>> 172.17.9.155:2181,172.17.9.156:2181
>>
>> 2014-01-15 15:32:20,499 [util.Initialize] INFO : Checking if Zookeeper is
>> available. If this hangs, then you need to make sure zookeeper is running
>>
>>
>>
>>
>>
>> Warning!!! Your instance secret is still set to the default, this is not
>> secure. We highly recommend you change it.
>>
>>
>>
>>
>>
>> You can change the instance secret in accumulo by using:
>>
>>    bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword
>> newPassword.
>>
>> You will also need to edit your secret in your configuration file by
>> adding the property instance.secret to your conf/accumulo-site.xml. Without
>> this accumulo will not operate correctly
>>
>> Instance name : sis
>>
>> Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] :
>> Y
>>
>> Enter initial password for root (this may not be applicable for your
>> security setup): ********
>>
>> Confirm initial password for root: ********
>>
>> 2014-01-15 15:33:05,994 [util.Initialize] FATAL: Failed to initialize
>> filesystem
>>
>> java.io.IOException: Mkdirs failed to create /accumulo/instance_id
>>
>>                 at
>> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:438)
>>
>>                 at
>> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
>>
>>                 at
>> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:905)
>>
>>                 at
>> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:886)
>>
>>                 at
>> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:848)
>>
>>                 at
>> org.apache.hadoop.fs.FileSystem.createNewFile(FileSystem.java:1148)
>>
>>                 at
>> org.apache.accumulo.server.util.Initialize.initFileSystem(Initialize.java:220)
>>
>>                 at
>> org.apache.accumulo.server.util.Initialize.initialize(Initialize.java:176)
>>
>>                 at
>> org.apache.accumulo.server.util.Initialize.doInit(Initialize.java:162)
>>
>>                 at
>> org.apache.accumulo.server.util.Initialize.main(Initialize.java:494)
>>
>>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>>
>>                 at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>
>>                 at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>
>>                 at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>>
>>                 at java.lang.Thread.run(Thread.java:619)
>>
>> raduser@cvaraddemo04>
>>
>>
>>
>> Does this mean my hadoop is not setup properly?  Everything seems to be
>> running, I can get to all of the web admin pages and don’t seem to have any
>> errors.  Any help would be great.
>>
>>
>>
>> Thanks,
>>
>> Steve
>>
>>
>>
>> *From:* Sean Busbey [mailto:busbey+lists@cloudera.com]
>> *Sent:* Wednesday, January 15, 2014 3:19 PM
>> *To:* Accumulo User List
>>
>> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there
>> is no instance id at /accumulo/instance_id
>>
>>
>>
>> Hi Steve!
>>
>>
>>
>> It looks like you don't have any log4j settings, so you may not get some
>> error messages reported. You should copy the log4j.properties and
>> *_logger.xml files from one of hte configuration examples into
>> $ACCUMULO_CONF_DIR before running init.
>>
>>
>>
>> On Wed, Jan 15, 2014 at 2:07 PM, Steve Kruse <sk...@adaptivemethods.com>
>> wrote:
>>
>> Arshak,
>>
>>
>>
>> When I do the following commands I get the following:
>>
>>
>>
>> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/instance_id/
>>
>> 2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader
>> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
>> for your platform... using builtin-java classes where applicable
>>
>> ls: `/accumulo/instance_id/': No such file or directory
>>
>> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/sis/
>>
>> 2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader
>> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
>> for your platform... using builtin-java classes where applicable
>>
>> ls: `/accumulo/sis/': No such file or directory
>>
>> raduser@cvaraddemo01>
>>
>>
>>
>> It doesn’t like it is initializing my instance name in HDFS from what I
>> can tell but as I said I am new to this and I am not getting any errors in
>> the accumulo init script output.
>>
>>
>>
>> Steve
>>
>>
>>
>> *From:* Arshak Navruzyan [mailto:arshakn@gmail.com]
>> *Sent:* Wednesday, January 15, 2014 2:57 PM
>>
>>
>> *To:* user@accumulo.apache.org
>> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there
>> is no instance id at /accumulo/instance_id
>>
>>
>>
>> Steve,
>>
>>
>>
>> You can check to see if it's initialized correctly in HDFS with:
>>
>>
>>
>> hadoop fs -ls /accumulo/instance_id/
>>
>>
>>
>> If you run it as the user that is trying to start Accumulo, you should
>> see something like this
>>
>>
>>
>> -rw-------   3 arshakn supergroup          0 2014-01-01 22:37
>> /accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c
>>
>>
>>
>> Arshak
>>
>>
>>
>> On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>
>> wrote:
>>
>> Hi Mike,
>>
>>
>>
>> The init seems to work fine.  Here is the output:
>>
>>
>>
>> raduser@cvaraddemo01>./accumulo init
>>
>> log4j:WARN No appenders could be found for logger
>> (org.apache.accumulo.start.classloader.AccumuloClassLoader).
>>
>> log4j:WARN Please initialize the log4j system properly.
>>
>> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
>> more info.
>>
>>
>>
>>
>>
>> Warning!!! Your instance secret is still set to the default, this is not
>> secure. We highly recommend you change it.
>>
>>
>>
>>
>>
>> You can change the instance secret in accumulo by using:
>>
>>    bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword
>> newPassword.
>>
>> You will also need to edit your secret in your configuration file by
>> adding the property instance.secret to your conf/accumulo-site.xml. Without
>> this accumulo will not operate correctly
>>
>> Instance name : sis
>>
>> Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] :
>> Y
>>
>> Enter initial password for root (this may not be applicable for your
>> security setup): ********
>>
>> Confirm initial password for root: ********
>>
>>
>>
>>
>>
>> If I go to zookeeper I can actually see my instance sis.
>>
>>
>>
>> Steve
>>
>>
>>
>> *From:* Mike Drob [mailto:madrob@cloudera.com]
>> *Sent:* Wednesday, January 15, 2014 2:48 PM
>> *To:* user@accumulo.apache.org
>> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there
>> is no instance id at /accumulo/instance_id
>>
>>
>>
>> What do you get when you try to run "accumulo init"?
>>
>>
>>
>> On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>
>> wrote:
>>
>> Hello,
>>
>>
>>
>> I'm new to accumulo and I am trying to get it up and running.  I
>> currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I
>> have gone t= hrough the installation steps on the following page and I now
>> am running in= to a problem when I try to start accumulo up.  The error I
>> receive is the f=
>>
>> ollowing:
>>
>>
>>
>> Thread "org.apache.accumulo.server.master.state.SetGoalState" died null
>> java.lang.reflect.InvocationTargetException
>>
>>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Meth=
>>
>> od)
>>
>>                 at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
>>
>> AccessorImpl.java:39)
>>
>>                 at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
>>
>> ngMethodAccessorImpl.java:25)
>>
>>                 at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>>
>>                 at java.lang.Thread.run(Thread.java:619)
>>
>> Caused by: java.lang.RuntimeException: Accumulo not initialized, there is
>> n= o instance id at /accumulo/instance_id
>>
>>                 at
>> org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
>>
>> tanceIDFromHdfs(ZooKeeperInstance.java:293)
>>
>>                 at
>> org.apache.accumulo.server.client.HdfsZooInstance._getIn=
>>
>> stanceID(HdfsZooInstance.java:126)
>>
>>                 at
>> org.apache.accumulo.server.client.HdfsZooInstance.getIns=
>>
>> tanceID(HdfsZooInstance.java:119)
>>
>>                 at
>> org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
>>
>> il.java:24)
>>
>>                 at
>> org.apache.accumulo.server.master.state.SetGoalState.mai=
>>
>> n(SetGoalState.java:46)
>>
>>                 ... 6 more
>>
>>
>>
>> I have tried to run accumulo init several times but I still get the same
>> re= sult every single time.  Any help would be much appreciated.
>>
>>
>>
>> Thanks,
>>
>>
>>
>> Steve
>>
>>
>>
>> *H. Stephen Kruse*
>>
>> Software Engineer
>>
>> Adaptive Methods
>>
>> 5860 Trinity Parkway, Suite 200
>>
>> Centreville, VA 20121
>>
>> phone: (703) 968-6132
>>
>> email: skruse@adaptivemethods.com
>>
>>
>>
>>
>>
>>
>> ------------------------------
>>
>>
>> Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=s>
>> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=n>
>> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=f>
>>
>
>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Eric Newton <er...@gmail.com>.
I'm sue you will get a bunch of people responding ... the email delays have
made that worse recently.  The key here is this:

 Hadoop Filesystem is file:///


The hadoop configuration directory (HADOOP_CONF_DIR) is not in your
classpath.

You can edit the classpath in conf/accumulo-site.xml, and you can check it
like this:

 $ ./bin/accumulo classpath

-Eric



On Wed, Jan 15, 2014 at 3:37 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Sean,
>
>
>
> The logging definitely helped.  I’m now getting the following but I’m not
> sure why.
>
>
>
> raduser@cvaraddemo04>./bin/accumulo init
>
> 2014-01-15 15:32:20,331 [util.NativeCodeLoader] WARN : Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
>
> 2014-01-15 15:32:20,498 [util.Initialize] INFO : Hadoop Filesystem is
> file:///
>
> 2014-01-15 15:32:20,499 [util.Initialize] INFO : Accumulo data dir is
> /accumulo
>
> 2014-01-15 15:32:20,499 [util.Initialize] INFO : Zookeeper server is
> 172.17.9.151:2181,172.17.9.152:2181,172.17.9.153:2181,172.17.9.154:2181,
> 172.17.9.155:2181,172.17.9.156:2181
>
> 2014-01-15 15:32:20,499 [util.Initialize] INFO : Checking if Zookeeper is
> available. If this hangs, then you need to make sure zookeeper is running
>
>
>
>
>
> Warning!!! Your instance secret is still set to the default, this is not
> secure. We highly recommend you change it.
>
>
>
>
>
> You can change the instance secret in accumulo by using:
>
>    bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword
> newPassword.
>
> You will also need to edit your secret in your configuration file by
> adding the property instance.secret to your conf/accumulo-site.xml. Without
> this accumulo will not operate correctly
>
> Instance name : sis
>
> Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
>
> Enter initial password for root (this may not be applicable for your
> security setup): ********
>
> Confirm initial password for root: ********
>
> 2014-01-15 15:33:05,994 [util.Initialize] FATAL: Failed to initialize
> filesystem
>
> java.io.IOException: Mkdirs failed to create /accumulo/instance_id
>
>                 at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:438)
>
>                 at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
>
>                 at
> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:905)
>
>                 at
> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:886)
>
>                 at
> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:848)
>
>                 at
> org.apache.hadoop.fs.FileSystem.createNewFile(FileSystem.java:1148)
>
>                 at
> org.apache.accumulo.server.util.Initialize.initFileSystem(Initialize.java:220)
>
>                 at
> org.apache.accumulo.server.util.Initialize.initialize(Initialize.java:176)
>
>                 at
> org.apache.accumulo.server.util.Initialize.doInit(Initialize.java:162)
>
>                 at
> org.apache.accumulo.server.util.Initialize.main(Initialize.java:494)
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>
>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>                 at java.lang.Thread.run(Thread.java:619)
>
> raduser@cvaraddemo04>
>
>
>
> Does this mean my hadoop is not setup properly?  Everything seems to be
> running, I can get to all of the web admin pages and don’t seem to have any
> errors.  Any help would be great.
>
>
>
> Thanks,
>
> Steve
>
>
>
> *From:* Sean Busbey [mailto:busbey+lists@cloudera.com]
> *Sent:* Wednesday, January 15, 2014 3:19 PM
> *To:* Accumulo User List
>
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> Hi Steve!
>
>
>
> It looks like you don't have any log4j settings, so you may not get some
> error messages reported. You should copy the log4j.properties and
> *_logger.xml files from one of hte configuration examples into
> $ACCUMULO_CONF_DIR before running init.
>
>
>
> On Wed, Jan 15, 2014 at 2:07 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Arshak,
>
>
>
> When I do the following commands I get the following:
>
>
>
> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/instance_id/
>
> 2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader
> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
>
> ls: `/accumulo/instance_id/': No such file or directory
>
> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/sis/
>
> 2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader
> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
>
> ls: `/accumulo/sis/': No such file or directory
>
> raduser@cvaraddemo01>
>
>
>
> It doesn’t like it is initializing my instance name in HDFS from what I
> can tell but as I said I am new to this and I am not getting any errors in
> the accumulo init script output.
>
>
>
> Steve
>
>
>
> *From:* Arshak Navruzyan [mailto:arshakn@gmail.com]
> *Sent:* Wednesday, January 15, 2014 2:57 PM
>
>
> *To:* user@accumulo.apache.org
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> Steve,
>
>
>
> You can check to see if it's initialized correctly in HDFS with:
>
>
>
> hadoop fs -ls /accumulo/instance_id/
>
>
>
> If you run it as the user that is trying to start Accumulo, you should see
> something like this
>
>
>
> -rw-------   3 arshakn supergroup          0 2014-01-01 22:37
> /accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c
>
>
>
> Arshak
>
>
>
> On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Hi Mike,
>
>
>
> The init seems to work fine.  Here is the output:
>
>
>
> raduser@cvaraddemo01>./accumulo init
>
> log4j:WARN No appenders could be found for logger
> (org.apache.accumulo.start.classloader.AccumuloClassLoader).
>
> log4j:WARN Please initialize the log4j system properly.
>
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
>
>
>
>
>
> Warning!!! Your instance secret is still set to the default, this is not
> secure. We highly recommend you change it.
>
>
>
>
>
> You can change the instance secret in accumulo by using:
>
>    bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword
> newPassword.
>
> You will also need to edit your secret in your configuration file by
> adding the property instance.secret to your conf/accumulo-site.xml. Without
> this accumulo will not operate correctly
>
> Instance name : sis
>
> Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
>
> Enter initial password for root (this may not be applicable for your
> security setup): ********
>
> Confirm initial password for root: ********
>
>
>
>
>
> If I go to zookeeper I can actually see my instance sis.
>
>
>
> Steve
>
>
>
> *From:* Mike Drob [mailto:madrob@cloudera.com]
> *Sent:* Wednesday, January 15, 2014 2:48 PM
> *To:* user@accumulo.apache.org
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> What do you get when you try to run "accumulo init"?
>
>
>
> On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Hello,
>
>
>
> I'm new to accumulo and I am trying to get it up and running.  I currently
> = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone
> t= hrough the installation steps on the following page and I now am running
> in= to a problem when I try to start accumulo up.  The error I receive is
> the f=
>
> ollowing:
>
>
>
> Thread "org.apache.accumulo.server.master.state.SetGoalState" died null
> java.lang.reflect.InvocationTargetException
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Meth=
>
> od)
>
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
>
> AccessorImpl.java:39)
>
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
>
> ngMethodAccessorImpl.java:25)
>
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>
>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>                 at java.lang.Thread.run(Thread.java:619)
>
> Caused by: java.lang.RuntimeException: Accumulo not initialized, there is
> n= o instance id at /accumulo/instance_id
>
>                 at
> org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
>
> tanceIDFromHdfs(ZooKeeperInstance.java:293)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance._getIn=
>
> stanceID(HdfsZooInstance.java:126)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance.getIns=
>
> tanceID(HdfsZooInstance.java:119)
>
>                 at
> org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
>
> il.java:24)
>
>                 at
> org.apache.accumulo.server.master.state.SetGoalState.mai=
>
> n(SetGoalState.java:46)
>
>                 ... 6 more
>
>
>
> I have tried to run accumulo init several times but I still get the same
> re= sult every single time.  Any help would be much appreciated.
>
>
>
> Thanks,
>
>
>
> Steve
>
>
>
> *H. Stephen Kruse*
>
> Software Engineer
>
> Adaptive Methods
>
> 5860 Trinity Parkway, Suite 200
>
> Centreville, VA 20121
>
> phone: (703) 968-6132
>
> email: skruse@adaptivemethods.com
>
>
>
>
>
>
> ------------------------------
>
>
> Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=s>
> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=n>
> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=f>
>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
Sean,

The logging definitely helped.  I’m now getting the following but I’m not sure why.

raduser@cvaraddemo04>./bin/accumulo init
2014-01-15 15:32:20,331 [util.NativeCodeLoader] WARN : Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2014-01-15 15:32:20,498 [util.Initialize] INFO : Hadoop Filesystem is file:///
2014-01-15 15:32:20,499 [util.Initialize] INFO : Accumulo data dir is /accumulo
2014-01-15 15:32:20,499 [util.Initialize] INFO : Zookeeper server is 172.17.9.151:2181,172.17.9.152:2181,172.17.9.153:2181,172.17.9.154:2181,172.17.9.155:2181,172.17.9.156:2181
2014-01-15 15:32:20,499 [util.Initialize] INFO : Checking if Zookeeper is available. If this hangs, then you need to make sure zookeeper is running


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********
2014-01-15 15:33:05,994 [util.Initialize] FATAL: Failed to initialize filesystem
java.io.IOException: Mkdirs failed to create /accumulo/instance_id
                at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:438)
                at org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
                at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:905)
                at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:886)
                at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:848)
                at org.apache.hadoop.fs.FileSystem.createNewFile(FileSystem.java:1148)
                at org.apache.accumulo.server.util.Initialize.initFileSystem(Initialize.java:220)
                at org.apache.accumulo.server.util.Initialize.initialize(Initialize.java:176)
                at org.apache.accumulo.server.util.Initialize.doInit(Initialize.java:162)
                at org.apache.accumulo.server.util.Initialize.main(Initialize.java:494)
                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
                at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
                at java.lang.reflect.Method.invoke(Method.java:597)
                at org.apache.accumulo.start.Main$1.run(Main.java:101)
                at java.lang.Thread.run(Thread.java:619)
raduser@cvaraddemo04>

Does this mean my hadoop is not setup properly?  Everything seems to be running, I can get to all of the web admin pages and don’t seem to have any errors.  Any help would be great.

Thanks,
Steve

From: Sean Busbey [mailto:busbey+lists@cloudera.com]
Sent: Wednesday, January 15, 2014 3:19 PM
To: Accumulo User List
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Hi Steve!

It looks like you don't have any log4j settings, so you may not get some error messages reported. You should copy the log4j.properties and *_logger.xml files from one of hte configuration examples into $ACCUMULO_CONF_DIR before running init.

On Wed, Jan 15, 2014 at 2:07 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Arshak,

When I do the following commands I get the following:

raduser@cvaraddemo01>./hadoop<mailto:raduser@cvaraddemo01%3e./hadoop> fs -ls /accumulo/instance_id/
2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/instance_id/': No such file or directory
raduser@cvaraddemo01>./hadoop<mailto:raduser@cvaraddemo01%3e./hadoop> fs -ls /accumulo/sis/
2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/sis/': No such file or directory
raduser@cvaraddemo01>

It doesn’t like it is initializing my instance name in HDFS from what I can tell but as I said I am new to this and I am not getting any errors in the accumulo init script output.

Steve

From: Arshak Navruzyan [mailto:arshakn@gmail.com<ma...@gmail.com>]
Sent: Wednesday, January 15, 2014 2:57 PM

To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Steve,

You can check to see if it's initialized correctly in HDFS with:

hadoop fs -ls /accumulo/instance_id/

If you run it as the user that is trying to start Accumulo, you should see something like this

-rw-------   3 arshakn supergroup          0 2014-01-01 22:37 /accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c

Arshak

On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Hi Mike,

The init seems to work fine.  Here is the output:

raduser@cvaraddemo01>./accumulo<mailto:raduser@cvaraddemo01%3e./accumulo> init
log4j:WARN No appenders could be found for logger (org.apache.accumulo.start.classloader.AccumuloClassLoader).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********


If I go to zookeeper I can actually see my instance sis.

Steve

From: Mike Drob [mailto:madrob@cloudera.com<ma...@cloudera.com>]
Sent: Wednesday, January 15, 2014 2:48 PM
To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

What do you get when you try to run "accumulo init"?

On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:

Hello,



I'm new to accumulo and I am trying to get it up and running.  I currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone t= hrough the installation steps on the following page and I now am running in= to a problem when I try to start accumulo up.  The error I receive is the f=

ollowing:



Thread "org.apache.accumulo.server.master.state.SetGoalState" died null java.lang.reflect.InvocationTargetException

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=

od)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=

AccessorImpl.java:39)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=

ngMethodAccessorImpl.java:25)

                at java.lang.reflect.Method.invoke(Method.java:597)

                at org.apache.accumulo.start.Main$1.run(Main.java:101)

                at java.lang.Thread.run(Thread.java:619)

Caused by: java.lang.RuntimeException: Accumulo not initialized, there is n= o instance id at /accumulo/instance_id

                at org.apache.accumulo.core.client.ZooKeeperInstance.getIns=

tanceIDFromHdfs(ZooKeeperInstance.java:293)

                at org.apache.accumulo.server.client.HdfsZooInstance._getIn=

stanceID(HdfsZooInstance.java:126)

                at org.apache.accumulo.server.client.HdfsZooInstance.getIns=

tanceID(HdfsZooInstance.java:119)

                at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=

il.java:24)

                at org.apache.accumulo.server.master.state.SetGoalState.mai=

n(SetGoalState.java:46)

                ... 6 more



I have tried to run accumulo init several times but I still get the same re= sult every single time.  Any help would be much appreciated.

Thanks,

Steve

H. Stephen Kruse
Software Engineer
Adaptive Methods
5860 Trinity Parkway, Suite 200
Centreville, VA 20121
phone: (703) 968-6132<tel:%28703%29%20968-6132>
email: skruse@adaptivemethods.com<ma...@adaptivemethods.com>



________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLekk40K&m=c8be3454d43c&t=20140115&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
Hi Steve!

It looks like you don't have any log4j settings, so you may not get some
error messages reported. You should copy the log4j.properties and
*_logger.xml files from one of hte configuration examples into
$ACCUMULO_CONF_DIR before running init.


On Wed, Jan 15, 2014 at 2:07 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Arshak,
>
>
>
> When I do the following commands I get the following:
>
>
>
> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/instance_id/
>
> 2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader
> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
>
> ls: `/accumulo/instance_id/': No such file or directory
>
> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/sis/
>
> 2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader
> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
>
> ls: `/accumulo/sis/': No such file or directory
>
> raduser@cvaraddemo01>
>
>
>
> It doesn’t like it is initializing my instance name in HDFS from what I
> can tell but as I said I am new to this and I am not getting any errors in
> the accumulo init script output.
>
>
>
> Steve
>
>
>
> *From:* Arshak Navruzyan [mailto:arshakn@gmail.com]
> *Sent:* Wednesday, January 15, 2014 2:57 PM
>
> *To:* user@accumulo.apache.org
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> Steve,
>
>
>
> You can check to see if it's initialized correctly in HDFS with:
>
>
>
> hadoop fs -ls /accumulo/instance_id/
>
>
>
> If you run it as the user that is trying to start Accumulo, you should see
> something like this
>
>
>
> -rw-------   3 arshakn supergroup          0 2014-01-01 22:37
> /accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c
>
>
>
> Arshak
>
>
>
> On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Hi Mike,
>
>
>
> The init seems to work fine.  Here is the output:
>
>
>
> raduser@cvaraddemo01>./accumulo init
>
> log4j:WARN No appenders could be found for logger
> (org.apache.accumulo.start.classloader.AccumuloClassLoader).
>
> log4j:WARN Please initialize the log4j system properly.
>
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
>
>
>
>
>
> Warning!!! Your instance secret is still set to the default, this is not
> secure. We highly recommend you change it.
>
>
>
>
>
> You can change the instance secret in accumulo by using:
>
>    bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword
> newPassword.
>
> You will also need to edit your secret in your configuration file by
> adding the property instance.secret to your conf/accumulo-site.xml. Without
> this accumulo will not operate correctly
>
> Instance name : sis
>
> Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
>
> Enter initial password for root (this may not be applicable for your
> security setup): ********
>
> Confirm initial password for root: ********
>
>
>
>
>
> If I go to zookeeper I can actually see my instance sis.
>
>
>
> Steve
>
>
>
> *From:* Mike Drob [mailto:madrob@cloudera.com]
> *Sent:* Wednesday, January 15, 2014 2:48 PM
> *To:* user@accumulo.apache.org
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> What do you get when you try to run "accumulo init"?
>
>
>
> On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Hello,
>
>
>
> I'm new to accumulo and I am trying to get it up and running.  I currently
> = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone
> t= hrough the installation steps on the following page and I now am running
> in= to a problem when I try to start accumulo up.  The error I receive is
> the f=
>
> ollowing:
>
>
>
> Thread "org.apache.accumulo.server.master.state.SetGoalState" died null
> java.lang.reflect.InvocationTargetException
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Meth=
>
> od)
>
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
>
> AccessorImpl.java:39)
>
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
>
> ngMethodAccessorImpl.java:25)
>
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>
>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>                 at java.lang.Thread.run(Thread.java:619)
>
> Caused by: java.lang.RuntimeException: Accumulo not initialized, there is
> n= o instance id at /accumulo/instance_id
>
>                 at
> org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
>
> tanceIDFromHdfs(ZooKeeperInstance.java:293)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance._getIn=
>
> stanceID(HdfsZooInstance.java:126)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance.getIns=
>
> tanceID(HdfsZooInstance.java:119)
>
>                 at
> org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
>
> il.java:24)
>
>                 at
> org.apache.accumulo.server.master.state.SetGoalState.mai=
>
> n(SetGoalState.java:46)
>
>                 ... 6 more
>
>
>
> I have tried to run accumulo init several times but I still get the same
> re= sult every single time.  Any help would be much appreciated.
>
>
>
> Thanks,
>
>
>
> Steve
>
>
>
> *H. Stephen Kruse*
>
> Software Engineer
>
> Adaptive Methods
>
> 5860 Trinity Parkway, Suite 200
>
> Centreville, VA 20121
>
> phone: (703) 968-6132
>
> email: skruse@adaptivemethods.com
>
>
>
>
>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Sean Busbey <bu...@cloudera.com>.
On Wed, Jan 15, 2014 at 4:09 PM, Kesten Broughton <kb...@21ct.com>wrote:

>
> I have seen similar problems caused by only installing the bin rpm.
> The docs seem to suggest you can choose one or the other.
>
> However, I was only able to get it to work by installing both and then
> selecting the one i would use in the config files - accumulo-env.sh
>
> accumulo-1.5.0-bin.rpm mirrors (gpg signature)
> accumulo-1.5.0-native.rpm mirrors (gpg signature)
>
>

Christopher can correct me (since he knows the most about packaging), but I
believe the native rpm just adds pre-built libraries for our native memory
maps. It's an optimization that you don't strictly need.




> ------------
> Seems related to the message...
>
>
> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/instance_id/
> 2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader
> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
> ls: `/accumulo/instance_id/': No such file or directory
> raduser@cvaraddemo01>./hadoop fs -ls /accumulo/sis/
> 2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader
> (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library
> for your platform... using builtin-java classes where applicable
> ls: `/accumulo/sis/': No such file or directory
>
>
>
 This is actually an unrelated problem with the Hadoop installation, not
Accumulo. It just means that the paths for loading Hadoop are wrong.

Accumulo tries to guess based on common paths in HADOOP_PREFIX[1], but
sometimes it's wrong (or they're not installed). Again, this is just an
optimization measure and you can ignore it if you're just looking to test
PoC or correctness.

[1]: https://github.com/apache/accumulo/blob/1.5.0/bin/accumulo#L114

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Kesten Broughton <kb...@21ct.com>.
I have seen similar problems caused by only installing the bin rpm.
The docs seem to suggest you can choose one or the other.

However, I was only able to get it to work by installing both and then selecting the one i would use in the config files - accumulo-env.sh

accumulo-1.5.0-bin.rpm mirrors (gpg signature)
accumulo-1.5.0-native.rpm mirrors (gpg signature)

------------
Seems related to the message...


raduser@cvaraddemo01>./hadoop fs -ls /accumulo/instance_id/
2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/instance_id/': No such file or directory
raduser@cvaraddemo01>./hadoop fs -ls /accumulo/sis/
2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/sis/': No such file or directory



Kesten Broughton | Software Developer | 21CT

________________________________________
From: Steve Kruse [skruse@adaptivemethods.com]
Sent: Wednesday, January 15, 2014 2:07 PM
To: user@accumulo.apache.org
Subject: RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Arshak,

When I do the following commands I get the following:

raduser@cvaraddemo01>./hadoop fs -ls /accumulo/instance_id/
2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/instance_id/': No such file or directory
raduser@cvaraddemo01>./hadoop fs -ls /accumulo/sis/
2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/sis/': No such file or directory
raduser@cvaraddemo01>

It doesn’t like it is initializing my instance name in HDFS from what I can tell but as I said I am new to this and I am not getting any errors in the accumulo init script output.

Steve

From: Arshak Navruzyan [mailto:arshakn@gmail.com]
Sent: Wednesday, January 15, 2014 2:57 PM
To: user@accumulo.apache.org
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Steve,

You can check to see if it's initialized correctly in HDFS with:

hadoop fs -ls /accumulo/instance_id/

If you run it as the user that is trying to start Accumulo, you should see something like this

-rw-------   3 arshakn supergroup          0 2014-01-01 22:37 /accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c

Arshak

On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Hi Mike,

The init seems to work fine.  Here is the output:

raduser@cvaraddemo01>./accumulo<mailto:raduser@cvaraddemo01%3e./accumulo> init
log4j:WARN No appenders could be found for logger (org.apache.accumulo.start.classloader.AccumuloClassLoader).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********


If I go to zookeeper I can actually see my instance sis.

Steve

From: Mike Drob [mailto:madrob@cloudera.com<ma...@cloudera.com>]
Sent: Wednesday, January 15, 2014 2:48 PM
To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

What do you get when you try to run "accumulo init"?

On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:

Hello,



I'm new to accumulo and I am trying to get it up and running.  I currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone t= hrough the installation steps on the following page and I now am running in= to a problem when I try to start accumulo up.  The error I receive is the f=

ollowing:



Thread "org.apache.accumulo.server.master.state.SetGoalState" died null java.lang.reflect.InvocationTargetException

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=

od)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=

AccessorImpl.java:39)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=

ngMethodAccessorImpl.java:25)

                at java.lang.reflect.Method.invoke(Method.java:597)

                at org.apache.accumulo.start.Main$1.run(Main.java:101)

                at java.lang.Thread.run(Thread.java:619)

Caused by: java.lang.RuntimeException: Accumulo not initialized, there is n= o instance id at /accumulo/instance_id

                at org.apache.accumulo.core.client.ZooKeeperInstance.getIns=

tanceIDFromHdfs(ZooKeeperInstance.java:293)

                at org.apache.accumulo.server.client.HdfsZooInstance._getIn=

stanceID(HdfsZooInstance.java:126)

                at org.apache.accumulo.server.client.HdfsZooInstance.getIns=

tanceID(HdfsZooInstance.java:119)

                at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=

il.java:24)

                at org.apache.accumulo.server.master.state.SetGoalState.mai=

n(SetGoalState.java:46)

                ... 6 more



I have tried to run accumulo init several times but I still get the same re= sult every single time.  Any help would be much appreciated.

Thanks,

Steve

H. Stephen Kruse
Software Engineer
Adaptive Methods
5860 Trinity Parkway, Suite 200
Centreville, VA 20121
phone: (703) 968-6132<tel:%28703%29%20968-6132>
email: skruse@adaptivemethods.com<ma...@adaptivemethods.com>


________________________________

Spam<about:blank>
Not spam<about:blank>
Forget previous vote<about:blank>

________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=f>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
Arshak,

When I do the following commands I get the following:

raduser@cvaraddemo01>./hadoop fs -ls /accumulo/instance_id/
2014-01-15 15:05:05,220 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/instance_id/': No such file or directory
raduser@cvaraddemo01>./hadoop fs -ls /accumulo/sis/
2014-01-15 15:05:18,974 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
ls: `/accumulo/sis/': No such file or directory
raduser@cvaraddemo01>

It doesn't like it is initializing my instance name in HDFS from what I can tell but as I said I am new to this and I am not getting any errors in the accumulo init script output.

Steve

From: Arshak Navruzyan [mailto:arshakn@gmail.com]
Sent: Wednesday, January 15, 2014 2:57 PM
To: user@accumulo.apache.org
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Steve,

You can check to see if it's initialized correctly in HDFS with:

hadoop fs -ls /accumulo/instance_id/

If you run it as the user that is trying to start Accumulo, you should see something like this

-rw-------   3 arshakn supergroup          0 2014-01-01 22:37 /accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c

Arshak

On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>> wrote:
Hi Mike,

The init seems to work fine.  Here is the output:

raduser@cvaraddemo01>./accumulo<mailto:raduser@cvaraddemo01%3e./accumulo> init
log4j:WARN No appenders could be found for logger (org.apache.accumulo.start.classloader.AccumuloClassLoader).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********


If I go to zookeeper I can actually see my instance sis.

Steve

From: Mike Drob [mailto:madrob@cloudera.com<ma...@cloudera.com>]
Sent: Wednesday, January 15, 2014 2:48 PM
To: user@accumulo.apache.org<ma...@accumulo.apache.org>
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

What do you get when you try to run "accumulo init"?

On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:

Hello,



I'm new to accumulo and I am trying to get it up and running.  I currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone t= hrough the installation steps on the following page and I now am running in= to a problem when I try to start accumulo up.  The error I receive is the f=

ollowing:



Thread "org.apache.accumulo.server.master.state.SetGoalState" died null java.lang.reflect.InvocationTargetException

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=

od)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=

AccessorImpl.java:39)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=

ngMethodAccessorImpl.java:25)

                at java.lang.reflect.Method.invoke(Method.java:597)

                at org.apache.accumulo.start.Main$1.run(Main.java:101)

                at java.lang.Thread.run(Thread.java:619)

Caused by: java.lang.RuntimeException: Accumulo not initialized, there is n= o instance id at /accumulo/instance_id

                at org.apache.accumulo.core.client.ZooKeeperInstance.getIns=

tanceIDFromHdfs(ZooKeeperInstance.java:293)

                at org.apache.accumulo.server.client.HdfsZooInstance._getIn=

stanceID(HdfsZooInstance.java:126)

                at org.apache.accumulo.server.client.HdfsZooInstance.getIns=

tanceID(HdfsZooInstance.java:119)

                at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=

il.java:24)

                at org.apache.accumulo.server.master.state.SetGoalState.mai=

n(SetGoalState.java:46)

                ... 6 more



I have tried to run accumulo init several times but I still get the same re= sult every single time.  Any help would be much appreciated.

Thanks,

Steve

H. Stephen Kruse
Software Engineer
Adaptive Methods
5860 Trinity Parkway, Suite 200
Centreville, VA 20121
phone: (703) 968-6132<tel:%28703%29%20968-6132>
email: skruse@adaptivemethods.com<ma...@adaptivemethods.com>


________________________________

Spam<about:blank>
Not spam<about:blank>
Forget previous vote<about:blank>

________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejVPIW&m=2327134d1f06&t=20140115&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Arshak Navruzyan <ar...@gmail.com>.
Steve,

You can check to see if it's initialized correctly in HDFS with:

hadoop fs -ls /accumulo/instance_id/

If you run it as the user that is trying to start Accumulo, you should see
something like this

-rw-------   3 arshakn supergroup          0 2014-01-01 22:37
/accumulo/instance_id/f269a1cd-1425-47fc-b80b-eecd2feeed9c

Arshak


On Wed, Jan 15, 2014 at 11:52 AM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Hi Mike,
>
>
>
> The init seems to work fine.  Here is the output:
>
>
>
> raduser@cvaraddemo01>./accumulo init
>
> log4j:WARN No appenders could be found for logger
> (org.apache.accumulo.start.classloader.AccumuloClassLoader).
>
> log4j:WARN Please initialize the log4j system properly.
>
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
>
>
>
>
>
> Warning!!! Your instance secret is still set to the default, this is not
> secure. We highly recommend you change it.
>
>
>
>
>
> You can change the instance secret in accumulo by using:
>
>    bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword
> newPassword.
>
> You will also need to edit your secret in your configuration file by
> adding the property instance.secret to your conf/accumulo-site.xml. Without
> this accumulo will not operate correctly
>
> Instance name : sis
>
> Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
>
> Enter initial password for root (this may not be applicable for your
> security setup): ********
>
> Confirm initial password for root: ********
>
>
>
>
>
> If I go to zookeeper I can actually see my instance sis.
>
>
>
> Steve
>
>
>
> *From:* Mike Drob [mailto:madrob@cloudera.com]
> *Sent:* Wednesday, January 15, 2014 2:48 PM
> *To:* user@accumulo.apache.org
> *Subject:* Re: accumulo startup issue: Accumulo not initialized, there is
> no instance id at /accumulo/instance_id
>
>
>
> What do you get when you try to run "accumulo init"?
>
>
>
> On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>
> wrote:
>
> Hello,
>
>
>
> I'm new to accumulo and I am trying to get it up and running.  I currently
> = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone
> t= hrough the installation steps on the following page and I now am running
> in= to a problem when I try to start accumulo up.  The error I receive is
> the f=
>
> ollowing:
>
>
>
> Thread "org.apache.accumulo.server.master.state.SetGoalState" died null
> java.lang.reflect.InvocationTargetException
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Meth=
>
> od)
>
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
>
> AccessorImpl.java:39)
>
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
>
> ngMethodAccessorImpl.java:25)
>
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>
>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>                 at java.lang.Thread.run(Thread.java:619)
>
> Caused by: java.lang.RuntimeException: Accumulo not initialized, there is
> n= o instance id at /accumulo/instance_id
>
>                 at
> org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
>
> tanceIDFromHdfs(ZooKeeperInstance.java:293)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance._getIn=
>
> stanceID(HdfsZooInstance.java:126)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance.getIns=
>
> tanceID(HdfsZooInstance.java:119)
>
>                 at
> org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
>
> il.java:24)
>
>                 at
> org.apache.accumulo.server.master.state.SetGoalState.mai=
>
> n(SetGoalState.java:46)
>
>                 ... 6 more
>
>
>
> I have tried to run accumulo init several times but I still get the same
> re= sult every single time.  Any help would be much appreciated.
>
>
>
> Thanks,
>
>
>
> Steve
>
>
>
> *H. Stephen Kruse*
>
> Software Engineer
>
> Adaptive Methods
>
> 5860 Trinity Parkway, Suite 200
>
> Centreville, VA 20121
>
> phone: (703) 968-6132
>
> email: skruse@adaptivemethods.com
>
>
>
>
> ------------------------------
>
>
> Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=eceeee445a2d&t=20140115&c=s>
> Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=eceeee445a2d&t=20140115&c=n>
> Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=eceeee445a2d&t=20140115&c=f>
>

RE: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Steve Kruse <sk...@adaptivemethods.com>.
Hi Mike,

The init seems to work fine.  Here is the output:

raduser@cvaraddemo01>./accumulo init
log4j:WARN No appenders could be found for logger (org.apache.accumulo.start.classloader.AccumuloClassLoader).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.


Warning!!! Your instance secret is still set to the default, this is not secure. We highly recommend you change it.


You can change the instance secret in accumulo by using:
   bin/accumulo org.apache.accumulo.server.util.ChangeSecret oldPassword newPassword.
You will also need to edit your secret in your configuration file by adding the property instance.secret to your conf/accumulo-site.xml. Without this accumulo will not operate correctly
Instance name : sis
Instance name "sis" exists. Delete existing entry from zookeeper? [Y/N] : Y
Enter initial password for root (this may not be applicable for your security setup): ********
Confirm initial password for root: ********


If I go to zookeeper I can actually see my instance sis.

Steve

From: Mike Drob [mailto:madrob@cloudera.com]
Sent: Wednesday, January 15, 2014 2:48 PM
To: user@accumulo.apache.org
Subject: Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

What do you get when you try to run "accumulo init"?

On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>> wrote:

Hello,



I'm new to accumulo and I am trying to get it up and running.  I currently = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone t= hrough the installation steps on the following page and I now am running in= to a problem when I try to start accumulo up.  The error I receive is the f=

ollowing:



Thread "org.apache.accumulo.server.master.state.SetGoalState" died null java.lang.reflect.InvocationTargetException

                at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Meth=

od)

                at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=

AccessorImpl.java:39)

                at sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=

ngMethodAccessorImpl.java:25)

                at java.lang.reflect.Method.invoke(Method.java:597)

                at org.apache.accumulo.start.Main$1.run(Main.java:101)

                at java.lang.Thread.run(Thread.java:619)

Caused by: java.lang.RuntimeException: Accumulo not initialized, there is n= o instance id at /accumulo/instance_id

                at org.apache.accumulo.core.client.ZooKeeperInstance.getIns=

tanceIDFromHdfs(ZooKeeperInstance.java:293)

                at org.apache.accumulo.server.client.HdfsZooInstance._getIn=

stanceID(HdfsZooInstance.java:126)

                at org.apache.accumulo.server.client.HdfsZooInstance.getIns=

tanceID(HdfsZooInstance.java:119)

                at org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=

il.java:24)

                at org.apache.accumulo.server.master.state.SetGoalState.mai=

n(SetGoalState.java:46)

                ... 6 more



I have tried to run accumulo init several times but I still get the same re= sult every single time.  Any help would be much appreciated.

Thanks,

Steve

H. Stephen Kruse
Software Engineer
Adaptive Methods
5860 Trinity Parkway, Suite 200
Centreville, VA 20121
phone: (703) 968-6132<tel:%28703%29%20968-6132>
email: skruse@adaptivemethods.com<ma...@adaptivemethods.com>


________________________________

Spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=eceeee445a2d&t=20140115&c=s>
Not spam<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=eceeee445a2d&t=20140115&c=n>
Forget previous vote<https://antispam.roaringpenguin.com/canit/b.php?i=0aLejNfDc&m=eceeee445a2d&t=20140115&c=f>

Re: accumulo startup issue: Accumulo not initialized, there is no instance id at /accumulo/instance_id

Posted by Mike Drob <ma...@cloudera.com>.
What do you get when you try to run "accumulo init"?


On Wed, Jan 15, 2014 at 2:39 PM, Steve Kruse <sk...@adaptivemethods.com>wrote:

> Hello,
>
>
>
> I'm new to accumulo and I am trying to get it up and running.  I currently
> = have hadoop 2.2.0 and zookeeper 3.4.5 installed and running.  I have gone
> t= hrough the installation steps on the following page and I now am running
> in= to a problem when I try to start accumulo up.  The error I receive is
> the f=
>
> ollowing:
>
>
>
> Thread "org.apache.accumulo.server.master.state.SetGoalState" died null
> java.lang.reflect.InvocationTargetException
>
>                 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Meth=
>
> od)
>
>                 at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethod=
>
> AccessorImpl.java:39)
>
>                 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegati=
>
> ngMethodAccessorImpl.java:25)
>
>                 at java.lang.reflect.Method.invoke(Method.java:597)
>
>                 at org.apache.accumulo.start.Main$1.run(Main.java:101)
>
>                 at java.lang.Thread.run(Thread.java:619)
>
> Caused by: java.lang.RuntimeException: Accumulo not initialized, there is
> n= o instance id at /accumulo/instance_id
>
>                 at
> org.apache.accumulo.core.client.ZooKeeperInstance.getIns=
>
> tanceIDFromHdfs(ZooKeeperInstance.java:293)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance._getIn=
>
> stanceID(HdfsZooInstance.java:126)
>
>                 at
> org.apache.accumulo.server.client.HdfsZooInstance.getIns=
>
> tanceID(HdfsZooInstance.java:119)
>
>                 at
> org.apache.accumulo.core.zookeeper.ZooUtil.getRoot(ZooUt=
>
> il.java:24)
>
>                 at
> org.apache.accumulo.server.master.state.SetGoalState.mai=
>
> n(SetGoalState.java:46)
>
>                 ... 6 more
>
>
>
> I have tried to run accumulo init several times but I still get the same
> re= sult every single time.  Any help would be much appreciated.
>
>
>
> Thanks,
>
>
>
> Steve
>
>
>
> *H. Stephen Kruse*
>
> Software Engineer
>
> Adaptive Methods
>
> 5860 Trinity Parkway, Suite 200
>
> Centreville, VA 20121
>
> phone: (703) 968-6132
>
> email: skruse@adaptivemethods.com
>
>
>