You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@accumulo.apache.org by Benjamin Parrish <be...@gmail.com> on 2014/03/17 01:28:56 UTC
Installing with Hadoop 2.2.0
I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
1) I start with accumulo init and everything runs through just fine, but I
can find '/accumulo' using 'hadoop fs -ls /'
2) I try to run 'accumulo shell -u root' and it says that that Hadoop and
ZooKeeper are not started, but if I run 'jps' on the each cluster node it
shows all the necessary processes for both in the JVM. Is there something
I am missing?
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
Running Sun JDK 1,7.0
On Tue, Mar 18, 2014 at 12:32 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> Results are located here...
>
> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>
>
> On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi <billie.rinaldi@gmail.com
> > wrote:
>
>> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>>
>>> 1) I start with accumulo init and everything runs through just fine, but
>>> I can find '/accumulo' using 'hadoop fs -ls /'
>>>
>>
>> If /accumulo doesn't exist, then accumulo init did not complete
>> successfully. (Unless the accumulo directory was set to something else,
>> but that did not appear to be the case in your site configuration file.)
>> Would you happen to have the output of the accumulo init command?
>>
>>
>>>
>>> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop
>>> and ZooKeeper are not started, but if I run 'jps' on the each cluster node
>>> it shows all the necessary processes for both in the JVM. Is there
>>> something I am missing?
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Josh Elser <jo...@gmail.com>.
That's definitely difficult to encapsulate. You can get a mixing of
Apache conventions, your OS of choice conventions, and vendor conventions.
The thing that I usually see is applications installed under /usr/lib
(e.g. /usr/lib/accumulo), the relevant executables linked to /usr/bin to
get them on the $PATH, /usr/lib/accumulo/conf linked to
/etc/accumulo/conf (with indirection for your configuration mgmt tool of
choice -- e.g. alternatives on RHEL-based systems), and
/usr/lib/accumulo/logs linked to /var/log/accumulo.
Typically you would want all of that chown'ed by the accumulo user. Be
sure to chmod /etc/accumulo/conf and /var/log/accumulo 700 to not
inadvertently leak any sensitive configuration or log messages. The rest
of /usr/lib/accumulo can probably just be 755/644 for dirs/files,
respectively.
This also can map well to development machines if you use /usr/local/lib
for installations and avoid symlink'ing out to /etc and /var.
On 3/19/14, 2:32 PM, Benjamin Parrish wrote:
> Finally got it. Came down to a user and ownership issue with my Hadoop,
> ZooKeeper, Accumulo. Does anyone have a Knowledgebase for this info
> that lays out a standard of what users should be created, where folders
> should be created, permissions, ownership, etc. I feel like that would
> be invaluable information for a newbie setting items up... or maybe I
> just tried to jump into something head first without being a Linux power
> user.
>
>
> On Wed, Mar 19, 2014 at 10:04 AM, Sean Busbey <busbey+lists@cloudera.com
> <ma...@cloudera.com>> wrote:
>
> Also, on the off chance that some other part of your system is
> exporting an incorrect HADOOP_CONF_DIR, you should still run this
> confirmation step from earlier:
>
> > You can verify this by doing
> >
> > ssh ${HOST} "bash -c 'echo ${HADOOP_CONF_DIR:-no hadoop conf}'"
> >
> > as the accumulo user on the master server, where HOST is the tserver.
>
> For the accumulo-env.sh you posted to impact things, the above
> command would have to result in the output "no hadoop conf".
>
> -Sean
>
>
> On Wed, Mar 19, 2014 at 9:01 AM, Sean Busbey
> <busbey+lists@cloudera.com <ma...@cloudera.com>> wrote:
>
> Josh is correct about the behavior of the ZooKeeper cli. As an
> aside, how big is this cluster? Five ZooKeeper servers shouldn't
> be needed until you get past ~100 nodes, unless you're just
> going for more fault tolerance.
>
> Could you update your gist with the changes to accumulo-env.sh?
> It's much easier to follow there.
>
> Could you also re-run the accumulo classpath command on the
> tserver after updating accumulo-env.sh across the cluster?
>
> We already know the proximal cause of the failure: the Hadoop
> configuration files aren't ending up in the classpath for the
> tabletservers. I can think of a few things that would show this
> in the tablet server logs, but you've already described hitting
> most of them.
>
> -Sean
>
>
>
> On Wed, Mar 19, 2014 at 8:27 AM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>> wrote:
>
> So, I am back to no clue now...
>
>
> On Wed, Mar 19, 2014 at 9:13 AM, Josh Elser
> <josh.elser@gmail.com <ma...@gmail.com>> wrote:
>
> I think by default zkCli.sh will just try to connect to
> localhost. You can change this by providing the quorum
> string to the script with the -server option.
>
> On Mar 19, 2014 8:29 AM, "Benjamin Parrish"
> <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>> wrote:
>
> I adjusted accumulo-env.sh to have hard coded values
> as seen below.
>
> Are there any logs that could shed some light on
> this issue?
>
> If it also helps I am using CentOS 6.5, Hadoop
> 2.2.0, ZooKeeper 3.4.6.
>
> I also ran across this, that didn't look right...
>
> Welcome to ZooKeeper!
> 2014-03-19 08:25:53,479 [myid:] - INFO
> [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening socket connection to server localhost/127.0.0.1:2181 <http://127.0.0.1:2181>. Will not attempt to authenticat
> e using SASL (unknown error)
> 2014-03-19 08:25:53,483 [myid:] - INFO
> [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket connection established to localhost/127.0.0.1:2181 <http://127.0.0.1:2181>, initiating session
> JLine support is enabled
> [zk: localhost:2181(CONNECTING) 0] 2014-03-19
> 08:25:53,523 [myid:] - INFO
> [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server localhost/127.0.
> 0.1:2181, sessionid = 0x144da4e00d90000, negotiated
> timeout = 30000
>
> should ZooKeeper try to hit localhost/127.0.0.1
> <http://127.0.0.1>?
>
> my zoo.cfg looks like this....
> tickTime=2000
> initLimit=10
> syncLimit=5
> dataDir=/usr/local/zookeeper/data
> clientPort=2181
> server.1=hadoop-node-1:2888:3888
> server.2=hadoop-node-2:2888:3888
> server.3=hadoop-node-3:2888:3888
> server.4=hadoop-node-4:2888:3888
> server.5=hadoop-node-5:2888:3888
>
>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
On Wed, Mar 19, 2014 at 1:32 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> Finally got it. Came down to a user and ownership issue with my Hadoop,
> ZooKeeper, Accumulo. Does anyone have a Knowledgebase for this info that
> lays out a standard of what users should be created, where folders should
> be created, permissions, ownership, etc. I feel like that would be
> invaluable information for a newbie setting items up... or maybe I just
> tried to jump into something head first without being a Linux power user.
>
>
>
I usually follow vendor installation guides because they cover these kinds
of integration issues.
-Sean
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
Finally got it. Came down to a user and ownership issue with my Hadoop,
ZooKeeper, Accumulo. Does anyone have a Knowledgebase for this info that
lays out a standard of what users should be created, where folders should
be created, permissions, ownership, etc. I feel like that would be
invaluable information for a newbie setting items up... or maybe I just
tried to jump into something head first without being a Linux power user.
On Wed, Mar 19, 2014 at 10:04 AM, Sean Busbey <bu...@cloudera.com>wrote:
> Also, on the off chance that some other part of your system is exporting
> an incorrect HADOOP_CONF_DIR, you should still run this confirmation step
> from earlier:
>
> > You can verify this by doing
> >
> > ssh ${HOST} "bash -c 'echo ${HADOOP_CONF_DIR:-no hadoop conf}'"
> >
> > as the accumulo user on the master server, where HOST is the tserver.
>
> For the accumulo-env.sh you posted to impact things, the above command
> would have to result in the output "no hadoop conf".
>
> -Sean
>
>
> On Wed, Mar 19, 2014 at 9:01 AM, Sean Busbey <bu...@cloudera.com>wrote:
>
>> Josh is correct about the behavior of the ZooKeeper cli. As an aside, how
>> big is this cluster? Five ZooKeeper servers shouldn't be needed until you
>> get past ~100 nodes, unless you're just going for more fault tolerance.
>>
>> Could you update your gist with the changes to accumulo-env.sh? It's much
>> easier to follow there.
>>
>> Could you also re-run the accumulo classpath command on the tserver after
>> updating accumulo-env.sh across the cluster?
>>
>> We already know the proximal cause of the failure: the Hadoop
>> configuration files aren't ending up in the classpath for the
>> tabletservers. I can think of a few things that would show this in the
>> tablet server logs, but you've already described hitting most of them.
>>
>> -Sean
>>
>>
>>
>> On Wed, Mar 19, 2014 at 8:27 AM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> So, I am back to no clue now...
>>>
>>>
>>> On Wed, Mar 19, 2014 at 9:13 AM, Josh Elser <jo...@gmail.com>wrote:
>>>
>>>> I think by default zkCli.sh will just try to connect to localhost. You
>>>> can change this by providing the quorum string to the script with the
>>>> -server option.
>>>> On Mar 19, 2014 8:29 AM, "Benjamin Parrish" <
>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>
>>>>> I adjusted accumulo-env.sh to have hard coded values as seen below.
>>>>>
>>>>> Are there any logs that could shed some light on this issue?
>>>>>
>>>>> If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.
>>>>>
>>>>> I also ran across this, that didn't look right...
>>>>>
>>>>> Welcome to ZooKeeper!
>>>>> 2014-03-19 08:25:53,479 [myid:] - INFO
>>>>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] -
>>>>> Opening socket connection to server localhost/127.0.0.1:2181. Will
>>>>> not attempt to authenticat
>>>>> e using SASL (unknown error)
>>>>> 2014-03-19 08:25:53,483 [myid:] - INFO
>>>>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket
>>>>> connection established to localhost/127.0.0.1:2181, initiating session
>>>>> JLine support is enabled
>>>>> [zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] -
>>>>> INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] -
>>>>> Session establishment complete on server localhost/127.0.
>>>>> 0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000
>>>>>
>>>>> should ZooKeeper try to hit localhost/127.0.0.1?
>>>>>
>>>>> my zoo.cfg looks like this....
>>>>> tickTime=2000
>>>>> initLimit=10
>>>>> syncLimit=5
>>>>> dataDir=/usr/local/zookeeper/data
>>>>> clientPort=2181
>>>>> server.1=hadoop-node-1:2888:3888
>>>>> server.2=hadoop-node-2:2888:3888
>>>>> server.3=hadoop-node-3:2888:3888
>>>>> server.4=hadoop-node-4:2888:3888
>>>>> server.5=hadoop-node-5:2888:3888
>>>>>
>>>>>
>>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
Also, on the off chance that some other part of your system is exporting an
incorrect HADOOP_CONF_DIR, you should still run this confirmation step from
earlier:
> You can verify this by doing
>
> ssh ${HOST} "bash -c 'echo ${HADOOP_CONF_DIR:-no hadoop conf}'"
>
> as the accumulo user on the master server, where HOST is the tserver.
For the accumulo-env.sh you posted to impact things, the above command
would have to result in the output "no hadoop conf".
-Sean
On Wed, Mar 19, 2014 at 9:01 AM, Sean Busbey <bu...@cloudera.com>wrote:
> Josh is correct about the behavior of the ZooKeeper cli. As an aside, how
> big is this cluster? Five ZooKeeper servers shouldn't be needed until you
> get past ~100 nodes, unless you're just going for more fault tolerance.
>
> Could you update your gist with the changes to accumulo-env.sh? It's much
> easier to follow there.
>
> Could you also re-run the accumulo classpath command on the tserver after
> updating accumulo-env.sh across the cluster?
>
> We already know the proximal cause of the failure: the Hadoop
> configuration files aren't ending up in the classpath for the
> tabletservers. I can think of a few things that would show this in the
> tablet server logs, but you've already described hitting most of them.
>
> -Sean
>
>
>
> On Wed, Mar 19, 2014 at 8:27 AM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> So, I am back to no clue now...
>>
>>
>> On Wed, Mar 19, 2014 at 9:13 AM, Josh Elser <jo...@gmail.com> wrote:
>>
>>> I think by default zkCli.sh will just try to connect to localhost. You
>>> can change this by providing the quorum string to the script with the
>>> -server option.
>>> On Mar 19, 2014 8:29 AM, "Benjamin Parrish" <
>>> benjamin.d.parrish@gmail.com> wrote:
>>>
>>>> I adjusted accumulo-env.sh to have hard coded values as seen below.
>>>>
>>>> Are there any logs that could shed some light on this issue?
>>>>
>>>> If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.
>>>>
>>>> I also ran across this, that didn't look right...
>>>>
>>>> Welcome to ZooKeeper!
>>>> 2014-03-19 08:25:53,479 [myid:] - INFO
>>>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening
>>>> socket connection to server localhost/127.0.0.1:2181. Will not attempt
>>>> to authenticat
>>>> e using SASL (unknown error)
>>>> 2014-03-19 08:25:53,483 [myid:] - INFO
>>>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket
>>>> connection established to localhost/127.0.0.1:2181, initiating session
>>>> JLine support is enabled
>>>> [zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] -
>>>> INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] -
>>>> Session establishment complete on server localhost/127.0.
>>>> 0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000
>>>>
>>>> should ZooKeeper try to hit localhost/127.0.0.1?
>>>>
>>>> my zoo.cfg looks like this....
>>>> tickTime=2000
>>>> initLimit=10
>>>> syncLimit=5
>>>> dataDir=/usr/local/zookeeper/data
>>>> clientPort=2181
>>>> server.1=hadoop-node-1:2888:3888
>>>> server.2=hadoop-node-2:2888:3888
>>>> server.3=hadoop-node-3:2888:3888
>>>> server.4=hadoop-node-4:2888:3888
>>>> server.5=hadoop-node-5:2888:3888
>>>>
>>>>
>
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
Josh is correct about the behavior of the ZooKeeper cli. As an aside, how
big is this cluster? Five ZooKeeper servers shouldn't be needed until you
get past ~100 nodes, unless you're just going for more fault tolerance.
Could you update your gist with the changes to accumulo-env.sh? It's much
easier to follow there.
Could you also re-run the accumulo classpath command on the tserver after
updating accumulo-env.sh across the cluster?
We already know the proximal cause of the failure: the Hadoop configuration
files aren't ending up in the classpath for the tabletservers. I can think
of a few things that would show this in the tablet server logs, but you've
already described hitting most of them.
-Sean
On Wed, Mar 19, 2014 at 8:27 AM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> So, I am back to no clue now...
>
>
> On Wed, Mar 19, 2014 at 9:13 AM, Josh Elser <jo...@gmail.com> wrote:
>
>> I think by default zkCli.sh will just try to connect to localhost. You
>> can change this by providing the quorum string to the script with the
>> -server option.
>> On Mar 19, 2014 8:29 AM, "Benjamin Parrish" <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> I adjusted accumulo-env.sh to have hard coded values as seen below.
>>>
>>> Are there any logs that could shed some light on this issue?
>>>
>>> If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.
>>>
>>> I also ran across this, that didn't look right...
>>>
>>> Welcome to ZooKeeper!
>>> 2014-03-19 08:25:53,479 [myid:] - INFO
>>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening
>>> socket connection to server localhost/127.0.0.1:2181. Will not attempt
>>> to authenticat
>>> e using SASL (unknown error)
>>> 2014-03-19 08:25:53,483 [myid:] - INFO
>>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket
>>> connection established to localhost/127.0.0.1:2181, initiating session
>>> JLine support is enabled
>>> [zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] -
>>> INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] -
>>> Session establishment complete on server localhost/127.0.
>>> 0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000
>>>
>>> should ZooKeeper try to hit localhost/127.0.0.1?
>>>
>>> my zoo.cfg looks like this....
>>> tickTime=2000
>>> initLimit=10
>>> syncLimit=5
>>> dataDir=/usr/local/zookeeper/data
>>> clientPort=2181
>>> server.1=hadoop-node-1:2888:3888
>>> server.2=hadoop-node-2:2888:3888
>>> server.3=hadoop-node-3:2888:3888
>>> server.4=hadoop-node-4:2888:3888
>>> server.5=hadoop-node-5:2888:3888
>>>
>>>
RE: Installing with Hadoop 2.2.0
Posted by "Ott, Charlie H." <CH...@leidos.com>.
Benjamin,
It may be better to step back for a second and make sure you have the Hadoop environment set up correctly. You are very close but it seems like there is just an issue with the Accumulo classpath or your environment variables.
In regard to ensuring zookeeper is working, you can use the Command line interface script "zkCli.sh" to connect. However, you need to specify which server zookeeper is running on.
# zkCli.sh -server <yourZooServer>
My setup is a bit different, but If you connect you should be able to do ls / and see what znodes are created in zookeeper. If the accumulo shell -init worked correctly, you should see something like this when you connect and run ls /accumulo:
[root@1620-Megatron bin]# ./zookeeper-client -server 1620-Megatron
Connecting to 1620-Megatron
2014-03-19 09:50:57,286 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.5-cdh4.5.0--1, built on 11/20/2013 22:29 GMT
2014-03-19 09:50:57,289 [myid:] - INFO [main:Environment@100] - Client environment:host.name=1620-Megatron
2014-03-19 09:50:57,290 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.7.0_45
2014-03-19 09:50:57,290 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation
2014-03-19 09:50:57,291 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/usr/java/jdk1.7.0_45/jre
2014-03-19 09:50:57,291 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../build/classes:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../build/lib/*.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../lib/slf4j-api-1.6.1.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../lib/netty-3.2.2.Final.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../lib/log4j-1.2.15.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../lib/jline-0.9.94.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../zookeeper-3.4.5-cdh4.5.0.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/lib/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf::/etc/zookeeper/conf:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/zookeeper/zookeeper-3.4.5-cdh4.5.0.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/zookeeper/lib/log4j-1.2.15.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/zookeeper/lib/jline-0.9.94.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/zookeeper/lib/slf4j-api-1.6.1.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/zookeeper/lib/netty-3.2.2.Final.jar:/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin/../lib/zookeeper/lib/slf4j-log4j12-1.6.1.jar
2014-03-19 09:50:57,292 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2014-03-19 09:50:57,292 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp
2014-03-19 09:50:57,293 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA>
2014-03-19 09:50:57,293 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux
2014-03-19 09:50:57,294 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=amd64
2014-03-19 09:50:57,294 [myid:] - INFO [main:Environment@100] - Client environment:os.version=2.6.32-431.el6.x86_64
2014-03-19 09:50:57,295 [myid:] - INFO [main:Environment@100] - Client environment:user.name=root
2014-03-19 09:50:57,295 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/root
2014-03-19 09:50:57,295 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/opt/cloudera/parcels/CDH-4.5.0-1.cdh4.5.0.p0.30/bin
2014-03-19 09:50:57,297 [myid:] - INFO [main:ZooKeeper@438] - Initiating client connection, connectString=1620-Megatron sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@40e51e67
Welcome to ZooKeeper!
2014-03-19 09:50:57,319 [myid:] - INFO [main-SendThread(1620-Megatron:2181):ClientCnxn$SendThread@966] - Opening socket connection to server 1620-Megatron/10.35.56.87:2181. Will not attempt to authenticate using SASL (unknown error)
2014-03-19 09:50:57,324 [myid:] - INFO [main-SendThread(1620-Megatron:2181):ClientCnxn$SendThread@849] - Socket connection established to 1620-Megatron /10.35.56.87:2181, initiating session
JLine support is enabled
[zk: 1620-Megatron(CONNECTING) 0] 2014-03-19 09:50:57,360 [myid:] - INFO [main-SendThread(1620-Megatron:2181):ClientCnxn$SendThread@1207] - Session establishment complete on server 1620-Megatron /10.35.56.87:2181, sessionid = 0x244d57a1c511db9, negotiated timeout = 30000
WATCHER::
WatchedEvent state:SyncConnected type:None path:null
[zk: 1620-Megatron(CONNECTED) 0] ls /
[accumulo, zookeeper]
[zk: 1620-Megatron(CONNECTED) 1] ls /accumulo
[a85286bf-031c-4e24-9b47-f6aca34401b8, a531e027-6154-47ec-8b0e-eebf20a9a902, instances, ec960eed-e05f-448c-b417-74620a242764, 1b491f7e-d2a2-4353-a691-fdcab06592bd, 675bbabc-0e0d-4ae1-9de0-0dba3cd4d1f0]
If you are able to see that there is an /accumulo node, then you're accumulo init probably worked fine. Then you need to make sure the accumulo-env.sh is defining the correct paths to the Hadoop settings. Remember that the slaves running tablet servers must be setup the same, and ensure passwordless ssh is working for the account you are running start-all.sh.
Hope this helps.
From: user-return-3911-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3911-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Benjamin Parrish
Sent: Wednesday, March 19, 2014 9:28 AM
To: user@accumulo.apache.org
Subject: Re: Installing with Hadoop 2.2.0
So, I am back to no clue now...
On Wed, Mar 19, 2014 at 9:13 AM, Josh Elser <jo...@gmail.com>> wrote:
I think by default zkCli.sh will just try to connect to localhost. You can change this by providing the quorum string to the script with the -server option.
On Mar 19, 2014 8:29 AM, "Benjamin Parrish" <be...@gmail.com>> wrote:
I adjusted accumulo-env.sh to have hard coded values as seen below.
Are there any logs that could shed some light on this issue?
If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.
I also ran across this, that didn't look right...
Welcome to ZooKeeper!
2014-03-19 08:25:53,479 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening socket connection to server localhost/127.0.0.1:2181<http://127.0.0.1:2181>. Will not attempt to authenticat
e using SASL (unknown error)
2014-03-19 08:25:53,483 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket connection established to localhost/127.0.0.1:2181<http://127.0.0.1:2181>, initiating session
JLine support is enabled
[zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] - INFO [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server localhost/127.0.
0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000
should ZooKeeper try to hit localhost/127.0.0.1<http://127.0.0.1>?
my zoo.cfg looks like this....
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/usr/local/zookeeper/data
clientPort=2181
server.1=hadoop-node-1:2888:3888
server.2=hadoop-node-2:2888:3888
server.3=hadoop-node-3:2888:3888
server.4=hadoop-node-4:2888:3888
server.5=hadoop-node-5:2888:3888
#! /usr/bin/env bash
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
###
### Configure these environment variables to point to your local installations.
###
### The functional tests require conditional values, so keep this style:
###
### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
###
###
### Note that the -Xmx -Xms settings below require substantial free memory:
### you may want to use smaller values, especially when running everything
### on a single machine.
###
if [ -z "$HADOOP_HOME" ]
then
test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
else
HADOOP_PREFIX="$HADOOP_HOME"
unset HADOOP_HOME
fi
# test -z "$HADOOP_CONF_DIR" && export HADOOP_CONF_DIR="/usr/local/hadoop/conf"
# hadoop-2.0:
test -z "$HADOOP_CONF_DIR" && export HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
#! /usr/bin/env bash
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
###
### Configure these environment variables to point to your local installations.
###
### The functional tests require conditional values, so keep this style:
###
### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
###
###
### Note that the -Xmx -Xms settings below require substantial free memory:
### you may want to use smaller values, especially when running everything
### on a single machine.
###
if [ -z "$HADOOP_HOME" ]
then
test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
else
HADOOP_PREFIX="$HADOOP_HOME"
unset HADOOP_HOME
fi
# test -z "$HADOOP_CONF_DIR" && export HADOOP_CONF_DIR="/usr/local/hadoop/conf"
# hadoop-2.0:
test -z "$HADOOP_CONF_DIR" && export HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
test -z "$JAVA_HOME" && export JAVA_HOME=/usr/lib/jvm/jdk1.7.0
test -z "$ZOOKEEPER_HOME" && export ZOOKEEPER_HOME=/usr/local/zookeeper
test -z "$ACCUMULO_LOG_DIR" && export ACCUMULO_LOG_DIR=/usr/local/accumulo/logs
if [ -f /usr/local/accumulo/conf/accumulo.policy ]
then
POLICY="-Djava.security.manager -Djava.security.policy=/usr/local/accumulo/conf/accumulo.policy"
fi
test -z "$ACCUMULO_TSERVER_OPTS" && export ACCUMULO_TSERVER_OPTS="${POLICY} -Xmx1g -Xms1g -XX:NewSize=500m -XX:MaxNewSize=500m "
test -z "$ACCUMULO_MASTER_OPTS" && export ACCUMULO_MASTER_OPTS="${POLICY} -Xmx1g -Xms1g"
test -z "$ACCUMULO_MONITOR_OPTS" && export ACCUMULO_MONITOR_OPTS="${POLICY} -Xmx1g -Xms256m"
test -z "$ACCUMULO_GC_OPTS" && export ACCUMULO_GC_OPTS="-Xmx256m -Xms256m"
test -z "$ACCUMULO_GENERAL_OPTS" && export ACCUMULO_GENERAL_OPTS="-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -Djava.net.preferIPv4Stack=true"
test -z "$ACCUMULO_OTHER_OPTS" && export ACCUMULO_OTHER_OPTS="-Xmx1g -Xms256m"
# what do when the JVM runs out of heap memory
export ACCUMULO_KILL_CMD='kill -9 %p'
# Should the monitor bind to all network interfaces -- default: false
# export ACCUMULO_MONITOR_BIND_ALL="true"
On Tue, Mar 18, 2014 at 8:58 PM, Sean Busbey <bu...@cloudera.com>> wrote:
On Mar 18, 2014 7:51 PM, "Benjamin Parrish" <be...@gmail.com>> wrote:
>
> HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all ~/.bash_profile files as needed.
>
>
Can you add to the gist the output of running
$> find $HADOOP_CONF_DIR
As the user who runs the tablet server on the same host you ran the classpath command on?
-Sean
--
Benjamin D. Parrish
H: 540-597-7860<tel:540-597-7860>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
So, I am back to no clue now...
On Wed, Mar 19, 2014 at 9:13 AM, Josh Elser <jo...@gmail.com> wrote:
> I think by default zkCli.sh will just try to connect to localhost. You can
> change this by providing the quorum string to the script with the -server
> option.
> On Mar 19, 2014 8:29 AM, "Benjamin Parrish" <be...@gmail.com>
> wrote:
>
>> I adjusted accumulo-env.sh to have hard coded values as seen below.
>>
>> Are there any logs that could shed some light on this issue?
>>
>> If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.
>>
>> I also ran across this, that didn't look right...
>>
>> Welcome to ZooKeeper!
>> 2014-03-19 08:25:53,479 [myid:] - INFO
>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening
>> socket connection to server localhost/127.0.0.1:2181. Will not attempt
>> to authenticat
>> e using SASL (unknown error)
>> 2014-03-19 08:25:53,483 [myid:] - INFO
>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket
>> connection established to localhost/127.0.0.1:2181, initiating session
>> JLine support is enabled
>> [zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] - INFO
>> [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] - Session
>> establishment complete on server localhost/127.0.
>> 0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000
>>
>> should ZooKeeper try to hit localhost/127.0.0.1?
>>
>> my zoo.cfg looks like this....
>> tickTime=2000
>> initLimit=10
>> syncLimit=5
>> dataDir=/usr/local/zookeeper/data
>> clientPort=2181
>> server.1=hadoop-node-1:2888:3888
>> server.2=hadoop-node-2:2888:3888
>> server.3=hadoop-node-3:2888:3888
>> server.4=hadoop-node-4:2888:3888
>> server.5=hadoop-node-5:2888:3888
>>
>> #! /usr/bin/env bash
>>
>> # Licensed to the Apache Software Foundation (ASF) under one or more
>> # contributor license agreements. See the NOTICE file distributed with
>> # this work for additional information regarding copyright ownership.
>> # The ASF licenses this file to You under the Apache License, Version 2.0
>> # (the "License"); you may not use this file except in compliance with
>> # the License. You may obtain a copy of the License at
>> #
>> # http://www.apache.org/licenses/LICENSE-2.0
>> #
>> # Unless required by applicable law or agreed to in writing, software
>> # distributed under the License is distributed on an "AS IS" BASIS,
>> # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
>> # See the License for the specific language governing permissions and
>> # limitations under the License.
>>
>> ###
>> ### Configure these environment variables to point to your local
>> installations.
>> ###
>> ### The functional tests require conditional values, so keep this style:
>> ###
>> ### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
>> ###
>> ###
>> ### Note that the -Xmx -Xms settings below require substantial free
>> memory:
>> ### you may want to use smaller values, especially when running everything
>> ### on a single machine.
>> ###
>> if [ -z "$HADOOP_HOME" ]
>> then
>> test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
>> else
>> HADOOP_PREFIX="$HADOOP_HOME"
>> unset HADOOP_HOME
>> fi
>> # test -z "$HADOOP_CONF_DIR" && export
>> HADOOP_CONF_DIR="/usr/local/hadoop/conf"
>> # hadoop-2.0:
>> test -z "$HADOOP_CONF_DIR" && export
>> HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
>>
>> #! /usr/bin/env bash
>>
>> # Licensed to the Apache Software Foundation (ASF) under one or more
>> # contributor license agreements. See the NOTICE file distributed with
>> # this work for additional information regarding copyright ownership.
>> # The ASF licenses this file to You under the Apache License, Version 2.0
>> # (the "License"); you may not use this file except in compliance with
>> # the License. You may obtain a copy of the License at
>> #
>> # http://www.apache.org/licenses/LICENSE-2.0
>> #
>> # Unless required by applicable law or agreed to in writing, software
>> # distributed under the License is distributed on an "AS IS" BASIS,
>> # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
>> # See the License for the specific language governing permissions and
>> # limitations under the License.
>>
>> ###
>> ### Configure these environment variables to point to your local
>> installations.
>> ###
>> ### The functional tests require conditional values, so keep this style:
>> ###
>> ### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
>> ###
>> ###
>> ### Note that the -Xmx -Xms settings below require substantial free
>> memory:
>> ### you may want to use smaller values, especially when running everything
>> ### on a single machine.
>> ###
>> if [ -z "$HADOOP_HOME" ]
>> then
>> test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
>> else
>> HADOOP_PREFIX="$HADOOP_HOME"
>> unset HADOOP_HOME
>> fi
>> # test -z "$HADOOP_CONF_DIR" && export
>> HADOOP_CONF_DIR="/usr/local/hadoop/conf"
>> # hadoop-2.0:
>> test -z "$HADOOP_CONF_DIR" && export
>> HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
>>
>> test -z "$JAVA_HOME" && export JAVA_HOME=/usr/lib/jvm/jdk1.7.0
>> test -z "$ZOOKEEPER_HOME" && export
>> ZOOKEEPER_HOME=/usr/local/zookeeper
>> test -z "$ACCUMULO_LOG_DIR" && export
>> ACCUMULO_LOG_DIR=/usr/local/accumulo/logs
>> if [ -f /usr/local/accumulo/conf/accumulo.policy ]
>> then
>> POLICY="-Djava.security.manager
>> -Djava.security.policy=/usr/local/accumulo/conf/accumulo.policy"
>> fi
>> test -z "$ACCUMULO_TSERVER_OPTS" && export
>> ACCUMULO_TSERVER_OPTS="${POLICY} -Xmx1g -Xms1g -XX:NewSize=500m
>> -XX:MaxNewSize=500m "
>> test -z "$ACCUMULO_MASTER_OPTS" && export
>> ACCUMULO_MASTER_OPTS="${POLICY} -Xmx1g -Xms1g"
>> test -z "$ACCUMULO_MONITOR_OPTS" && export
>> ACCUMULO_MONITOR_OPTS="${POLICY} -Xmx1g -Xms256m"
>> test -z "$ACCUMULO_GC_OPTS" && export ACCUMULO_GC_OPTS="-Xmx256m
>> -Xms256m"
>> test -z "$ACCUMULO_GENERAL_OPTS" && export
>> ACCUMULO_GENERAL_OPTS="-XX:+UseConcMarkSweepGC
>> -XX:CMSInitiatingOccupancyFraction=75 -Djava.net.preferIPv4Stack=true"
>> test -z "$ACCUMULO_OTHER_OPTS" && export ACCUMULO_OTHER_OPTS="-Xmx1g
>> -Xms256m"
>> # what do when the JVM runs out of heap memory
>> export ACCUMULO_KILL_CMD='kill -9 %p'
>>
>> # Should the monitor bind to all network interfaces -- default: false
>> # export ACCUMULO_MONITOR_BIND_ALL="true"
>>
>>
>> On Tue, Mar 18, 2014 at 8:58 PM, Sean Busbey <bu...@cloudera.com>wrote:
>>
>>>
>>> On Mar 18, 2014 7:51 PM, "Benjamin Parrish" <
>>> benjamin.d.parrish@gmail.com> wrote:
>>> >
>>> > HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all
>>> ~/.bash_profile files as needed.
>>> >
>>> >
>>>
>>> Can you add to the gist the output of running
>>>
>>> $> find $HADOOP_CONF_DIR
>>>
>>> As the user who runs the tablet server on the same host you ran the
>>> classpath command on?
>>>
>>> -Sean
>>>
>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Josh Elser <jo...@gmail.com>.
I think by default zkCli.sh will just try to connect to localhost. You can
change this by providing the quorum string to the script with the -server
option.
On Mar 19, 2014 8:29 AM, "Benjamin Parrish" <be...@gmail.com>
wrote:
> I adjusted accumulo-env.sh to have hard coded values as seen below.
>
> Are there any logs that could shed some light on this issue?
>
> If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.
>
> I also ran across this, that didn't look right...
>
> Welcome to ZooKeeper!
> 2014-03-19 08:25:53,479 [myid:] - INFO
> [main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening
> socket connection to server localhost/127.0.0.1:2181. Will not attempt to
> authenticat
> e using SASL (unknown error)
> 2014-03-19 08:25:53,483 [myid:] - INFO
> [main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket
> connection established to localhost/127.0.0.1:2181, initiating session
> JLine support is enabled
> [zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] - INFO
> [main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] - Session
> establishment complete on server localhost/127.0.
> 0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000
>
> should ZooKeeper try to hit localhost/127.0.0.1?
>
> my zoo.cfg looks like this....
> tickTime=2000
> initLimit=10
> syncLimit=5
> dataDir=/usr/local/zookeeper/data
> clientPort=2181
> server.1=hadoop-node-1:2888:3888
> server.2=hadoop-node-2:2888:3888
> server.3=hadoop-node-3:2888:3888
> server.4=hadoop-node-4:2888:3888
> server.5=hadoop-node-5:2888:3888
>
> #! /usr/bin/env bash
>
> # Licensed to the Apache Software Foundation (ASF) under one or more
> # contributor license agreements. See the NOTICE file distributed with
> # this work for additional information regarding copyright ownership.
> # The ASF licenses this file to You under the Apache License, Version 2.0
> # (the "License"); you may not use this file except in compliance with
> # the License. You may obtain a copy of the License at
> #
> # http://www.apache.org/licenses/LICENSE-2.0
> #
> # Unless required by applicable law or agreed to in writing, software
> # distributed under the License is distributed on an "AS IS" BASIS,
> # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
> # See the License for the specific language governing permissions and
> # limitations under the License.
>
> ###
> ### Configure these environment variables to point to your local
> installations.
> ###
> ### The functional tests require conditional values, so keep this style:
> ###
> ### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
> ###
> ###
> ### Note that the -Xmx -Xms settings below require substantial free memory:
> ### you may want to use smaller values, especially when running everything
> ### on a single machine.
> ###
> if [ -z "$HADOOP_HOME" ]
> then
> test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
> else
> HADOOP_PREFIX="$HADOOP_HOME"
> unset HADOOP_HOME
> fi
> # test -z "$HADOOP_CONF_DIR" && export
> HADOOP_CONF_DIR="/usr/local/hadoop/conf"
> # hadoop-2.0:
> test -z "$HADOOP_CONF_DIR" && export
> HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
>
> #! /usr/bin/env bash
>
> # Licensed to the Apache Software Foundation (ASF) under one or more
> # contributor license agreements. See the NOTICE file distributed with
> # this work for additional information regarding copyright ownership.
> # The ASF licenses this file to You under the Apache License, Version 2.0
> # (the "License"); you may not use this file except in compliance with
> # the License. You may obtain a copy of the License at
> #
> # http://www.apache.org/licenses/LICENSE-2.0
> #
> # Unless required by applicable law or agreed to in writing, software
> # distributed under the License is distributed on an "AS IS" BASIS,
> # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
> # See the License for the specific language governing permissions and
> # limitations under the License.
>
> ###
> ### Configure these environment variables to point to your local
> installations.
> ###
> ### The functional tests require conditional values, so keep this style:
> ###
> ### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
> ###
> ###
> ### Note that the -Xmx -Xms settings below require substantial free memory:
> ### you may want to use smaller values, especially when running everything
> ### on a single machine.
> ###
> if [ -z "$HADOOP_HOME" ]
> then
> test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
> else
> HADOOP_PREFIX="$HADOOP_HOME"
> unset HADOOP_HOME
> fi
> # test -z "$HADOOP_CONF_DIR" && export
> HADOOP_CONF_DIR="/usr/local/hadoop/conf"
> # hadoop-2.0:
> test -z "$HADOOP_CONF_DIR" && export
> HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
>
> test -z "$JAVA_HOME" && export JAVA_HOME=/usr/lib/jvm/jdk1.7.0
> test -z "$ZOOKEEPER_HOME" && export
> ZOOKEEPER_HOME=/usr/local/zookeeper
> test -z "$ACCUMULO_LOG_DIR" && export
> ACCUMULO_LOG_DIR=/usr/local/accumulo/logs
> if [ -f /usr/local/accumulo/conf/accumulo.policy ]
> then
> POLICY="-Djava.security.manager
> -Djava.security.policy=/usr/local/accumulo/conf/accumulo.policy"
> fi
> test -z "$ACCUMULO_TSERVER_OPTS" && export
> ACCUMULO_TSERVER_OPTS="${POLICY} -Xmx1g -Xms1g -XX:NewSize=500m
> -XX:MaxNewSize=500m "
> test -z "$ACCUMULO_MASTER_OPTS" && export ACCUMULO_MASTER_OPTS="${POLICY}
> -Xmx1g -Xms1g"
> test -z "$ACCUMULO_MONITOR_OPTS" && export
> ACCUMULO_MONITOR_OPTS="${POLICY} -Xmx1g -Xms256m"
> test -z "$ACCUMULO_GC_OPTS" && export ACCUMULO_GC_OPTS="-Xmx256m
> -Xms256m"
> test -z "$ACCUMULO_GENERAL_OPTS" && export
> ACCUMULO_GENERAL_OPTS="-XX:+UseConcMarkSweepGC
> -XX:CMSInitiatingOccupancyFraction=75 -Djava.net.preferIPv4Stack=true"
> test -z "$ACCUMULO_OTHER_OPTS" && export ACCUMULO_OTHER_OPTS="-Xmx1g
> -Xms256m"
> # what do when the JVM runs out of heap memory
> export ACCUMULO_KILL_CMD='kill -9 %p'
>
> # Should the monitor bind to all network interfaces -- default: false
> # export ACCUMULO_MONITOR_BIND_ALL="true"
>
>
> On Tue, Mar 18, 2014 at 8:58 PM, Sean Busbey <bu...@cloudera.com>wrote:
>
>>
>> On Mar 18, 2014 7:51 PM, "Benjamin Parrish" <be...@gmail.com>
>> wrote:
>> >
>> > HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all
>> ~/.bash_profile files as needed.
>> >
>> >
>>
>> Can you add to the gist the output of running
>>
>> $> find $HADOOP_CONF_DIR
>>
>> As the user who runs the tablet server on the same host you ran the
>> classpath command on?
>>
>> -Sean
>>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
I adjusted accumulo-env.sh to have hard coded values as seen below.
Are there any logs that could shed some light on this issue?
If it also helps I am using CentOS 6.5, Hadoop 2.2.0, ZooKeeper 3.4.6.
I also ran across this, that didn't look right...
Welcome to ZooKeeper!
2014-03-19 08:25:53,479 [myid:] - INFO
[main-SendThread(localhost:2181):ClientCnxn$SendThread@975] - Opening
socket connection to server localhost/127.0.0.1:2181. Will not attempt to
authenticat
e using SASL (unknown error)
2014-03-19 08:25:53,483 [myid:] - INFO
[main-SendThread(localhost:2181):ClientCnxn$SendThread@852] - Socket
connection established to localhost/127.0.0.1:2181, initiating session
JLine support is enabled
[zk: localhost:2181(CONNECTING) 0] 2014-03-19 08:25:53,523 [myid:] - INFO
[main-SendThread(localhost:2181):ClientCnxn$SendThread@1235] - Session
establishment complete on server localhost/127.0.
0.1:2181, sessionid = 0x144da4e00d90000, negotiated timeout = 30000
should ZooKeeper try to hit localhost/127.0.0.1?
my zoo.cfg looks like this....
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/usr/local/zookeeper/data
clientPort=2181
server.1=hadoop-node-1:2888:3888
server.2=hadoop-node-2:2888:3888
server.3=hadoop-node-3:2888:3888
server.4=hadoop-node-4:2888:3888
server.5=hadoop-node-5:2888:3888
#! /usr/bin/env bash
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
###
### Configure these environment variables to point to your local
installations.
###
### The functional tests require conditional values, so keep this style:
###
### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
###
###
### Note that the -Xmx -Xms settings below require substantial free memory:
### you may want to use smaller values, especially when running everything
### on a single machine.
###
if [ -z "$HADOOP_HOME" ]
then
test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
else
HADOOP_PREFIX="$HADOOP_HOME"
unset HADOOP_HOME
fi
# test -z "$HADOOP_CONF_DIR" && export
HADOOP_CONF_DIR="/usr/local/hadoop/conf"
# hadoop-2.0:
test -z "$HADOOP_CONF_DIR" && export
HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
#! /usr/bin/env bash
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
###
### Configure these environment variables to point to your local
installations.
###
### The functional tests require conditional values, so keep this style:
###
### test -z "$JAVA_HOME" && export JAVA_HOME=/usr/local/lib/jdk-1.6.0
###
###
### Note that the -Xmx -Xms settings below require substantial free memory:
### you may want to use smaller values, especially when running everything
### on a single machine.
###
if [ -z "$HADOOP_HOME" ]
then
test -z "$HADOOP_PREFIX" && export HADOOP_PREFIX=/usr/local/hadoop
else
HADOOP_PREFIX="$HADOOP_HOME"
unset HADOOP_HOME
fi
# test -z "$HADOOP_CONF_DIR" && export
HADOOP_CONF_DIR="/usr/local/hadoop/conf"
# hadoop-2.0:
test -z "$HADOOP_CONF_DIR" && export
HADOOP_CONF_DIR="/usr/local/hadoop/etc/hadoop"
test -z "$JAVA_HOME" && export JAVA_HOME=/usr/lib/jvm/jdk1.7.0
test -z "$ZOOKEEPER_HOME" && export
ZOOKEEPER_HOME=/usr/local/zookeeper
test -z "$ACCUMULO_LOG_DIR" && export
ACCUMULO_LOG_DIR=/usr/local/accumulo/logs
if [ -f /usr/local/accumulo/conf/accumulo.policy ]
then
POLICY="-Djava.security.manager
-Djava.security.policy=/usr/local/accumulo/conf/accumulo.policy"
fi
test -z "$ACCUMULO_TSERVER_OPTS" && export ACCUMULO_TSERVER_OPTS="${POLICY}
-Xmx1g -Xms1g -XX:NewSize=500m -XX:MaxNewSize=500m "
test -z "$ACCUMULO_MASTER_OPTS" && export ACCUMULO_MASTER_OPTS="${POLICY}
-Xmx1g -Xms1g"
test -z "$ACCUMULO_MONITOR_OPTS" && export ACCUMULO_MONITOR_OPTS="${POLICY}
-Xmx1g -Xms256m"
test -z "$ACCUMULO_GC_OPTS" && export ACCUMULO_GC_OPTS="-Xmx256m
-Xms256m"
test -z "$ACCUMULO_GENERAL_OPTS" && export
ACCUMULO_GENERAL_OPTS="-XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75 -Djava.net.preferIPv4Stack=true"
test -z "$ACCUMULO_OTHER_OPTS" && export ACCUMULO_OTHER_OPTS="-Xmx1g
-Xms256m"
# what do when the JVM runs out of heap memory
export ACCUMULO_KILL_CMD='kill -9 %p'
# Should the monitor bind to all network interfaces -- default: false
# export ACCUMULO_MONITOR_BIND_ALL="true"
On Tue, Mar 18, 2014 at 8:58 PM, Sean Busbey <bu...@cloudera.com>wrote:
>
> On Mar 18, 2014 7:51 PM, "Benjamin Parrish" <be...@gmail.com>
> wrote:
> >
> > HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all
> ~/.bash_profile files as needed.
> >
> >
>
> Can you add to the gist the output of running
>
> $> find $HADOOP_CONF_DIR
>
> As the user who runs the tablet server on the same host you ran the
> classpath command on?
>
> -Sean
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
On Tue, Mar 18, 2014 at 7:58 PM, Sean Busbey <bu...@cloudera.com>wrote:
>
> On Mar 18, 2014 7:51 PM, "Benjamin Parrish" <be...@gmail.com>
> wrote:
> >
> > HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all
> ~/.bash_profile files as needed.
> >
> >
>
> Can you add to the gist the output of running
>
> $> find $HADOOP_CONF_DIR
>
> As the user who runs the tablet server on the same host you ran the
> classpath command on?
>
Ah! the problem is that you're using .bash_profile to set up the env.
bash_profile is only used for login shells.
Presuming you use the provided $ACCUMULO_HOME/bin/start-all.sh, it does not
use login shells when starting the remote processes.
You can verify this by doing
ssh ${HOST} "bash -c 'echo ${HADOOP_CONF_DIR:-no hadoop conf}'"
as the accumulo user on the master server, where HOST is the tserver.
You can fix this by either setting up the env for non-login (and pref
non-interactive) shells or by making sure your accumulo-env.sh properly
defaults to the right place.
-Sean
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
On Mar 18, 2014 7:51 PM, "Benjamin Parrish" <be...@gmail.com>
wrote:
>
> HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all
~/.bash_profile files as needed.
>
>
Can you add to the gist the output of running
$> find $HADOOP_CONF_DIR
As the user who runs the tablet server on the same host you ran the
classpath command on?
-Sean
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
HADOOP_CONF_DIR=/usr/local/hadoop/etc/hadoop is set in all ~/.bash_profile
files as needed.
On Tue, Mar 18, 2014 at 3:21 PM, Ott, Charlie H.
<CH...@leidos.com>wrote:
> I am not sure if Benjamin is using Cloudera Manager or if he is using
> the Apache Distribution.
>
> However, I thought it might help to see the two files and configurations
> that should be focused on in regard to making Hadoop jars available to
> accumulo.
>
>
>
> From what it sounds like, it would seem that either the firewall is
> blocking communication with the tablet servers, or the hosts that have
> Accumulo tablets (slaves) do not have Hadoop client configuration setup
> properly. I would make sure the user account for the tserver process can
> see the exact same filesystem as the master where the shell init was run.
> I have seen 'hadoop fs -ls' actually show the local linux filesystem when
> the /etc/hadoop/hdfs-site.xml and mapred-site.xml are not configured
> properly.
>
>
>
>
>
>
>
> *From:* user-return-3902-CHARLES.H.OTT=leidos.com@accumulo.apache.org[mailto:
> user-return-3902-CHARLES.H.OTT=leidos.com@accumulo.apache.org] *On Behalf
> Of *Sean Busbey
> *Sent:* Tuesday, March 18, 2014 3:04 PM
>
> *To:* Accumulo User List
> *Subject:* Re: Installing with Hadoop 2.2.0
>
>
>
>
>
> On Tue, Mar 18, 2014 at 1:37 PM, Ott, Charlie H. <CH...@leidos.com>
> wrote:
>
> I posted my config here:
> http://championofcyrodiil.blogspot.com/2014/03/installing-accumulo-150-on-cloudera.html
>
>
>
>
>
>
>
> Hi Charlie!
>
>
>
> Do you mean Benjamin is using this same configuration? From his previous
> postings I thought he was using the Apache Hadoop 2.2.0 release and not a
> vendor specific repackaging.
>
>
>
> -Sean
>
--
Benjamin D. Parrish
H: 540-597-7860
RE: Installing with Hadoop 2.2.0
Posted by "Ott, Charlie H." <CH...@leidos.com>.
I am not sure if Benjamin is using Cloudera Manager or if he is using the Apache Distribution.
However, I thought it might help to see the two files and configurations that should be focused on in regard to making Hadoop jars available to accumulo.
From what it sounds like, it would seem that either the firewall is blocking communication with the tablet servers, or the hosts that have Accumulo tablets (slaves) do not have Hadoop client configuration setup properly. I would make sure the user account for the tserver process can see the exact same filesystem as the master where the shell init was run. I have seen ‘hadoop fs -ls’ actually show the local linux filesystem when the /etc/hadoop/hdfs-site.xml and mapred-site.xml are not configured properly.
From: user-return-3902-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3902-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Sean Busbey
Sent: Tuesday, March 18, 2014 3:04 PM
To: Accumulo User List
Subject: Re: Installing with Hadoop 2.2.0
On Tue, Mar 18, 2014 at 1:37 PM, Ott, Charlie H. <CH...@leidos.com>> wrote:
I posted my config here: http://championofcyrodiil.blogspot.com/2014/03/installing-accumulo-150-on-cloudera.html
Hi Charlie!
Do you mean Benjamin is using this same configuration? From his previous postings I thought he was using the Apache Hadoop 2.2.0 release and not a vendor specific repackaging.
-Sean
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
On Tue, Mar 18, 2014 at 1:37 PM, Ott, Charlie H.
<CH...@leidos.com>wrote:
> I posted my config here:
> http://championofcyrodiil.blogspot.com/2014/03/installing-accumulo-150-on-cloudera.html
>
>
>
>
>
Hi Charlie!
Do you mean Benjamin is using this same configuration? From his previous
postings I thought he was using the Apache Hadoop 2.2.0 release and not a
vendor specific repackaging.
-Sean
RE: Installing with Hadoop 2.2.0
Posted by "Ott, Charlie H." <CH...@leidos.com>.
I posted my config here: http://championofcyrodiil.blogspot.com/2014/03/installing-accumulo-150-on-cloudera.html
From: user-return-3900-CHARLES.H.OTT=leidos.com@accumulo.apache.org [mailto:user-return-3900-CHARLES.H.OTT=leidos.com@accumulo.apache.org] On Behalf Of Sean Busbey
Sent: Tuesday, March 18, 2014 2:34 PM
To: Accumulo User List
Subject: Re: Installing with Hadoop 2.2.0
It's curious that some of the Accumulo jars show up multiple times, but probably not related.
I don't see any plausible HADOOP_CONF_DIR candidates in that list.
Given your previous messages, I would expect
file:/usr/local/hadoop/etc/hadoop/
if you go to the tserver host and become the user that runs Accumulo, is HADOOP_CONF_DIR exported?
Does the hadoop conf dir exist on that host in that location?
On Tue, Mar 18, 2014 at 1:19 PM, Benjamin Parrish <be...@gmail.com>> wrote:
Updated...
https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
On Tue, Mar 18, 2014 at 1:59 PM, Sean Busbey <bu...@cloudera.com>> wrote:
Could you add to your gist the output of
$> $ACCUMULO_HOME/bin/accumulo classpath
on one of the tablet server?
On Tue, Mar 18, 2014 at 12:49 PM, Benjamin Parrish <be...@gmail.com>> wrote:
There is, but that error that says there isn't is from the Tablet Server logs. That is the correct dirrectory...Hadoop 2.2.0 does not have a conf directory like previously. The core-site.xml, et. al. are in etc/hadoop/*.
On Tue, Mar 18, 2014 at 1:42 PM, Billie Rinaldi <bi...@gmail.com>> wrote:
The accumulo init output looks OK. You're saying that there is no /accumulo directory in HDFS after that command is run? What does your accumulo-env.sh file look like? It appears to be using a default value for the hadoop conf dir ($HADOOP_PREFIX/etc/hadoop); is that value correct for your setup?
On Tue, Mar 18, 2014 at 9:32 AM, Benjamin Parrish <be...@gmail.com>> wrote:
Results are located here...
https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi <bi...@gmail.com>> wrote:
On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <be...@gmail.com>> wrote:
I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
1) I start with accumulo init and everything runs through just fine, but I can find '/accumulo' using 'hadoop fs -ls /'
If /accumulo doesn't exist, then accumulo init did not complete successfully. (Unless the accumulo directory was set to something else, but that did not appear to be the case in your site configuration file.) Would you happen to have the output of the accumulo init command?
2) I try to run 'accumulo shell -u root' and it says that that Hadoop and ZooKeeper are not started, but if I run 'jps' on the each cluster node it shows all the necessary processes for both in the JVM. Is there something I am missing?
--
Benjamin D. Parrish
H: 540-597-7860<tel:540-597-7860>
--
Benjamin D. Parrish
H: 540-597-7860<tel:540-597-7860>
--
Benjamin D. Parrish
H: 540-597-7860<tel:540-597-7860>
--
Benjamin D. Parrish
H: 540-597-7860<tel:540-597-7860>
Re: Installing with Hadoop 2.2.0
Posted by Josh Elser <jo...@gmail.com>.
Yes! -- check your environment for what Sean said.
Make sure accumulo-env.sh is properly exporting HADOOP_CONF_DIR. There
are some hints in the example configs (assuming you started there) that
have some blocks to switch over when using hadoop-2 (comments will guide
you).
On 3/18/14, 2:34 PM, Sean Busbey wrote:
> It's curious that some of the Accumulo jars show up multiple times, but
> probably not related.
>
> I don't see any plausible HADOOP_CONF_DIR candidates in that list.
>
> Given your previous messages, I would expect
>
> file:/usr/local/hadoop/etc/hadoop/
>
> if you go to the tserver host and become the user that runs Accumulo, is
> HADOOP_CONF_DIR exported?
>
> Does the hadoop conf dir exist on that host in that location?
>
>
> On Tue, Mar 18, 2014 at 1:19 PM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com <ma...@gmail.com>> wrote:
>
> Updated...
>
> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>
>
> On Tue, Mar 18, 2014 at 1:59 PM, Sean Busbey
> <busbey+lists@cloudera.com <ma...@cloudera.com>> wrote:
>
> Could you add to your gist the output of
>
> $> $ACCUMULO_HOME/bin/accumulo classpath
>
> on one of the tablet server?
>
>
> On Tue, Mar 18, 2014 at 12:49 PM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>> wrote:
>
> There is, but that error that says there isn't is from the
> Tablet Server logs. That is the correct dirrectory...Hadoop
> 2.2.0 does not have a conf directory like previously. The
> core-site.xml, et. al. are in etc/hadoop/*.
>
>
> On Tue, Mar 18, 2014 at 1:42 PM, Billie Rinaldi
> <billie.rinaldi@gmail.com <ma...@gmail.com>>
> wrote:
>
> The accumulo init output looks OK. You're saying that
> there is no /accumulo directory in HDFS after that
> command is run? What does your accumulo-env.sh file
> look like? It appears to be using a default value for
> the hadoop conf dir ($HADOOP_PREFIX/etc/hadoop); is that
> value correct for your setup?
>
>
> On Tue, Mar 18, 2014 at 9:32 AM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>> wrote:
>
> Results are located here...
>
> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>
>
> On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi
> <billie.rinaldi@gmail.com
> <ma...@gmail.com>> wrote:
>
> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin
> Parrish <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>> wrote:
>
> I have a couple of issues when trying to use
> Accumulo on Hadoop 2.2.0
>
> 1) I start with accumulo init and everything
> runs through just fine, but I can find
> '/accumulo' using 'hadoop fs -ls /'
>
>
> If /accumulo doesn't exist, then accumulo init
> did not complete successfully. (Unless the
> accumulo directory was set to something else,
> but that did not appear to be the case in your
> site configuration file.) Would you happen to
> have the output of the accumulo init command?
>
>
> 2) I try to run 'accumulo shell -u root' and
> it says that that Hadoop and ZooKeeper are
> not started, but if I run 'jps' on the each
> cluster node it shows all the necessary
> processes for both in the JVM. Is there
> something I am missing?
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
It's curious that some of the Accumulo jars show up multiple times, but
probably not related.
I don't see any plausible HADOOP_CONF_DIR candidates in that list.
Given your previous messages, I would expect
file:/usr/local/hadoop/etc/hadoop/
if you go to the tserver host and become the user that runs Accumulo, is
HADOOP_CONF_DIR exported?
Does the hadoop conf dir exist on that host in that location?
On Tue, Mar 18, 2014 at 1:19 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> Updated...
>
> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>
>
> On Tue, Mar 18, 2014 at 1:59 PM, Sean Busbey <bu...@cloudera.com>wrote:
>
>> Could you add to your gist the output of
>>
>> $> $ACCUMULO_HOME/bin/accumulo classpath
>>
>> on one of the tablet server?
>>
>>
>> On Tue, Mar 18, 2014 at 12:49 PM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> There is, but that error that says there isn't is from the Tablet Server
>>> logs. That is the correct dirrectory...Hadoop 2.2.0 does not have a conf
>>> directory like previously. The core-site.xml, et. al. are in etc/hadoop/*.
>>>
>>>
>>> On Tue, Mar 18, 2014 at 1:42 PM, Billie Rinaldi <
>>> billie.rinaldi@gmail.com> wrote:
>>>
>>>> The accumulo init output looks OK. You're saying that there is no
>>>> /accumulo directory in HDFS after that command is run? What does your
>>>> accumulo-env.sh file look like? It appears to be using a default value for
>>>> the hadoop conf dir ($HADOOP_PREFIX/etc/hadoop); is that value correct for
>>>> your setup?
>>>>
>>>>
>>>> On Tue, Mar 18, 2014 at 9:32 AM, Benjamin Parrish <
>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>
>>>>> Results are located here...
>>>>>
>>>>> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>>>>>
>>>>>
>>>>> On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi <
>>>>> billie.rinaldi@gmail.com> wrote:
>>>>>
>>>>>> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
>>>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>>>
>>>>>>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>>>>>>
>>>>>>> 1) I start with accumulo init and everything runs through just fine,
>>>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>>>
>>>>>>
>>>>>> If /accumulo doesn't exist, then accumulo init did not complete
>>>>>> successfully. (Unless the accumulo directory was set to something else,
>>>>>> but that did not appear to be the case in your site configuration file.)
>>>>>> Would you happen to have the output of the accumulo init command?
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>>>>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the each
>>>>>>> cluster node it shows all the necessary processes for both in the JVM. Is
>>>>>>> there something I am missing?
>>>>>>>
>>>>>>> --
>>>>>>> Benjamin D. Parrish
>>>>>>> H: 540-597-7860
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
Updated...
https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
On Tue, Mar 18, 2014 at 1:59 PM, Sean Busbey <bu...@cloudera.com>wrote:
> Could you add to your gist the output of
>
> $> $ACCUMULO_HOME/bin/accumulo classpath
>
> on one of the tablet server?
>
>
> On Tue, Mar 18, 2014 at 12:49 PM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> There is, but that error that says there isn't is from the Tablet Server
>> logs. That is the correct dirrectory...Hadoop 2.2.0 does not have a conf
>> directory like previously. The core-site.xml, et. al. are in etc/hadoop/*.
>>
>>
>> On Tue, Mar 18, 2014 at 1:42 PM, Billie Rinaldi <billie.rinaldi@gmail.com
>> > wrote:
>>
>>> The accumulo init output looks OK. You're saying that there is no
>>> /accumulo directory in HDFS after that command is run? What does your
>>> accumulo-env.sh file look like? It appears to be using a default value for
>>> the hadoop conf dir ($HADOOP_PREFIX/etc/hadoop); is that value correct for
>>> your setup?
>>>
>>>
>>> On Tue, Mar 18, 2014 at 9:32 AM, Benjamin Parrish <
>>> benjamin.d.parrish@gmail.com> wrote:
>>>
>>>> Results are located here...
>>>>
>>>> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>>>>
>>>>
>>>> On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi <
>>>> billie.rinaldi@gmail.com> wrote:
>>>>
>>>>> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
>>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>>
>>>>>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>>>>>
>>>>>> 1) I start with accumulo init and everything runs through just fine,
>>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>>
>>>>>
>>>>> If /accumulo doesn't exist, then accumulo init did not complete
>>>>> successfully. (Unless the accumulo directory was set to something else,
>>>>> but that did not appear to be the case in your site configuration file.)
>>>>> Would you happen to have the output of the accumulo init command?
>>>>>
>>>>>
>>>>>>
>>>>>> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop
>>>>>> and ZooKeeper are not started, but if I run 'jps' on the each cluster node
>>>>>> it shows all the necessary processes for both in the JVM. Is there
>>>>>> something I am missing?
>>>>>>
>>>>>> --
>>>>>> Benjamin D. Parrish
>>>>>> H: 540-597-7860
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860
>>>>
>>>
>>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Sean Busbey <bu...@cloudera.com>.
Could you add to your gist the output of
$> $ACCUMULO_HOME/bin/accumulo classpath
on one of the tablet server?
On Tue, Mar 18, 2014 at 12:49 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> There is, but that error that says there isn't is from the Tablet Server
> logs. That is the correct dirrectory...Hadoop 2.2.0 does not have a conf
> directory like previously. The core-site.xml, et. al. are in etc/hadoop/*.
>
>
> On Tue, Mar 18, 2014 at 1:42 PM, Billie Rinaldi <bi...@gmail.com>wrote:
>
>> The accumulo init output looks OK. You're saying that there is no
>> /accumulo directory in HDFS after that command is run? What does your
>> accumulo-env.sh file look like? It appears to be using a default value for
>> the hadoop conf dir ($HADOOP_PREFIX/etc/hadoop); is that value correct for
>> your setup?
>>
>>
>> On Tue, Mar 18, 2014 at 9:32 AM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> Results are located here...
>>>
>>> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>>>
>>>
>>> On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi <
>>> billie.rinaldi@gmail.com> wrote:
>>>
>>>> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>
>>>>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>>>>
>>>>> 1) I start with accumulo init and everything runs through just fine,
>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>
>>>>
>>>> If /accumulo doesn't exist, then accumulo init did not complete
>>>> successfully. (Unless the accumulo directory was set to something else,
>>>> but that did not appear to be the case in your site configuration file.)
>>>> Would you happen to have the output of the accumulo init command?
>>>>
>>>>
>>>>>
>>>>> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop
>>>>> and ZooKeeper are not started, but if I run 'jps' on the each cluster node
>>>>> it shows all the necessary processes for both in the JVM. Is there
>>>>> something I am missing?
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
There is, but that error that says there isn't is from the Tablet Server
logs. That is the correct dirrectory...Hadoop 2.2.0 does not have a conf
directory like previously. The core-site.xml, et. al. are in etc/hadoop/*.
On Tue, Mar 18, 2014 at 1:42 PM, Billie Rinaldi <bi...@gmail.com>wrote:
> The accumulo init output looks OK. You're saying that there is no
> /accumulo directory in HDFS after that command is run? What does your
> accumulo-env.sh file look like? It appears to be using a default value for
> the hadoop conf dir ($HADOOP_PREFIX/etc/hadoop); is that value correct for
> your setup?
>
>
> On Tue, Mar 18, 2014 at 9:32 AM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> Results are located here...
>>
>> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>>
>>
>> On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi <
>> billie.rinaldi@gmail.com> wrote:
>>
>>> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
>>> benjamin.d.parrish@gmail.com> wrote:
>>>
>>>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>>>
>>>> 1) I start with accumulo init and everything runs through just fine,
>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>
>>>
>>> If /accumulo doesn't exist, then accumulo init did not complete
>>> successfully. (Unless the accumulo directory was set to something else,
>>> but that did not appear to be the case in your site configuration file.)
>>> Would you happen to have the output of the accumulo init command?
>>>
>>>
>>>>
>>>> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop
>>>> and ZooKeeper are not started, but if I run 'jps' on the each cluster node
>>>> it shows all the necessary processes for both in the JVM. Is there
>>>> something I am missing?
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860
>>>>
>>>
>>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Billie Rinaldi <bi...@gmail.com>.
The accumulo init output looks OK. You're saying that there is no
/accumulo directory in HDFS after that command is run? What does your
accumulo-env.sh file look like? It appears to be using a default value for
the hadoop conf dir ($HADOOP_PREFIX/etc/hadoop); is that value correct for
your setup?
On Tue, Mar 18, 2014 at 9:32 AM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> Results are located here...
>
> https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
>
>
> On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi <billie.rinaldi@gmail.com
> > wrote:
>
>> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>>
>>> 1) I start with accumulo init and everything runs through just fine, but
>>> I can find '/accumulo' using 'hadoop fs -ls /'
>>>
>>
>> If /accumulo doesn't exist, then accumulo init did not complete
>> successfully. (Unless the accumulo directory was set to something else,
>> but that did not appear to be the case in your site configuration file.)
>> Would you happen to have the output of the accumulo init command?
>>
>>
>>>
>>> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop
>>> and ZooKeeper are not started, but if I run 'jps' on the each cluster node
>>> it shows all the necessary processes for both in the JVM. Is there
>>> something I am missing?
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
Results are located here...
https://gist.github.com/bdparrish/4141ba4cb1674ff2668a
On Tue, Mar 18, 2014 at 12:23 PM, Billie Rinaldi
<bi...@gmail.com>wrote:
> On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>
>> 1) I start with accumulo init and everything runs through just fine, but
>> I can find '/accumulo' using 'hadoop fs -ls /'
>>
>
> If /accumulo doesn't exist, then accumulo init did not complete
> successfully. (Unless the accumulo directory was set to something else,
> but that did not appear to be the case in your site configuration file.)
> Would you happen to have the output of the accumulo init command?
>
>
>>
>> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop and
>> ZooKeeper are not started, but if I run 'jps' on the each cluster node it
>> shows all the necessary processes for both in the JVM. Is there something
>> I am missing?
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Billie Rinaldi <bi...@gmail.com>.
On Sun, Mar 16, 2014 at 5:28 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>
> 1) I start with accumulo init and everything runs through just fine, but I
> can find '/accumulo' using 'hadoop fs -ls /'
>
If /accumulo doesn't exist, then accumulo init did not complete
successfully. (Unless the accumulo directory was set to something else,
but that did not appear to be the case in your site configuration file.)
Would you happen to have the output of the accumulo init command?
>
> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop and
> ZooKeeper are not started, but if I run 'jps' on the each cluster node it
> shows all the necessary processes for both in the JVM. Is there something
> I am missing?
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Mike Drob <ma...@cloudera.com>.
Can you check a tablet server log? If the contents are too large for the
mailing list, then you can post them as a github gist or paste, or whatever
your favourite tool is.
On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> First off, are there specific ports that need to be opened up for
> accumulo? I have hadoop operating without any issues as a 5 node cluster.
> Zookeeper seems to be operating with 2181, 3888, 2888 ports open.
>
> Here is some data from trying to get everything started and getting into
> the shell. I discluded the bash portion as Eric suggested because the
> mailing list rejected it for length and thinking it was spam.
>
> bin/start-all.sh
>
> [root@hadoop-node-1 zookeeper]# bash -x
> /usr/local/accumulo/bin/start-all.sh
> Starting monitor on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting tablet servers ....... done
> Starting tablet server on hadoop-node-3
> Starting tablet server on hadoop-node-5
> Starting tablet server on hadoop-node-2
> Starting tablet server on hadoop-node-4
> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
> stack guard. The VM will try to fix the stack guard no
> w.
> It's highly recommended that you fix the library with 'execstack -c
> <libfile>', or link it with '-z noexecstack'.
> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to talk to
> zookeeper
> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper connected and
> initialized, attemping to talk to HDFS
> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to HDFS
> Starting master on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting garbage collector on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting tracer on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>
> starting shell as root...
>
> [root@hadoop-node-1 zookeeper]# bash -x /usr/local/accumulo/bin/accumulo
> shell -u root
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
> stack guard. The VM will try to fix the stack guard no
> w.
> It's highly recommended that you fix the library with 'execstack -c
> <libfile>', or link it with '-z noexecstack'.
> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> Password: ****
> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no tablet
> servers: check that zookeeper and accumulo are running.
>
> ... this is the point where it sits and acts like it doesn't do anything
>
> -- LOGS -- (most of this looks to be that I cannot connect to anything)
>
> here is the tail -f
> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>
> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to locate
> tablet for table : !0 row : ~err_
> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to obtain problem
> reports
> java.lang.RuntimeException:
> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
> at
> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:174)
> at
> org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:241)
> at
> org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:299)
> at
> org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:399)
> at
> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.java:530)
> at
> org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> at java.lang.Thread.run(Thread.java:744)
> Caused by:
> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
> at
> org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:212)
> at
> org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:82)
> at
> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:164)
> ... 6 more
>
> here is the tail -f
> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>
> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService request
> failed null, retrying ...
> org.apache.thrift.transport.TTransportException: Failed to connect to a
> server
> at
> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:455)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:154)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
> at
> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
> at
> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
> at
> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
> at
> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:200)
> at
> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:295)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.accumulo.start.Main$1.run(Main.java:103)
> at java.lang.Thread.run(Thread.java:744)
>
>
> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton <er...@gmail.com>wrote:
>
>> Can you post the exact error message you are seeing?
>>
>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being set properly
>> in accumulo-site.xml.
>>
>> The output of:
>>
>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>
>>
>> would also help.
>>
>> It's going to be something simple.
>>
>>
>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> Looking to see if there was an answer to this issue or if you could
>>> point me in a direction or example that could lead to a solution.
>>>
>>>
>>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish <
>>> benjamin.d.parrish@gmail.com> wrote:
>>>
>>>> I am running Accumulo 1.5.1
>>>>
>>>> <?xml version="1.0" encoding="UTF-8"?>
>>>> <!--
>>>> Licensed to the Apache Software Foundation (ASF) under one or more
>>>> contributor license agreements. See the NOTICE file distributed with
>>>> this work for additional information regarding copyright ownership.
>>>> The ASF licenses this file to You under the Apache License, Version
>>>> 2.0
>>>> (the "License"); you may not use this file except in compliance with
>>>> the License. You may obtain a copy of the License at
>>>>
>>>> http://www.apache.org/licenses/LICENSE-2.0
>>>>
>>>> Unless required by applicable law or agreed to in writing, software
>>>> distributed under the License is distributed on an "AS IS" BASIS,
>>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
>>>> implied.
>>>> See the License for the specific language governing permissions and
>>>> limitations under the License.
>>>> -->
>>>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>>>>
>>>> <configuration>
>>>> <!-- Put your site-specific accumulo configurations here. The
>>>> available configuration values along with their defaults are documented in
>>>> docs/config.html Unless
>>>> you are simply testing at your workstation, you will most
>>>> definitely need to change the three entries below. -->
>>>>
>>>> <property>
>>>> <name>instance.zookeeper.host</name>
>>>>
>>>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>>>> <description>comma separated list of zookeeper servers</description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>logger.dir.walog</name>
>>>> <value>walogs</value>
>>>> <description>The property only needs to be set if upgrading from
>>>> 1.4 which used to store write-ahead logs on the local
>>>> filesystem. In 1.5 write-ahead logs are stored in DFS. When 1.5
>>>> is started for the first time it will copy any 1.4
>>>> write ahead logs into DFS. It is possible to specify a
>>>> comma-separated list of directories.
>>>> </description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>instance.secret</name>
>>>> <value></value>
>>>> <description>A secret unique to a given instance that all servers
>>>> must know in order to communicate with one another.
>>>> Change it before initialization. To
>>>> change it later use ./bin/accumulo
>>>> org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
>>>> [newpasswd],
>>>> and then update this file.
>>>> </description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.memory.maps.max</name>
>>>> <value>1G</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.cache.data.size</name>
>>>> <value>128M</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.cache.index.size</name>
>>>> <value>128M</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>trace.token.property.password</name>
>>>> <!-- change this to the root user's password, and/or change the
>>>> user below -->
>>>> <value></value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>trace.user</name>
>>>> <value>root</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>general.classpaths</name>
>>>> <value>
>>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>>> /usr/lib/hadoop/.*.jar,
>>>> /usr/lib/hadoop/lib/.*.jar,
>>>> /usr/lib/hadoop-hdfs/.*.jar,
>>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>>> /usr/lib/hadoop-yarn/.*.jar,
>>>> $ACCUMULO_HOME/server/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>>> $ACCUMULO_HOME/core/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>>> $ACCUMULO_HOME/start/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>>> $ACCUMULO_HOME/fate/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>>> $ACCUMULO_HOME/proxy/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>>> $HADOOP_CONF_DIR,
>>>> $HADOOP_PREFIX/[^.].*.jar,
>>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>>> </value>
>>>> <description>Classpaths that accumulo checks for updates and class
>>>> files.
>>>> When using the Security Manager, please remove the
>>>> ".../target/classes/" values.
>>>> </description>
>>>> </property>
>>>> </configuration>
>>>>
>>>>
>>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com>wrote:
>>>>
>>>>> Posting your accumulo-site.xml (filtering out instance.secret and
>>>>> trace.password before you post) would also help us figure out what exactly
>>>>> is going on.
>>>>>
>>>>>
>>>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>>>
>>>>>> Which version of Accumulo are you using?
>>>>>>
>>>>>> You might be missing the hadoop libraries from your classpath. For
>>>>>> this,
>>>>>> you would check your accumulo-site.xml and find the comment about
>>>>>> Hadoop
>>>>>> 2 in the file.
>>>>>>
>>>>>>
>>>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>>>>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>>>>> wrote:
>>>>>>
>>>>>> I have a couple of issues when trying to use Accumulo on Hadoop
>>>>>> 2.2.0
>>>>>>
>>>>>> 1) I start with accumulo init and everything runs through just
>>>>>> fine,
>>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>>
>>>>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>>>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the
>>>>>> each
>>>>>> cluster node it shows all the necessary processes for both in the
>>>>>> JVM. Is there something I am missing?
>>>>>>
>>>>>> --
>>>>>> Benjamin D. Parrish
>>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>>
>>>>>>
>>>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860
>>>>
>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Mike Drob <ma...@cloudera.com>.
This might be a red herring, but are you running a GNU JRE?
On Tue, Mar 18, 2014 at 12:18 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> Yeah, left it in just in case that might cause an issue.
>
> i did find this in zookeeper.out as well...
>
> java.io.IOException: Too many open files
> at gnu.java.net.PlainSocketImpl.create(libgcj.so.10)
> at gnu.java.nio.SocketChannelImpl.<init>(libgcj.so.10)
> at gnu.java.nio.SelectorProviderImpl.openSocketChannel(libgcj.so.10)
> at gnu.java.nio.NIOServerSocket.accept(libgcj.so.10)
> at gnu.java.nio.ServerSocketChannelImpl.accept(libgcj.so.10)
> at
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:188)
> at java.lang.Thread.run(libgcj.so.10)
>
>
> On Tue, Mar 18, 2014 at 12:16 PM, Eric Newton <er...@gmail.com>wrote:
>
>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
>>> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
>>> stack guard. The VM will try to fix the stack guard no
>>> w.
>>> It's highly recommended that you fix the library with 'execstack -c
>>> <libfile>', or link it with '-z noexecstack'.
>>
>>
>> This is not causing your problem, but the binaries are 32-bit and need to
>> be recompiled for a 64-bit environment. This message is just bogus.
>>
>> -Eric
>>
>>
>> On Tue, Mar 18, 2014 at 12:07 PM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> on all 5 nodes there is a conf/accumulo-site.xml with the same values
>>> for all 5.
>>>
>>> someone is going to kill me when they find out that i left off a bracket
>>> or semi-colon somewhere...
>>>
>>>
>>> On Tue, Mar 18, 2014 at 12:02 PM, Josh Elser <jo...@gmail.com>wrote:
>>>
>>>> No, running `accumulo init` on a single host is sufficient.
>>>>
>>>> Is accumulo-site.xml consistent across all machines?
>>>>
>>>>
>>>> On 3/18/14, 11:57 AM, Benjamin Parrish wrote:
>>>>
>>>>> So here is the error from the tablet server...
>>>>>
>>>>> 2014-03-18 10:38:43,456 [client.ZooKeeperInstance] ERROR: unable obtain
>>>>> instance id at /accumulo/instance_id
>>>>> 2014-03-18 10:38:43,456 [tabletserver.TabletServer] ERROR: Uncaught
>>>>> exception in TabletServer.main, exiting
>>>>> java.lang.RuntimeException: Accumulo not initialized, there is no
>>>>> instance id at /accumulo/instance_id
>>>>> at
>>>>> org.apache.accumulo.core.client.ZooKeeperInstance.
>>>>> getInstanceIDFromHdfs(ZooKeeperInstance.java:295)
>>>>> at
>>>>> org.apache.accumulo.server.client.HdfsZooInstance._
>>>>> getInstanceID(HdfsZooInstance.java:126)
>>>>> at
>>>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>>>> getInstanceID(HdfsZooInstance.java:119)
>>>>> at
>>>>> org.apache.accumulo.server.conf.ZooConfiguration.
>>>>> getInstance(ZooConfiguration.java:55)
>>>>> at
>>>>> org.apache.accumulo.server.conf.ServerConfiguration.
>>>>> getZooConfiguration(ServerConfiguration.java:50)
>>>>> at
>>>>> org.apache.accumulo.server.conf.ServerConfiguration.getConfiguration(
>>>>> ServerConfiguration.java:104)
>>>>> at org.apache.accumulo.server.Accumulo.init(Accumulo.java:98)
>>>>> at
>>>>> org.apache.accumulo.server.tabletserver.TabletServer.
>>>>> main(TabletServer.java:3249)
>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>>> Method)
>>>>> at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>>>> NativeMethodAccessorImpl.java:57)
>>>>> at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>>>> DelegatingMethodAccessorImpl.java:43)
>>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>>>>> at java.lang.Thread.run(Thread.java:744)
>>>>>
>>>>> Do I need to run bin/accumulo init on every box in the cluster?
>>>>>
>>>>>
>>>>> On Tue, Mar 18, 2014 at 11:19 AM, Eric Newton <eric.newton@gmail.com
>>>>> <ma...@gmail.com>> wrote:
>>>>>
>>>>> Port numbers (for 1.5+)
>>>>>
>>>>> 4560 Accumulo monitor (for centralized log display)
>>>>> 9997 Tablet Server
>>>>> 9999 Master Server
>>>>> 12234 Accumulo Tracer
>>>>> 50091 Accumulo GC
>>>>> 50095 Accumulo HTTP monitor
>>>>>
>>>>>
>>>>> On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish
>>>>> <benjamin.d.parrish@gmail.com <mailto:benjamin.d.parrish@gmail.com
>>>>> >>
>>>>>
>>>>> wrote:
>>>>>
>>>>> First off, are there specific ports that need to be opened up
>>>>> for accumulo? I have hadoop operating without any issues as a 5
>>>>> node cluster. Zookeeper seems to be operating with 2181, 3888,
>>>>> 2888 ports open.
>>>>>
>>>>> Here is some data from trying to get everything started and
>>>>> getting into the shell. I discluded the bash portion as Eric
>>>>> suggested because the mailing list rejected it for length and
>>>>> thinking it was spam.
>>>>>
>>>>> bin/start-all.sh
>>>>>
>>>>> [root@hadoop-node-1 zookeeper]# bash -x
>>>>> /usr/local/accumulo/bin/start-all.sh
>>>>> Starting monitor on hadoop-node-1
>>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>>> Starting tablet servers ....... done
>>>>> Starting tablet server on hadoop-node-3
>>>>> Starting tablet server on hadoop-node-5
>>>>> Starting tablet server on hadoop-node-2
>>>>> Starting tablet server on hadoop-node-4
>>>>> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
>>>>> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
>>>>> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
>>>>> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
>>>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>>>>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>>>>> might have disabled stack guard. The VM will try to fix the
>>>>> stack guard no
>>>>> w.
>>>>> It's highly recommended that you fix the library with
>>>>> 'execstack
>>>>> -c <libfile>', or link it with '-z noexecstack'.
>>>>> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable
>>>>> to
>>>>> load native-hadoop library for your platform... using
>>>>> builtin-java classes where applicable
>>>>> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to
>>>>> talk to zookeeper
>>>>> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper
>>>>> connected and initialized, attemping to talk to HDFS
>>>>> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to
>>>>> HDFS
>>>>> Starting master on hadoop-node-1
>>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>>> Starting garbage collector on hadoop-node-1
>>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>>> Starting tracer on hadoop-node-1
>>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>>>
>>>>> starting shell as root...
>>>>>
>>>>> [root@hadoop-node-1 zookeeper]# bash -x
>>>>> /usr/local/accumulo/bin/accumulo shell -u root
>>>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>>>>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>>>>> might have disabled stack guard. The VM will try to fix the
>>>>> stack guard no
>>>>> w.
>>>>> It's highly recommended that you fix the library with
>>>>> 'execstack
>>>>> -c <libfile>', or link it with '-z noexecstack'.
>>>>> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable
>>>>> to
>>>>> load native-hadoop library for your platform... using
>>>>> builtin-java classes where applicable
>>>>> Password: ****
>>>>> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no
>>>>> tablet servers: check that zookeeper and accumulo are running.
>>>>>
>>>>> ... this is the point where it sits and acts like it doesn't do
>>>>> anything
>>>>>
>>>>> -- LOGS -- (most of this looks to be that I cannot connect to
>>>>> anything)
>>>>>
>>>>> here is the tail -f
>>>>> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>>>>>
>>>>> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to
>>>>> locate tablet for table : !0 row : ~err_
>>>>> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to
>>>>> obtain problem reports
>>>>> java.lang.RuntimeException:
>>>>> org.apache.accumulo.core.client.impl.ThriftScanner$
>>>>> ScanTimedOutException
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ScannerIterator.
>>>>> hasNext(ScannerIterator.java:174)
>>>>> at
>>>>> org.apache.accumulo.server.problems.ProblemReports$3.
>>>>> hasNext(ProblemReports.java:241)
>>>>> at
>>>>> org.apache.accumulo.server.problems.ProblemReports.
>>>>> summarize(ProblemReports.java:299)
>>>>> at
>>>>> org.apache.accumulo.server.monitor.Monitor.fetchData(
>>>>> Monitor.java:399)
>>>>> at
>>>>> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.
>>>>> java:530)
>>>>> at
>>>>> org.apache.accumulo.core.util.LoggingRunnable.run(
>>>>> LoggingRunnable.java:34)
>>>>> at java.lang.Thread.run(Thread.java:744)
>>>>> Caused by:
>>>>> org.apache.accumulo.core.client.impl.ThriftScanner$
>>>>> ScanTimedOutException
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ThriftScanner.
>>>>> scan(ThriftScanner.java:212)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ScannerIterator$
>>>>> Reader.run(ScannerIterator.java:82)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ScannerIterator.
>>>>> hasNext(ScannerIterator.java:164)
>>>>> ... 6 more
>>>>>
>>>>> here is the tail -f
>>>>> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>>>>>
>>>>> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG:
>>>>> ClientService
>>>>> request failed null, retrying ...
>>>>> org.apache.thrift.transport.TTransportException: Failed to
>>>>> connect to a server
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ThriftTransportPool.
>>>>> getAnyTransport(ThriftTransportPool.java:455)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>>> getConnection(ServerClient.java:154)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>>> getConnection(ServerClient.java:128)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>>> getConnection(ServerClient.java:123)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>>> executeRaw(ServerClient.java:105)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>>> execute(ServerClient.java:71)
>>>>> at
>>>>> org.apache.accumulo.core.client.impl.ConnectorImpl.<
>>>>> init>(ConnectorImpl.java:64)
>>>>> at
>>>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>>>> getConnector(HdfsZooInstance.java:154)
>>>>> at
>>>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>>>> getConnector(HdfsZooInstance.java:149)
>>>>> at
>>>>> org.apache.accumulo.server.trace.TraceServer.<init>(
>>>>> TraceServer.java:200)
>>>>> at
>>>>> org.apache.accumulo.server.trace.TraceServer.main(
>>>>> TraceServer.java:295)
>>>>> at sun.reflect.NativeMethodAccessorImpl.
>>>>> invoke0(Native
>>>>> Method)
>>>>> at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>>>> NativeMethodAccessorImpl.java:57)
>>>>> at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>>>> DelegatingMethodAccessorImpl.java:43)
>>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>>> at org.apache.accumulo.start.
>>>>> Main$1.run(Main.java:103)
>>>>> at java.lang.Thread.run(Thread.java:744)
>>>>>
>>>>>
>>>>> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton
>>>>> <eric.newton@gmail.com <ma...@gmail.com>> wrote:
>>>>>
>>>>> Can you post the exact error message you are seeing?
>>>>>
>>>>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are
>>>>> being
>>>>> set properly in accumulo-site.xml.
>>>>>
>>>>> The output of:
>>>>>
>>>>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>>>>
>>>>>
>>>>> would also help.
>>>>>
>>>>> It's going to be something simple.
>>>>>
>>>>>
>>>>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish
>>>>> <benjamin.d.parrish@gmail.com
>>>>> <ma...@gmail.com>> wrote:
>>>>>
>>>>> Looking to see if there was an answer to this issue or
>>>>> if you could point me in a direction or example that
>>>>> could lead to a solution.
>>>>>
>>>>>
>>>>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish
>>>>> <benjamin.d.parrish@gmail.com
>>>>> <ma...@gmail.com>> wrote:
>>>>>
>>>>> I am running Accumulo 1.5.1
>>>>>
>>>>> <?xml version="1.0" encoding="UTF-8"?>
>>>>> <!--
>>>>> Licensed to the Apache Software Foundation (ASF)
>>>>> under one or more
>>>>> contributor license agreements. See the NOTICE
>>>>> file distributed with
>>>>> this work for additional information regarding
>>>>> copyright ownership.
>>>>> The ASF licenses this file to You under the
>>>>> Apache License, Version 2.0
>>>>> (the "License"); you may not use this file
>>>>> except
>>>>> in compliance with
>>>>> the License. You may obtain a copy of the
>>>>> License at
>>>>>
>>>>> http://www.apache.org/licenses/LICENSE-2.0
>>>>>
>>>>> Unless required by applicable law or agreed to
>>>>> in
>>>>> writing, software
>>>>> distributed under the License is distributed on
>>>>> an "AS IS" BASIS,
>>>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
>>>>> either express or implied.
>>>>> See the License for the specific language
>>>>> governing permissions and
>>>>> limitations under the License.
>>>>> -->
>>>>> <?xml-stylesheet type="text/xsl"
>>>>> href="configuration.xsl"?>
>>>>>
>>>>> <configuration>
>>>>> <!-- Put your site-specific accumulo
>>>>> configurations here. The available configuration
>>>>> values along with their defaults are documented in
>>>>> docs/config.html Unless
>>>>> you are simply testing at your workstation,
>>>>> you
>>>>> will most definitely need to change the three
>>>>> entries below. -->
>>>>>
>>>>> <property>
>>>>> <name>instance.zookeeper.host</name>
>>>>>
>>>>> <value>hadoop-node-1:2181,
>>>>> hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:
>>>>> 2181,hadoop-node-5:2181</value>
>>>>> <description>comma separated list of zookeeper
>>>>> servers</description>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>logger.dir.walog</name>
>>>>> <value>walogs</value>
>>>>> <description>The property only needs to be set
>>>>> if upgrading from 1.4 which used to store
>>>>> write-ahead logs on the local
>>>>> filesystem. In 1.5 write-ahead logs are
>>>>> stored in DFS. When 1.5 is started for the first
>>>>> time it will copy any 1.4
>>>>> write ahead logs into DFS. It is possible
>>>>> to
>>>>> specify a comma-separated list of directories.
>>>>> </description>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>instance.secret</name>
>>>>> <value></value>
>>>>> <description>A secret unique to a given
>>>>> instance that all servers must know in order to
>>>>> communicate with one another.
>>>>> Change it before initialization. To
>>>>> change it later use ./bin/accumulo
>>>>> org.apache.accumulo.server.util.ChangeSecret --old
>>>>> [oldpasswd] --new [newpasswd],
>>>>> and then update this file.
>>>>> </description>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>tserver.memory.maps.max</name>
>>>>> <value>1G</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>tserver.cache.data.size</name>
>>>>> <value>128M</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>tserver.cache.index.size</name>
>>>>> <value>128M</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>trace.token.property.password</name>
>>>>> <!-- change this to the root user's password,
>>>>> and/or change the user below -->
>>>>> <value></value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>trace.user</name>
>>>>> <value>root</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>general.classpaths</name>
>>>>> <value>
>>>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/
>>>>> common/lib/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/
>>>>> mapreduce/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>>>> /usr/lib/hadoop/.*.jar,
>>>>> /usr/lib/hadoop/lib/.*.jar,
>>>>> /usr/lib/hadoop-hdfs/.*.jar,
>>>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>>>> /usr/lib/hadoop-yarn/.*.jar,
>>>>> $ACCUMULO_HOME/server/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>>>> $ACCUMULO_HOME/core/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>>>> $ACCUMULO_HOME/start/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>>>> $ACCUMULO_HOME/fate/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>>>> $ACCUMULO_HOME/proxy/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>>>> $HADOOP_CONF_DIR,
>>>>> $HADOOP_PREFIX/[^.].*.jar,
>>>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>>>> </value>
>>>>> <description>Classpaths that accumulo checks
>>>>> for updates and class files.
>>>>> When using the Security Manager, please
>>>>> remove the ".../target/classes/" values.
>>>>> </description>
>>>>> </property>
>>>>> </configuration>
>>>>>
>>>>>
>>>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser
>>>>> <josh.elser@gmail.com <mailto:josh.elser@gmail.com
>>>>> >>
>>>>>
>>>>> wrote:
>>>>>
>>>>> Posting your accumulo-site.xml (filtering out
>>>>> instance.secret and trace.password before you
>>>>> post) would also help us figure out what
>>>>> exactly
>>>>> is going on.
>>>>>
>>>>>
>>>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>>>
>>>>> Which version of Accumulo are you using?
>>>>>
>>>>> You might be missing the hadoop libraries
>>>>> from your classpath. For this,
>>>>> you would check your accumulo-site.xml and
>>>>> find the comment about Hadoop
>>>>> 2 in the file.
>>>>>
>>>>>
>>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin
>>>>> Parrish
>>>>> <benjamin.d.parrish@gmail.com
>>>>> <ma...@gmail.com>
>>>>> <mailto:benjamin.d.parrish@__gmail.com
>>>>>
>>>>> <ma...@gmail.com>>>
>>>>> wrote:
>>>>>
>>>>> I have a couple of issues when trying
>>>>> to use Accumulo on Hadoop 2.2.0
>>>>>
>>>>> 1) I start with accumulo init and
>>>>> everything runs through just fine,
>>>>> but I can find '/accumulo' using
>>>>> 'hadoop fs -ls /'
>>>>>
>>>>> 2) I try to run 'accumulo shell -u
>>>>> root' and it says that that
>>>>> Hadoop and ZooKeeper are not started,
>>>>> but if I run 'jps' on the each
>>>>> cluster node it shows all the
>>>>> necessary
>>>>> processes for both in the
>>>>> JVM. Is there something I am missing?
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>> <tel:540-597-7860 <tel:540-597-7860>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860
>>>>>
>>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
Yeah, left it in just in case that might cause an issue.
i did find this in zookeeper.out as well...
java.io.IOException: Too many open files
at gnu.java.net.PlainSocketImpl.create(libgcj.so.10)
at gnu.java.nio.SocketChannelImpl.<init>(libgcj.so.10)
at gnu.java.nio.SelectorProviderImpl.openSocketChannel(libgcj.so.10)
at gnu.java.nio.NIOServerSocket.accept(libgcj.so.10)
at gnu.java.nio.ServerSocketChannelImpl.accept(libgcj.so.10)
at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:188)
at java.lang.Thread.run(libgcj.so.10)
On Tue, Mar 18, 2014 at 12:16 PM, Eric Newton <er...@gmail.com> wrote:
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
>> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
>> stack guard. The VM will try to fix the stack guard no
>> w.
>> It's highly recommended that you fix the library with 'execstack -c
>> <libfile>', or link it with '-z noexecstack'.
>
>
> This is not causing your problem, but the binaries are 32-bit and need to
> be recompiled for a 64-bit environment. This message is just bogus.
>
> -Eric
>
>
> On Tue, Mar 18, 2014 at 12:07 PM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> on all 5 nodes there is a conf/accumulo-site.xml with the same values for
>> all 5.
>>
>> someone is going to kill me when they find out that i left off a bracket
>> or semi-colon somewhere...
>>
>>
>> On Tue, Mar 18, 2014 at 12:02 PM, Josh Elser <jo...@gmail.com>wrote:
>>
>>> No, running `accumulo init` on a single host is sufficient.
>>>
>>> Is accumulo-site.xml consistent across all machines?
>>>
>>>
>>> On 3/18/14, 11:57 AM, Benjamin Parrish wrote:
>>>
>>>> So here is the error from the tablet server...
>>>>
>>>> 2014-03-18 10:38:43,456 [client.ZooKeeperInstance] ERROR: unable obtain
>>>> instance id at /accumulo/instance_id
>>>> 2014-03-18 10:38:43,456 [tabletserver.TabletServer] ERROR: Uncaught
>>>> exception in TabletServer.main, exiting
>>>> java.lang.RuntimeException: Accumulo not initialized, there is no
>>>> instance id at /accumulo/instance_id
>>>> at
>>>> org.apache.accumulo.core.client.ZooKeeperInstance.
>>>> getInstanceIDFromHdfs(ZooKeeperInstance.java:295)
>>>> at
>>>> org.apache.accumulo.server.client.HdfsZooInstance._
>>>> getInstanceID(HdfsZooInstance.java:126)
>>>> at
>>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>>> getInstanceID(HdfsZooInstance.java:119)
>>>> at
>>>> org.apache.accumulo.server.conf.ZooConfiguration.
>>>> getInstance(ZooConfiguration.java:55)
>>>> at
>>>> org.apache.accumulo.server.conf.ServerConfiguration.
>>>> getZooConfiguration(ServerConfiguration.java:50)
>>>> at
>>>> org.apache.accumulo.server.conf.ServerConfiguration.getConfiguration(
>>>> ServerConfiguration.java:104)
>>>> at org.apache.accumulo.server.Accumulo.init(Accumulo.java:98)
>>>> at
>>>> org.apache.accumulo.server.tabletserver.TabletServer.
>>>> main(TabletServer.java:3249)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>>> NativeMethodAccessorImpl.java:57)
>>>> at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>>> DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>>>> at java.lang.Thread.run(Thread.java:744)
>>>>
>>>> Do I need to run bin/accumulo init on every box in the cluster?
>>>>
>>>>
>>>> On Tue, Mar 18, 2014 at 11:19 AM, Eric Newton <eric.newton@gmail.com
>>>> <ma...@gmail.com>> wrote:
>>>>
>>>> Port numbers (for 1.5+)
>>>>
>>>> 4560 Accumulo monitor (for centralized log display)
>>>> 9997 Tablet Server
>>>> 9999 Master Server
>>>> 12234 Accumulo Tracer
>>>> 50091 Accumulo GC
>>>> 50095 Accumulo HTTP monitor
>>>>
>>>>
>>>> On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish
>>>> <benjamin.d.parrish@gmail.com <mailto:benjamin.d.parrish@gmail.com
>>>> >>
>>>>
>>>> wrote:
>>>>
>>>> First off, are there specific ports that need to be opened up
>>>> for accumulo? I have hadoop operating without any issues as a 5
>>>> node cluster. Zookeeper seems to be operating with 2181, 3888,
>>>> 2888 ports open.
>>>>
>>>> Here is some data from trying to get everything started and
>>>> getting into the shell. I discluded the bash portion as Eric
>>>> suggested because the mailing list rejected it for length and
>>>> thinking it was spam.
>>>>
>>>> bin/start-all.sh
>>>>
>>>> [root@hadoop-node-1 zookeeper]# bash -x
>>>> /usr/local/accumulo/bin/start-all.sh
>>>> Starting monitor on hadoop-node-1
>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>> Starting tablet servers ....... done
>>>> Starting tablet server on hadoop-node-3
>>>> Starting tablet server on hadoop-node-5
>>>> Starting tablet server on hadoop-node-2
>>>> Starting tablet server on hadoop-node-4
>>>> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
>>>> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
>>>> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
>>>> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
>>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>>>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>>>> might have disabled stack guard. The VM will try to fix the
>>>> stack guard no
>>>> w.
>>>> It's highly recommended that you fix the library with 'execstack
>>>> -c <libfile>', or link it with '-z noexecstack'.
>>>> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to
>>>> load native-hadoop library for your platform... using
>>>> builtin-java classes where applicable
>>>> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to
>>>> talk to zookeeper
>>>> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper
>>>> connected and initialized, attemping to talk to HDFS
>>>> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to
>>>> HDFS
>>>> Starting master on hadoop-node-1
>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>> Starting garbage collector on hadoop-node-1
>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>> Starting tracer on hadoop-node-1
>>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>>
>>>> starting shell as root...
>>>>
>>>> [root@hadoop-node-1 zookeeper]# bash -x
>>>> /usr/local/accumulo/bin/accumulo shell -u root
>>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>>>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>>>> might have disabled stack guard. The VM will try to fix the
>>>> stack guard no
>>>> w.
>>>> It's highly recommended that you fix the library with 'execstack
>>>> -c <libfile>', or link it with '-z noexecstack'.
>>>> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to
>>>> load native-hadoop library for your platform... using
>>>> builtin-java classes where applicable
>>>> Password: ****
>>>> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no
>>>> tablet servers: check that zookeeper and accumulo are running.
>>>>
>>>> ... this is the point where it sits and acts like it doesn't do
>>>> anything
>>>>
>>>> -- LOGS -- (most of this looks to be that I cannot connect to
>>>> anything)
>>>>
>>>> here is the tail -f
>>>> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>>>>
>>>> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to
>>>> locate tablet for table : !0 row : ~err_
>>>> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to
>>>> obtain problem reports
>>>> java.lang.RuntimeException:
>>>> org.apache.accumulo.core.client.impl.ThriftScanner$
>>>> ScanTimedOutException
>>>> at
>>>> org.apache.accumulo.core.client.impl.ScannerIterator.
>>>> hasNext(ScannerIterator.java:174)
>>>> at
>>>> org.apache.accumulo.server.problems.ProblemReports$3.
>>>> hasNext(ProblemReports.java:241)
>>>> at
>>>> org.apache.accumulo.server.problems.ProblemReports.
>>>> summarize(ProblemReports.java:299)
>>>> at
>>>> org.apache.accumulo.server.monitor.Monitor.fetchData(
>>>> Monitor.java:399)
>>>> at
>>>> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.
>>>> java:530)
>>>> at
>>>> org.apache.accumulo.core.util.LoggingRunnable.run(
>>>> LoggingRunnable.java:34)
>>>> at java.lang.Thread.run(Thread.java:744)
>>>> Caused by:
>>>> org.apache.accumulo.core.client.impl.ThriftScanner$
>>>> ScanTimedOutException
>>>> at
>>>> org.apache.accumulo.core.client.impl.ThriftScanner.
>>>> scan(ThriftScanner.java:212)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ScannerIterator$
>>>> Reader.run(ScannerIterator.java:82)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ScannerIterator.
>>>> hasNext(ScannerIterator.java:164)
>>>> ... 6 more
>>>>
>>>> here is the tail -f
>>>> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>>>>
>>>> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService
>>>> request failed null, retrying ...
>>>> org.apache.thrift.transport.TTransportException: Failed to
>>>> connect to a server
>>>> at
>>>> org.apache.accumulo.core.client.impl.ThriftTransportPool.
>>>> getAnyTransport(ThriftTransportPool.java:455)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>> getConnection(ServerClient.java:154)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>> getConnection(ServerClient.java:128)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>> getConnection(ServerClient.java:123)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>> executeRaw(ServerClient.java:105)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ServerClient.
>>>> execute(ServerClient.java:71)
>>>> at
>>>> org.apache.accumulo.core.client.impl.ConnectorImpl.<
>>>> init>(ConnectorImpl.java:64)
>>>> at
>>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>>> getConnector(HdfsZooInstance.java:154)
>>>> at
>>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>>> getConnector(HdfsZooInstance.java:149)
>>>> at
>>>> org.apache.accumulo.server.trace.TraceServer.<init>(
>>>> TraceServer.java:200)
>>>> at
>>>> org.apache.accumulo.server.trace.TraceServer.main(
>>>> TraceServer.java:295)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>>> Method)
>>>> at
>>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>>> NativeMethodAccessorImpl.java:57)
>>>> at
>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>>> DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>>>> at java.lang.Thread.run(Thread.java:744)
>>>>
>>>>
>>>> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton
>>>> <eric.newton@gmail.com <ma...@gmail.com>> wrote:
>>>>
>>>> Can you post the exact error message you are seeing?
>>>>
>>>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being
>>>> set properly in accumulo-site.xml.
>>>>
>>>> The output of:
>>>>
>>>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>>>
>>>>
>>>> would also help.
>>>>
>>>> It's going to be something simple.
>>>>
>>>>
>>>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish
>>>> <benjamin.d.parrish@gmail.com
>>>> <ma...@gmail.com>> wrote:
>>>>
>>>> Looking to see if there was an answer to this issue or
>>>> if you could point me in a direction or example that
>>>> could lead to a solution.
>>>>
>>>>
>>>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish
>>>> <benjamin.d.parrish@gmail.com
>>>> <ma...@gmail.com>> wrote:
>>>>
>>>> I am running Accumulo 1.5.1
>>>>
>>>> <?xml version="1.0" encoding="UTF-8"?>
>>>> <!--
>>>> Licensed to the Apache Software Foundation (ASF)
>>>> under one or more
>>>> contributor license agreements. See the NOTICE
>>>> file distributed with
>>>> this work for additional information regarding
>>>> copyright ownership.
>>>> The ASF licenses this file to You under the
>>>> Apache License, Version 2.0
>>>> (the "License"); you may not use this file except
>>>> in compliance with
>>>> the License. You may obtain a copy of the
>>>> License at
>>>>
>>>> http://www.apache.org/licenses/LICENSE-2.0
>>>>
>>>> Unless required by applicable law or agreed to in
>>>> writing, software
>>>> distributed under the License is distributed on
>>>> an "AS IS" BASIS,
>>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
>>>> either express or implied.
>>>> See the License for the specific language
>>>> governing permissions and
>>>> limitations under the License.
>>>> -->
>>>> <?xml-stylesheet type="text/xsl"
>>>> href="configuration.xsl"?>
>>>>
>>>> <configuration>
>>>> <!-- Put your site-specific accumulo
>>>> configurations here. The available configuration
>>>> values along with their defaults are documented in
>>>> docs/config.html Unless
>>>> you are simply testing at your workstation, you
>>>> will most definitely need to change the three
>>>> entries below. -->
>>>>
>>>> <property>
>>>> <name>instance.zookeeper.host</name>
>>>>
>>>> <value>hadoop-node-1:2181,
>>>> hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:
>>>> 2181,hadoop-node-5:2181</value>
>>>> <description>comma separated list of zookeeper
>>>> servers</description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>logger.dir.walog</name>
>>>> <value>walogs</value>
>>>> <description>The property only needs to be set
>>>> if upgrading from 1.4 which used to store
>>>> write-ahead logs on the local
>>>> filesystem. In 1.5 write-ahead logs are
>>>> stored in DFS. When 1.5 is started for the first
>>>> time it will copy any 1.4
>>>> write ahead logs into DFS. It is possible to
>>>> specify a comma-separated list of directories.
>>>> </description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>instance.secret</name>
>>>> <value></value>
>>>> <description>A secret unique to a given
>>>> instance that all servers must know in order to
>>>> communicate with one another.
>>>> Change it before initialization. To
>>>> change it later use ./bin/accumulo
>>>> org.apache.accumulo.server.util.ChangeSecret --old
>>>> [oldpasswd] --new [newpasswd],
>>>> and then update this file.
>>>> </description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.memory.maps.max</name>
>>>> <value>1G</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.cache.data.size</name>
>>>> <value>128M</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.cache.index.size</name>
>>>> <value>128M</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>trace.token.property.password</name>
>>>> <!-- change this to the root user's password,
>>>> and/or change the user below -->
>>>> <value></value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>trace.user</name>
>>>> <value>root</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>general.classpaths</name>
>>>> <value>
>>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/
>>>> common/lib/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/
>>>> mapreduce/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>>> /usr/lib/hadoop/.*.jar,
>>>> /usr/lib/hadoop/lib/.*.jar,
>>>> /usr/lib/hadoop-hdfs/.*.jar,
>>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>>> /usr/lib/hadoop-yarn/.*.jar,
>>>> $ACCUMULO_HOME/server/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>>> $ACCUMULO_HOME/core/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>>> $ACCUMULO_HOME/start/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>>> $ACCUMULO_HOME/fate/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>>> $ACCUMULO_HOME/proxy/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>>> $HADOOP_CONF_DIR,
>>>> $HADOOP_PREFIX/[^.].*.jar,
>>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>>> </value>
>>>> <description>Classpaths that accumulo checks
>>>> for updates and class files.
>>>> When using the Security Manager, please
>>>> remove the ".../target/classes/" values.
>>>> </description>
>>>> </property>
>>>> </configuration>
>>>>
>>>>
>>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser
>>>> <josh.elser@gmail.com <mailto:josh.elser@gmail.com
>>>> >>
>>>>
>>>> wrote:
>>>>
>>>> Posting your accumulo-site.xml (filtering out
>>>> instance.secret and trace.password before you
>>>> post) would also help us figure out what exactly
>>>> is going on.
>>>>
>>>>
>>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>>
>>>> Which version of Accumulo are you using?
>>>>
>>>> You might be missing the hadoop libraries
>>>> from your classpath. For this,
>>>> you would check your accumulo-site.xml and
>>>> find the comment about Hadoop
>>>> 2 in the file.
>>>>
>>>>
>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin
>>>> Parrish
>>>> <benjamin.d.parrish@gmail.com
>>>> <ma...@gmail.com>
>>>> <mailto:benjamin.d.parrish@__gmail.com
>>>>
>>>> <ma...@gmail.com>>>
>>>> wrote:
>>>>
>>>> I have a couple of issues when trying
>>>> to use Accumulo on Hadoop 2.2.0
>>>>
>>>> 1) I start with accumulo init and
>>>> everything runs through just fine,
>>>> but I can find '/accumulo' using
>>>> 'hadoop fs -ls /'
>>>>
>>>> 2) I try to run 'accumulo shell -u
>>>> root' and it says that that
>>>> Hadoop and ZooKeeper are not started,
>>>> but if I run 'jps' on the each
>>>> cluster node it shows all the necessary
>>>> processes for both in the
>>>> JVM. Is there something I am missing?
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860 <tel:540-597-7860>
>>>> <tel:540-597-7860 <tel:540-597-7860>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860
>>>>
>>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Eric Newton <er...@gmail.com>.
>
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
> stack guard. The VM will try to fix the stack guard no
> w.
> It's highly recommended that you fix the library with 'execstack -c
> <libfile>', or link it with '-z noexecstack'.
This is not causing your problem, but the binaries are 32-bit and need to
be recompiled for a 64-bit environment. This message is just bogus.
-Eric
On Tue, Mar 18, 2014 at 12:07 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> on all 5 nodes there is a conf/accumulo-site.xml with the same values for
> all 5.
>
> someone is going to kill me when they find out that i left off a bracket
> or semi-colon somewhere...
>
>
> On Tue, Mar 18, 2014 at 12:02 PM, Josh Elser <jo...@gmail.com> wrote:
>
>> No, running `accumulo init` on a single host is sufficient.
>>
>> Is accumulo-site.xml consistent across all machines?
>>
>>
>> On 3/18/14, 11:57 AM, Benjamin Parrish wrote:
>>
>>> So here is the error from the tablet server...
>>>
>>> 2014-03-18 10:38:43,456 [client.ZooKeeperInstance] ERROR: unable obtain
>>> instance id at /accumulo/instance_id
>>> 2014-03-18 10:38:43,456 [tabletserver.TabletServer] ERROR: Uncaught
>>> exception in TabletServer.main, exiting
>>> java.lang.RuntimeException: Accumulo not initialized, there is no
>>> instance id at /accumulo/instance_id
>>> at
>>> org.apache.accumulo.core.client.ZooKeeperInstance.getInstanceIDFromHdfs(
>>> ZooKeeperInstance.java:295)
>>> at
>>> org.apache.accumulo.server.client.HdfsZooInstance._
>>> getInstanceID(HdfsZooInstance.java:126)
>>> at
>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>> getInstanceID(HdfsZooInstance.java:119)
>>> at
>>> org.apache.accumulo.server.conf.ZooConfiguration.
>>> getInstance(ZooConfiguration.java:55)
>>> at
>>> org.apache.accumulo.server.conf.ServerConfiguration.getZooConfiguration(
>>> ServerConfiguration.java:50)
>>> at
>>> org.apache.accumulo.server.conf.ServerConfiguration.getConfiguration(
>>> ServerConfiguration.java:104)
>>> at org.apache.accumulo.server.Accumulo.init(Accumulo.java:98)
>>> at
>>> org.apache.accumulo.server.tabletserver.TabletServer.
>>> main(TabletServer.java:3249)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>> NativeMethodAccessorImpl.java:57)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>> DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>>> at java.lang.Thread.run(Thread.java:744)
>>>
>>> Do I need to run bin/accumulo init on every box in the cluster?
>>>
>>>
>>> On Tue, Mar 18, 2014 at 11:19 AM, Eric Newton <eric.newton@gmail.com
>>> <ma...@gmail.com>> wrote:
>>>
>>> Port numbers (for 1.5+)
>>>
>>> 4560 Accumulo monitor (for centralized log display)
>>> 9997 Tablet Server
>>> 9999 Master Server
>>> 12234 Accumulo Tracer
>>> 50091 Accumulo GC
>>> 50095 Accumulo HTTP monitor
>>>
>>>
>>> On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish
>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>>
>>> wrote:
>>>
>>> First off, are there specific ports that need to be opened up
>>> for accumulo? I have hadoop operating without any issues as a 5
>>> node cluster. Zookeeper seems to be operating with 2181, 3888,
>>> 2888 ports open.
>>>
>>> Here is some data from trying to get everything started and
>>> getting into the shell. I discluded the bash portion as Eric
>>> suggested because the mailing list rejected it for length and
>>> thinking it was spam.
>>>
>>> bin/start-all.sh
>>>
>>> [root@hadoop-node-1 zookeeper]# bash -x
>>> /usr/local/accumulo/bin/start-all.sh
>>> Starting monitor on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>> Starting tablet servers ....... done
>>> Starting tablet server on hadoop-node-3
>>> Starting tablet server on hadoop-node-5
>>> Starting tablet server on hadoop-node-2
>>> Starting tablet server on hadoop-node-4
>>> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
>>> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
>>> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
>>> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>>> might have disabled stack guard. The VM will try to fix the
>>> stack guard no
>>> w.
>>> It's highly recommended that you fix the library with 'execstack
>>> -c <libfile>', or link it with '-z noexecstack'.
>>> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to
>>> load native-hadoop library for your platform... using
>>> builtin-java classes where applicable
>>> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to
>>> talk to zookeeper
>>> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper
>>> connected and initialized, attemping to talk to HDFS
>>> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to
>>> HDFS
>>> Starting master on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>> Starting garbage collector on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>> Starting tracer on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>
>>> starting shell as root...
>>>
>>> [root@hadoop-node-1 zookeeper]# bash -x
>>> /usr/local/accumulo/bin/accumulo shell -u root
>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>>> might have disabled stack guard. The VM will try to fix the
>>> stack guard no
>>> w.
>>> It's highly recommended that you fix the library with 'execstack
>>> -c <libfile>', or link it with '-z noexecstack'.
>>> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to
>>> load native-hadoop library for your platform... using
>>> builtin-java classes where applicable
>>> Password: ****
>>> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no
>>> tablet servers: check that zookeeper and accumulo are running.
>>>
>>> ... this is the point where it sits and acts like it doesn't do
>>> anything
>>>
>>> -- LOGS -- (most of this looks to be that I cannot connect to
>>> anything)
>>>
>>> here is the tail -f
>>> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>>>
>>> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to
>>> locate tablet for table : !0 row : ~err_
>>> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to
>>> obtain problem reports
>>> java.lang.RuntimeException:
>>> org.apache.accumulo.core.client.impl.ThriftScanner$
>>> ScanTimedOutException
>>> at
>>> org.apache.accumulo.core.client.impl.ScannerIterator.
>>> hasNext(ScannerIterator.java:174)
>>> at
>>> org.apache.accumulo.server.problems.ProblemReports$3.
>>> hasNext(ProblemReports.java:241)
>>> at
>>> org.apache.accumulo.server.problems.ProblemReports.
>>> summarize(ProblemReports.java:299)
>>> at
>>> org.apache.accumulo.server.monitor.Monitor.fetchData(
>>> Monitor.java:399)
>>> at
>>> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.
>>> java:530)
>>> at
>>> org.apache.accumulo.core.util.LoggingRunnable.run(
>>> LoggingRunnable.java:34)
>>> at java.lang.Thread.run(Thread.java:744)
>>> Caused by:
>>> org.apache.accumulo.core.client.impl.ThriftScanner$
>>> ScanTimedOutException
>>> at
>>> org.apache.accumulo.core.client.impl.ThriftScanner.
>>> scan(ThriftScanner.java:212)
>>> at
>>> org.apache.accumulo.core.client.impl.ScannerIterator$
>>> Reader.run(ScannerIterator.java:82)
>>> at
>>> org.apache.accumulo.core.client.impl.ScannerIterator.
>>> hasNext(ScannerIterator.java:164)
>>> ... 6 more
>>>
>>> here is the tail -f
>>> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>>>
>>> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService
>>> request failed null, retrying ...
>>> org.apache.thrift.transport.TTransportException: Failed to
>>> connect to a server
>>> at
>>> org.apache.accumulo.core.client.impl.ThriftTransportPool.
>>> getAnyTransport(ThriftTransportPool.java:455)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.
>>> getConnection(ServerClient.java:154)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.
>>> getConnection(ServerClient.java:128)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.
>>> getConnection(ServerClient.java:123)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.
>>> executeRaw(ServerClient.java:105)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.
>>> execute(ServerClient.java:71)
>>> at
>>> org.apache.accumulo.core.client.impl.ConnectorImpl.<
>>> init>(ConnectorImpl.java:64)
>>> at
>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>> getConnector(HdfsZooInstance.java:154)
>>> at
>>> org.apache.accumulo.server.client.HdfsZooInstance.
>>> getConnector(HdfsZooInstance.java:149)
>>> at
>>> org.apache.accumulo.server.trace.TraceServer.<init>(
>>> TraceServer.java:200)
>>> at
>>> org.apache.accumulo.server.trace.TraceServer.main(
>>> TraceServer.java:295)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>> Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(
>>> NativeMethodAccessorImpl.java:57)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>>> DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>>> at java.lang.Thread.run(Thread.java:744)
>>>
>>>
>>> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton
>>> <eric.newton@gmail.com <ma...@gmail.com>> wrote:
>>>
>>> Can you post the exact error message you are seeing?
>>>
>>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being
>>> set properly in accumulo-site.xml.
>>>
>>> The output of:
>>>
>>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>>
>>>
>>> would also help.
>>>
>>> It's going to be something simple.
>>>
>>>
>>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish
>>> <benjamin.d.parrish@gmail.com
>>> <ma...@gmail.com>> wrote:
>>>
>>> Looking to see if there was an answer to this issue or
>>> if you could point me in a direction or example that
>>> could lead to a solution.
>>>
>>>
>>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish
>>> <benjamin.d.parrish@gmail.com
>>> <ma...@gmail.com>> wrote:
>>>
>>> I am running Accumulo 1.5.1
>>>
>>> <?xml version="1.0" encoding="UTF-8"?>
>>> <!--
>>> Licensed to the Apache Software Foundation (ASF)
>>> under one or more
>>> contributor license agreements. See the NOTICE
>>> file distributed with
>>> this work for additional information regarding
>>> copyright ownership.
>>> The ASF licenses this file to You under the
>>> Apache License, Version 2.0
>>> (the "License"); you may not use this file except
>>> in compliance with
>>> the License. You may obtain a copy of the
>>> License at
>>>
>>> http://www.apache.org/licenses/LICENSE-2.0
>>>
>>> Unless required by applicable law or agreed to in
>>> writing, software
>>> distributed under the License is distributed on
>>> an "AS IS" BASIS,
>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
>>> either express or implied.
>>> See the License for the specific language
>>> governing permissions and
>>> limitations under the License.
>>> -->
>>> <?xml-stylesheet type="text/xsl"
>>> href="configuration.xsl"?>
>>>
>>> <configuration>
>>> <!-- Put your site-specific accumulo
>>> configurations here. The available configuration
>>> values along with their defaults are documented in
>>> docs/config.html Unless
>>> you are simply testing at your workstation, you
>>> will most definitely need to change the three
>>> entries below. -->
>>>
>>> <property>
>>> <name>instance.zookeeper.host</name>
>>>
>>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-
>>> node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>>> <description>comma separated list of zookeeper
>>> servers</description>
>>> </property>
>>>
>>> <property>
>>> <name>logger.dir.walog</name>
>>> <value>walogs</value>
>>> <description>The property only needs to be set
>>> if upgrading from 1.4 which used to store
>>> write-ahead logs on the local
>>> filesystem. In 1.5 write-ahead logs are
>>> stored in DFS. When 1.5 is started for the first
>>> time it will copy any 1.4
>>> write ahead logs into DFS. It is possible to
>>> specify a comma-separated list of directories.
>>> </description>
>>> </property>
>>>
>>> <property>
>>> <name>instance.secret</name>
>>> <value></value>
>>> <description>A secret unique to a given
>>> instance that all servers must know in order to
>>> communicate with one another.
>>> Change it before initialization. To
>>> change it later use ./bin/accumulo
>>> org.apache.accumulo.server.util.ChangeSecret --old
>>> [oldpasswd] --new [newpasswd],
>>> and then update this file.
>>> </description>
>>> </property>
>>>
>>> <property>
>>> <name>tserver.memory.maps.max</name>
>>> <value>1G</value>
>>> </property>
>>>
>>> <property>
>>> <name>tserver.cache.data.size</name>
>>> <value>128M</value>
>>> </property>
>>>
>>> <property>
>>> <name>tserver.cache.index.size</name>
>>> <value>128M</value>
>>> </property>
>>>
>>> <property>
>>> <name>trace.token.property.password</name>
>>> <!-- change this to the root user's password,
>>> and/or change the user below -->
>>> <value></value>
>>> </property>
>>>
>>> <property>
>>> <name>trace.user</name>
>>> <value>root</value>
>>> </property>
>>>
>>> <property>
>>> <name>general.classpaths</name>
>>> <value>
>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/
>>> common/lib/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>> /usr/lib/hadoop/.*.jar,
>>> /usr/lib/hadoop/lib/.*.jar,
>>> /usr/lib/hadoop-hdfs/.*.jar,
>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>> /usr/lib/hadoop-yarn/.*.jar,
>>> $ACCUMULO_HOME/server/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>> $ACCUMULO_HOME/core/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>> $ACCUMULO_HOME/start/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>> $ACCUMULO_HOME/fate/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>> $ACCUMULO_HOME/proxy/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>> $HADOOP_CONF_DIR,
>>> $HADOOP_PREFIX/[^.].*.jar,
>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>> </value>
>>> <description>Classpaths that accumulo checks
>>> for updates and class files.
>>> When using the Security Manager, please
>>> remove the ".../target/classes/" values.
>>> </description>
>>> </property>
>>> </configuration>
>>>
>>>
>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser
>>> <josh.elser@gmail.com <ma...@gmail.com>>
>>>
>>> wrote:
>>>
>>> Posting your accumulo-site.xml (filtering out
>>> instance.secret and trace.password before you
>>> post) would also help us figure out what exactly
>>> is going on.
>>>
>>>
>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>
>>> Which version of Accumulo are you using?
>>>
>>> You might be missing the hadoop libraries
>>> from your classpath. For this,
>>> you would check your accumulo-site.xml and
>>> find the comment about Hadoop
>>> 2 in the file.
>>>
>>>
>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin
>>> Parrish
>>> <benjamin.d.parrish@gmail.com
>>> <ma...@gmail.com>
>>> <mailto:benjamin.d.parrish@__gmail.com
>>>
>>> <ma...@gmail.com>>>
>>> wrote:
>>>
>>> I have a couple of issues when trying
>>> to use Accumulo on Hadoop 2.2.0
>>>
>>> 1) I start with accumulo init and
>>> everything runs through just fine,
>>> but I can find '/accumulo' using
>>> 'hadoop fs -ls /'
>>>
>>> 2) I try to run 'accumulo shell -u
>>> root' and it says that that
>>> Hadoop and ZooKeeper are not started,
>>> but if I run 'jps' on the each
>>> cluster node it shows all the necessary
>>> processes for both in the
>>> JVM. Is there something I am missing?
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860 <tel:540-597-7860>
>>> <tel:540-597-7860 <tel:540-597-7860>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860 <tel:540-597-7860>
>>>
>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860 <tel:540-597-7860>
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860 <tel:540-597-7860>
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
on all 5 nodes there is a conf/accumulo-site.xml with the same values for
all 5.
someone is going to kill me when they find out that i left off a bracket or
semi-colon somewhere...
On Tue, Mar 18, 2014 at 12:02 PM, Josh Elser <jo...@gmail.com> wrote:
> No, running `accumulo init` on a single host is sufficient.
>
> Is accumulo-site.xml consistent across all machines?
>
>
> On 3/18/14, 11:57 AM, Benjamin Parrish wrote:
>
>> So here is the error from the tablet server...
>>
>> 2014-03-18 10:38:43,456 [client.ZooKeeperInstance] ERROR: unable obtain
>> instance id at /accumulo/instance_id
>> 2014-03-18 10:38:43,456 [tabletserver.TabletServer] ERROR: Uncaught
>> exception in TabletServer.main, exiting
>> java.lang.RuntimeException: Accumulo not initialized, there is no
>> instance id at /accumulo/instance_id
>> at
>> org.apache.accumulo.core.client.ZooKeeperInstance.getInstanceIDFromHdfs(
>> ZooKeeperInstance.java:295)
>> at
>> org.apache.accumulo.server.client.HdfsZooInstance._
>> getInstanceID(HdfsZooInstance.java:126)
>> at
>> org.apache.accumulo.server.client.HdfsZooInstance.
>> getInstanceID(HdfsZooInstance.java:119)
>> at
>> org.apache.accumulo.server.conf.ZooConfiguration.
>> getInstance(ZooConfiguration.java:55)
>> at
>> org.apache.accumulo.server.conf.ServerConfiguration.getZooConfiguration(
>> ServerConfiguration.java:50)
>> at
>> org.apache.accumulo.server.conf.ServerConfiguration.getConfiguration(
>> ServerConfiguration.java:104)
>> at org.apache.accumulo.server.Accumulo.init(Accumulo.java:98)
>> at
>> org.apache.accumulo.server.tabletserver.TabletServer.
>> main(TabletServer.java:3249)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(
>> NativeMethodAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>> at java.lang.Thread.run(Thread.java:744)
>>
>> Do I need to run bin/accumulo init on every box in the cluster?
>>
>>
>> On Tue, Mar 18, 2014 at 11:19 AM, Eric Newton <eric.newton@gmail.com
>> <ma...@gmail.com>> wrote:
>>
>> Port numbers (for 1.5+)
>>
>> 4560 Accumulo monitor (for centralized log display)
>> 9997 Tablet Server
>> 9999 Master Server
>> 12234 Accumulo Tracer
>> 50091 Accumulo GC
>> 50095 Accumulo HTTP monitor
>>
>>
>> On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish
>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>
>> wrote:
>>
>> First off, are there specific ports that need to be opened up
>> for accumulo? I have hadoop operating without any issues as a 5
>> node cluster. Zookeeper seems to be operating with 2181, 3888,
>> 2888 ports open.
>>
>> Here is some data from trying to get everything started and
>> getting into the shell. I discluded the bash portion as Eric
>> suggested because the mailing list rejected it for length and
>> thinking it was spam.
>>
>> bin/start-all.sh
>>
>> [root@hadoop-node-1 zookeeper]# bash -x
>> /usr/local/accumulo/bin/start-all.sh
>> Starting monitor on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>> Starting tablet servers ....... done
>> Starting tablet server on hadoop-node-3
>> Starting tablet server on hadoop-node-5
>> Starting tablet server on hadoop-node-2
>> Starting tablet server on hadoop-node-4
>> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
>> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
>> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
>> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>> might have disabled stack guard. The VM will try to fix the
>> stack guard no
>> w.
>> It's highly recommended that you fix the library with 'execstack
>> -c <libfile>', or link it with '-z noexecstack'.
>> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to
>> load native-hadoop library for your platform... using
>> builtin-java classes where applicable
>> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to
>> talk to zookeeper
>> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper
>> connected and initialized, attemping to talk to HDFS
>> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to HDFS
>> Starting master on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>> Starting garbage collector on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>> Starting tracer on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>
>> starting shell as root...
>>
>> [root@hadoop-node-1 zookeeper]# bash -x
>> /usr/local/accumulo/bin/accumulo shell -u root
>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
>> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
>> might have disabled stack guard. The VM will try to fix the
>> stack guard no
>> w.
>> It's highly recommended that you fix the library with 'execstack
>> -c <libfile>', or link it with '-z noexecstack'.
>> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to
>> load native-hadoop library for your platform... using
>> builtin-java classes where applicable
>> Password: ****
>> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no
>> tablet servers: check that zookeeper and accumulo are running.
>>
>> ... this is the point where it sits and acts like it doesn't do
>> anything
>>
>> -- LOGS -- (most of this looks to be that I cannot connect to
>> anything)
>>
>> here is the tail -f
>> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>>
>> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to
>> locate tablet for table : !0 row : ~err_
>> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to
>> obtain problem reports
>> java.lang.RuntimeException:
>> org.apache.accumulo.core.client.impl.ThriftScanner$
>> ScanTimedOutException
>> at
>> org.apache.accumulo.core.client.impl.ScannerIterator.
>> hasNext(ScannerIterator.java:174)
>> at
>> org.apache.accumulo.server.problems.ProblemReports$3.
>> hasNext(ProblemReports.java:241)
>> at
>> org.apache.accumulo.server.problems.ProblemReports.
>> summarize(ProblemReports.java:299)
>> at
>> org.apache.accumulo.server.monitor.Monitor.fetchData(
>> Monitor.java:399)
>> at
>> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.
>> java:530)
>> at
>> org.apache.accumulo.core.util.LoggingRunnable.run(
>> LoggingRunnable.java:34)
>> at java.lang.Thread.run(Thread.java:744)
>> Caused by:
>> org.apache.accumulo.core.client.impl.ThriftScanner$
>> ScanTimedOutException
>> at
>> org.apache.accumulo.core.client.impl.ThriftScanner.
>> scan(ThriftScanner.java:212)
>> at
>> org.apache.accumulo.core.client.impl.ScannerIterator$
>> Reader.run(ScannerIterator.java:82)
>> at
>> org.apache.accumulo.core.client.impl.ScannerIterator.
>> hasNext(ScannerIterator.java:164)
>> ... 6 more
>>
>> here is the tail -f
>> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>>
>> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService
>> request failed null, retrying ...
>> org.apache.thrift.transport.TTransportException: Failed to
>> connect to a server
>> at
>> org.apache.accumulo.core.client.impl.ThriftTransportPool.
>> getAnyTransport(ThriftTransportPool.java:455)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.
>> getConnection(ServerClient.java:154)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.
>> getConnection(ServerClient.java:128)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.
>> getConnection(ServerClient.java:123)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.
>> executeRaw(ServerClient.java:105)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.
>> execute(ServerClient.java:71)
>> at
>> org.apache.accumulo.core.client.impl.ConnectorImpl.<
>> init>(ConnectorImpl.java:64)
>> at
>> org.apache.accumulo.server.client.HdfsZooInstance.
>> getConnector(HdfsZooInstance.java:154)
>> at
>> org.apache.accumulo.server.client.HdfsZooInstance.
>> getConnector(HdfsZooInstance.java:149)
>> at
>> org.apache.accumulo.server.trace.TraceServer.<init>(
>> TraceServer.java:200)
>> at
>> org.apache.accumulo.server.trace.TraceServer.main(
>> TraceServer.java:295)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(
>> NativeMethodAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>> at java.lang.Thread.run(Thread.java:744)
>>
>>
>> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton
>> <eric.newton@gmail.com <ma...@gmail.com>> wrote:
>>
>> Can you post the exact error message you are seeing?
>>
>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being
>> set properly in accumulo-site.xml.
>>
>> The output of:
>>
>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>
>>
>> would also help.
>>
>> It's going to be something simple.
>>
>>
>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish
>> <benjamin.d.parrish@gmail.com
>> <ma...@gmail.com>> wrote:
>>
>> Looking to see if there was an answer to this issue or
>> if you could point me in a direction or example that
>> could lead to a solution.
>>
>>
>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish
>> <benjamin.d.parrish@gmail.com
>> <ma...@gmail.com>> wrote:
>>
>> I am running Accumulo 1.5.1
>>
>> <?xml version="1.0" encoding="UTF-8"?>
>> <!--
>> Licensed to the Apache Software Foundation (ASF)
>> under one or more
>> contributor license agreements. See the NOTICE
>> file distributed with
>> this work for additional information regarding
>> copyright ownership.
>> The ASF licenses this file to You under the
>> Apache License, Version 2.0
>> (the "License"); you may not use this file except
>> in compliance with
>> the License. You may obtain a copy of the License
>> at
>>
>> http://www.apache.org/licenses/LICENSE-2.0
>>
>> Unless required by applicable law or agreed to in
>> writing, software
>> distributed under the License is distributed on
>> an "AS IS" BASIS,
>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
>> either express or implied.
>> See the License for the specific language
>> governing permissions and
>> limitations under the License.
>> -->
>> <?xml-stylesheet type="text/xsl"
>> href="configuration.xsl"?>
>>
>> <configuration>
>> <!-- Put your site-specific accumulo
>> configurations here. The available configuration
>> values along with their defaults are documented in
>> docs/config.html Unless
>> you are simply testing at your workstation, you
>> will most definitely need to change the three
>> entries below. -->
>>
>> <property>
>> <name>instance.zookeeper.host</name>
>>
>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-
>> node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>> <description>comma separated list of zookeeper
>> servers</description>
>> </property>
>>
>> <property>
>> <name>logger.dir.walog</name>
>> <value>walogs</value>
>> <description>The property only needs to be set
>> if upgrading from 1.4 which used to store
>> write-ahead logs on the local
>> filesystem. In 1.5 write-ahead logs are
>> stored in DFS. When 1.5 is started for the first
>> time it will copy any 1.4
>> write ahead logs into DFS. It is possible to
>> specify a comma-separated list of directories.
>> </description>
>> </property>
>>
>> <property>
>> <name>instance.secret</name>
>> <value></value>
>> <description>A secret unique to a given
>> instance that all servers must know in order to
>> communicate with one another.
>> Change it before initialization. To
>> change it later use ./bin/accumulo
>> org.apache.accumulo.server.util.ChangeSecret --old
>> [oldpasswd] --new [newpasswd],
>> and then update this file.
>> </description>
>> </property>
>>
>> <property>
>> <name>tserver.memory.maps.max</name>
>> <value>1G</value>
>> </property>
>>
>> <property>
>> <name>tserver.cache.data.size</name>
>> <value>128M</value>
>> </property>
>>
>> <property>
>> <name>tserver.cache.index.size</name>
>> <value>128M</value>
>> </property>
>>
>> <property>
>> <name>trace.token.property.password</name>
>> <!-- change this to the root user's password,
>> and/or change the user below -->
>> <value></value>
>> </property>
>>
>> <property>
>> <name>trace.user</name>
>> <value>root</value>
>> </property>
>>
>> <property>
>> <name>general.classpaths</name>
>> <value>
>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>> /usr/lib/hadoop/.*.jar,
>> /usr/lib/hadoop/lib/.*.jar,
>> /usr/lib/hadoop-hdfs/.*.jar,
>> /usr/lib/hadoop-mapreduce/.*.jar,
>> /usr/lib/hadoop-yarn/.*.jar,
>> $ACCUMULO_HOME/server/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>> $ACCUMULO_HOME/core/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>> $ACCUMULO_HOME/start/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>> $ACCUMULO_HOME/fate/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>> $ACCUMULO_HOME/proxy/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>> $ACCUMULO_HOME/lib/[^.].*.jar,
>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>> $HADOOP_CONF_DIR,
>> $HADOOP_PREFIX/[^.].*.jar,
>> $HADOOP_PREFIX/lib/[^.].*.jar,
>> </value>
>> <description>Classpaths that accumulo checks
>> for updates and class files.
>> When using the Security Manager, please
>> remove the ".../target/classes/" values.
>> </description>
>> </property>
>> </configuration>
>>
>>
>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser
>> <josh.elser@gmail.com <ma...@gmail.com>>
>>
>> wrote:
>>
>> Posting your accumulo-site.xml (filtering out
>> instance.secret and trace.password before you
>> post) would also help us figure out what exactly
>> is going on.
>>
>>
>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>
>> Which version of Accumulo are you using?
>>
>> You might be missing the hadoop libraries
>> from your classpath. For this,
>> you would check your accumulo-site.xml and
>> find the comment about Hadoop
>> 2 in the file.
>>
>>
>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin
>> Parrish
>> <benjamin.d.parrish@gmail.com
>> <ma...@gmail.com>
>> <mailto:benjamin.d.parrish@__gmail.com
>>
>> <ma...@gmail.com>>>
>> wrote:
>>
>> I have a couple of issues when trying
>> to use Accumulo on Hadoop 2.2.0
>>
>> 1) I start with accumulo init and
>> everything runs through just fine,
>> but I can find '/accumulo' using
>> 'hadoop fs -ls /'
>>
>> 2) I try to run 'accumulo shell -u
>> root' and it says that that
>> Hadoop and ZooKeeper are not started,
>> but if I run 'jps' on the each
>> cluster node it shows all the necessary
>> processes for both in the
>> JVM. Is there something I am missing?
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860 <tel:540-597-7860>
>> <tel:540-597-7860 <tel:540-597-7860>>
>>
>>
>>
>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860 <tel:540-597-7860>
>>
>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860 <tel:540-597-7860>
>>
>>
>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860 <tel:540-597-7860>
>>
>>
>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Josh Elser <jo...@gmail.com>.
No, running `accumulo init` on a single host is sufficient.
Is accumulo-site.xml consistent across all machines?
On 3/18/14, 11:57 AM, Benjamin Parrish wrote:
> So here is the error from the tablet server...
>
> 2014-03-18 10:38:43,456 [client.ZooKeeperInstance] ERROR: unable obtain
> instance id at /accumulo/instance_id
> 2014-03-18 10:38:43,456 [tabletserver.TabletServer] ERROR: Uncaught
> exception in TabletServer.main, exiting
> java.lang.RuntimeException: Accumulo not initialized, there is no
> instance id at /accumulo/instance_id
> at
> org.apache.accumulo.core.client.ZooKeeperInstance.getInstanceIDFromHdfs(ZooKeeperInstance.java:295)
> at
> org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:126)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:119)
> at
> org.apache.accumulo.server.conf.ZooConfiguration.getInstance(ZooConfiguration.java:55)
> at
> org.apache.accumulo.server.conf.ServerConfiguration.getZooConfiguration(ServerConfiguration.java:50)
> at
> org.apache.accumulo.server.conf.ServerConfiguration.getConfiguration(ServerConfiguration.java:104)
> at org.apache.accumulo.server.Accumulo.init(Accumulo.java:98)
> at
> org.apache.accumulo.server.tabletserver.TabletServer.main(TabletServer.java:3249)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.accumulo.start.Main$1.run(Main.java:103)
> at java.lang.Thread.run(Thread.java:744)
>
> Do I need to run bin/accumulo init on every box in the cluster?
>
>
> On Tue, Mar 18, 2014 at 11:19 AM, Eric Newton <eric.newton@gmail.com
> <ma...@gmail.com>> wrote:
>
> Port numbers (for 1.5+)
>
> 4560 Accumulo monitor (for centralized log display)
> 9997 Tablet Server
> 9999 Master Server
> 12234 Accumulo Tracer
> 50091 Accumulo GC
> 50095 Accumulo HTTP monitor
>
>
> On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
> wrote:
>
> First off, are there specific ports that need to be opened up
> for accumulo? I have hadoop operating without any issues as a 5
> node cluster. Zookeeper seems to be operating with 2181, 3888,
> 2888 ports open.
>
> Here is some data from trying to get everything started and
> getting into the shell. I discluded the bash portion as Eric
> suggested because the mailing list rejected it for length and
> thinking it was spam.
>
> bin/start-all.sh
>
> [root@hadoop-node-1 zookeeper]# bash -x
> /usr/local/accumulo/bin/start-all.sh
> Starting monitor on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting tablet servers ....... done
> Starting tablet server on hadoop-node-3
> Starting tablet server on hadoop-node-5
> Starting tablet server on hadoop-node-2
> Starting tablet server on hadoop-node-4
> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
> might have disabled stack guard. The VM will try to fix the
> stack guard no
> w.
> It's highly recommended that you fix the library with 'execstack
> -c <libfile>', or link it with '-z noexecstack'.
> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to
> load native-hadoop library for your platform... using
> builtin-java classes where applicable
> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to
> talk to zookeeper
> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper
> connected and initialized, attemping to talk to HDFS
> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to HDFS
> Starting master on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting garbage collector on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting tracer on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>
> starting shell as root...
>
> [root@hadoop-node-1 zookeeper]# bash -x
> /usr/local/accumulo/bin/accumulo shell -u root
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded
> library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which
> might have disabled stack guard. The VM will try to fix the
> stack guard no
> w.
> It's highly recommended that you fix the library with 'execstack
> -c <libfile>', or link it with '-z noexecstack'.
> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to
> load native-hadoop library for your platform... using
> builtin-java classes where applicable
> Password: ****
> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no
> tablet servers: check that zookeeper and accumulo are running.
>
> ... this is the point where it sits and acts like it doesn't do
> anything
>
> -- LOGS -- (most of this looks to be that I cannot connect to
> anything)
>
> here is the tail -f
> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>
> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to
> locate tablet for table : !0 row : ~err_
> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to
> obtain problem reports
> java.lang.RuntimeException:
> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
> at
> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:174)
> at
> org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:241)
> at
> org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:299)
> at
> org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:399)
> at
> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.java:530)
> at
> org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> at java.lang.Thread.run(Thread.java:744)
> Caused by:
> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
> at
> org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:212)
> at
> org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:82)
> at
> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:164)
> ... 6 more
>
> here is the tail -f
> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>
> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService
> request failed null, retrying ...
> org.apache.thrift.transport.TTransportException: Failed to
> connect to a server
> at
> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:455)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:154)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
> at
> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
> at
> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
> at
> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
> at
> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:200)
> at
> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:295)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.accumulo.start.Main$1.run(Main.java:103)
> at java.lang.Thread.run(Thread.java:744)
>
>
> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton
> <eric.newton@gmail.com <ma...@gmail.com>> wrote:
>
> Can you post the exact error message you are seeing?
>
> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being
> set properly in accumulo-site.xml.
>
> The output of:
>
> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>
>
> would also help.
>
> It's going to be something simple.
>
>
> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>> wrote:
>
> Looking to see if there was an answer to this issue or
> if you could point me in a direction or example that
> could lead to a solution.
>
>
> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>> wrote:
>
> I am running Accumulo 1.5.1
>
> <?xml version="1.0" encoding="UTF-8"?>
> <!--
> Licensed to the Apache Software Foundation (ASF)
> under one or more
> contributor license agreements. See the NOTICE
> file distributed with
> this work for additional information regarding
> copyright ownership.
> The ASF licenses this file to You under the
> Apache License, Version 2.0
> (the "License"); you may not use this file except
> in compliance with
> the License. You may obtain a copy of the License at
>
> http://www.apache.org/licenses/LICENSE-2.0
>
> Unless required by applicable law or agreed to in
> writing, software
> distributed under the License is distributed on
> an "AS IS" BASIS,
> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
> either express or implied.
> See the License for the specific language
> governing permissions and
> limitations under the License.
> -->
> <?xml-stylesheet type="text/xsl"
> href="configuration.xsl"?>
>
> <configuration>
> <!-- Put your site-specific accumulo
> configurations here. The available configuration
> values along with their defaults are documented in
> docs/config.html Unless
> you are simply testing at your workstation, you
> will most definitely need to change the three
> entries below. -->
>
> <property>
> <name>instance.zookeeper.host</name>
>
> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
> <description>comma separated list of zookeeper
> servers</description>
> </property>
>
> <property>
> <name>logger.dir.walog</name>
> <value>walogs</value>
> <description>The property only needs to be set
> if upgrading from 1.4 which used to store
> write-ahead logs on the local
> filesystem. In 1.5 write-ahead logs are
> stored in DFS. When 1.5 is started for the first
> time it will copy any 1.4
> write ahead logs into DFS. It is possible to
> specify a comma-separated list of directories.
> </description>
> </property>
>
> <property>
> <name>instance.secret</name>
> <value></value>
> <description>A secret unique to a given
> instance that all servers must know in order to
> communicate with one another.
> Change it before initialization. To
> change it later use ./bin/accumulo
> org.apache.accumulo.server.util.ChangeSecret --old
> [oldpasswd] --new [newpasswd],
> and then update this file.
> </description>
> </property>
>
> <property>
> <name>tserver.memory.maps.max</name>
> <value>1G</value>
> </property>
>
> <property>
> <name>tserver.cache.data.size</name>
> <value>128M</value>
> </property>
>
> <property>
> <name>tserver.cache.index.size</name>
> <value>128M</value>
> </property>
>
> <property>
> <name>trace.token.property.password</name>
> <!-- change this to the root user's password,
> and/or change the user below -->
> <value></value>
> </property>
>
> <property>
> <name>trace.user</name>
> <value>root</value>
> </property>
>
> <property>
> <name>general.classpaths</name>
> <value>
> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
> /usr/lib/hadoop/.*.jar,
> /usr/lib/hadoop/lib/.*.jar,
> /usr/lib/hadoop-hdfs/.*.jar,
> /usr/lib/hadoop-mapreduce/.*.jar,
> /usr/lib/hadoop-yarn/.*.jar,
> $ACCUMULO_HOME/server/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-server.jar,
> $ACCUMULO_HOME/core/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-core.jar,
> $ACCUMULO_HOME/start/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-start.jar,
> $ACCUMULO_HOME/fate/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-fate.jar,
> $ACCUMULO_HOME/proxy/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
> $ACCUMULO_HOME/lib/[^.].*.jar,
> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
> $HADOOP_CONF_DIR,
> $HADOOP_PREFIX/[^.].*.jar,
> $HADOOP_PREFIX/lib/[^.].*.jar,
> </value>
> <description>Classpaths that accumulo checks
> for updates and class files.
> When using the Security Manager, please
> remove the ".../target/classes/" values.
> </description>
> </property>
> </configuration>
>
>
> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser
> <josh.elser@gmail.com <ma...@gmail.com>>
> wrote:
>
> Posting your accumulo-site.xml (filtering out
> instance.secret and trace.password before you
> post) would also help us figure out what exactly
> is going on.
>
>
> On 3/16/14, 8:41 PM, Mike Drob wrote:
>
> Which version of Accumulo are you using?
>
> You might be missing the hadoop libraries
> from your classpath. For this,
> you would check your accumulo-site.xml and
> find the comment about Hadoop
> 2 in the file.
>
>
> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin
> Parrish
> <benjamin.d.parrish@gmail.com
> <ma...@gmail.com>
> <mailto:benjamin.d.parrish@__gmail.com
> <ma...@gmail.com>>> wrote:
>
> I have a couple of issues when trying
> to use Accumulo on Hadoop 2.2.0
>
> 1) I start with accumulo init and
> everything runs through just fine,
> but I can find '/accumulo' using
> 'hadoop fs -ls /'
>
> 2) I try to run 'accumulo shell -u
> root' and it says that that
> Hadoop and ZooKeeper are not started,
> but if I run 'jps' on the each
> cluster node it shows all the necessary
> processes for both in the
> JVM. Is there something I am missing?
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
> <tel:540-597-7860 <tel:540-597-7860>>
>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Mike Drob <ma...@cloudera.com>.
No, you shouldn't need to do that. Once is enough.
What are the hdfs permissions on /accumulo? And /accumulo/instance_id?
What user are you running your tablet servers as?
On Tue, Mar 18, 2014 at 11:57 AM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> So here is the error from the tablet server...
>
> 2014-03-18 10:38:43,456 [client.ZooKeeperInstance] ERROR: unable obtain
> instance id at /accumulo/instance_id
> 2014-03-18 10:38:43,456 [tabletserver.TabletServer] ERROR: Uncaught
> exception in TabletServer.main, exiting
> java.lang.RuntimeException: Accumulo not initialized, there is no instance
> id at /accumulo/instance_id
> at
> org.apache.accumulo.core.client.ZooKeeperInstance.getInstanceIDFromHdfs(ZooKeeperInstance.java:295)
> at
> org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:126)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:119)
> at
> org.apache.accumulo.server.conf.ZooConfiguration.getInstance(ZooConfiguration.java:55)
> at
> org.apache.accumulo.server.conf.ServerConfiguration.getZooConfiguration(ServerConfiguration.java:50)
> at
> org.apache.accumulo.server.conf.ServerConfiguration.getConfiguration(ServerConfiguration.java:104)
> at org.apache.accumulo.server.Accumulo.init(Accumulo.java:98)
> at
> org.apache.accumulo.server.tabletserver.TabletServer.main(TabletServer.java:3249)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.accumulo.start.Main$1.run(Main.java:103)
> at java.lang.Thread.run(Thread.java:744)
>
> Do I need to run bin/accumulo init on every box in the cluster?
>
>
> On Tue, Mar 18, 2014 at 11:19 AM, Eric Newton <er...@gmail.com>wrote:
>
>> Port numbers (for 1.5+)
>>
>> 4560 Accumulo monitor (for centralized log display)
>> 9997 Tablet Server
>> 9999 Master Server
>> 12234 Accumulo Tracer
>> 50091 Accumulo GC
>> 50095 Accumulo HTTP monitor
>>
>>
>> On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> First off, are there specific ports that need to be opened up for
>>> accumulo? I have hadoop operating without any issues as a 5 node cluster.
>>> Zookeeper seems to be operating with 2181, 3888, 2888 ports open.
>>>
>>> Here is some data from trying to get everything started and getting into
>>> the shell. I discluded the bash portion as Eric suggested because the
>>> mailing list rejected it for length and thinking it was spam.
>>>
>>> bin/start-all.sh
>>>
>>> [root@hadoop-node-1 zookeeper]# bash -x
>>> /usr/local/accumulo/bin/start-all.sh
>>> Starting monitor on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>> Starting tablet servers ....... done
>>> Starting tablet server on hadoop-node-3
>>> Starting tablet server on hadoop-node-5
>>> Starting tablet server on hadoop-node-2
>>> Starting tablet server on hadoop-node-4
>>> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
>>> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
>>> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
>>> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
>>> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
>>> stack guard. The VM will try to fix the stack guard no
>>> w.
>>> It's highly recommended that you fix the library with 'execstack -c
>>> <libfile>', or link it with '-z noexecstack'.
>>> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to load
>>> native-hadoop library for your platform... using builtin-java classes where
>>> applicable
>>> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to talk to
>>> zookeeper
>>> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper connected and
>>> initialized, attemping to talk to HDFS
>>> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to HDFS
>>> Starting master on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>> Starting garbage collector on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>> Starting tracer on hadoop-node-1
>>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>>
>>> starting shell as root...
>>>
>>> [root@hadoop-node-1 zookeeper]# bash -x
>>> /usr/local/accumulo/bin/accumulo shell -u root
>>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
>>> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
>>> stack guard. The VM will try to fix the stack guard no
>>> w.
>>> It's highly recommended that you fix the library with 'execstack -c
>>> <libfile>', or link it with '-z noexecstack'.
>>> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to load
>>> native-hadoop library for your platform... using builtin-java classes where
>>> applicable
>>> Password: ****
>>> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no tablet
>>> servers: check that zookeeper and accumulo are running.
>>>
>>> ... this is the point where it sits and acts like it doesn't do anything
>>>
>>> -- LOGS -- (most of this looks to be that I cannot connect to anything)
>>>
>>> here is the tail -f
>>> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>>>
>>> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to locate
>>> tablet for table : !0 row : ~err_
>>> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to obtain
>>> problem reports
>>> java.lang.RuntimeException:
>>> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
>>> at
>>> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:174)
>>> at
>>> org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:241)
>>> at
>>> org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:299)
>>> at
>>> org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:399)
>>> at
>>> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.java:530)
>>> at
>>> org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
>>> at java.lang.Thread.run(Thread.java:744)
>>> Caused by:
>>> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
>>> at
>>> org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:212)
>>> at
>>> org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:82)
>>> at
>>> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:164)
>>> ... 6 more
>>>
>>> here is the tail -f
>>> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>>>
>>> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService request
>>> failed null, retrying ...
>>> org.apache.thrift.transport.TTransportException: Failed to connect to a
>>> server
>>> at
>>> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:455)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:154)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
>>> at
>>> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
>>> at
>>> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
>>> at
>>> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
>>> at
>>> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
>>> at
>>> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:200)
>>> at
>>> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:295)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>>> at java.lang.Thread.run(Thread.java:744)
>>>
>>>
>>> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton <er...@gmail.com>wrote:
>>>
>>>> Can you post the exact error message you are seeing?
>>>>
>>>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being set
>>>> properly in accumulo-site.xml.
>>>>
>>>> The output of:
>>>>
>>>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>>>
>>>>
>>>> would also help.
>>>>
>>>> It's going to be something simple.
>>>>
>>>>
>>>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish <
>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>
>>>>> Looking to see if there was an answer to this issue or if you could
>>>>> point me in a direction or example that could lead to a solution.
>>>>>
>>>>>
>>>>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish <
>>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>>
>>>>>> I am running Accumulo 1.5.1
>>>>>>
>>>>>> <?xml version="1.0" encoding="UTF-8"?>
>>>>>> <!--
>>>>>> Licensed to the Apache Software Foundation (ASF) under one or more
>>>>>> contributor license agreements. See the NOTICE file distributed
>>>>>> with
>>>>>> this work for additional information regarding copyright ownership.
>>>>>> The ASF licenses this file to You under the Apache License, Version
>>>>>> 2.0
>>>>>> (the "License"); you may not use this file except in compliance with
>>>>>> the License. You may obtain a copy of the License at
>>>>>>
>>>>>> http://www.apache.org/licenses/LICENSE-2.0
>>>>>>
>>>>>> Unless required by applicable law or agreed to in writing, software
>>>>>> distributed under the License is distributed on an "AS IS" BASIS,
>>>>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
>>>>>> implied.
>>>>>> See the License for the specific language governing permissions and
>>>>>> limitations under the License.
>>>>>> -->
>>>>>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>>>>>>
>>>>>> <configuration>
>>>>>> <!-- Put your site-specific accumulo configurations here. The
>>>>>> available configuration values along with their defaults are documented in
>>>>>> docs/config.html Unless
>>>>>> you are simply testing at your workstation, you will most
>>>>>> definitely need to change the three entries below. -->
>>>>>>
>>>>>> <property>
>>>>>> <name>instance.zookeeper.host</name>
>>>>>>
>>>>>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>>>>>> <description>comma separated list of zookeeper
>>>>>> servers</description>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>logger.dir.walog</name>
>>>>>> <value>walogs</value>
>>>>>> <description>The property only needs to be set if upgrading from
>>>>>> 1.4 which used to store write-ahead logs on the local
>>>>>> filesystem. In 1.5 write-ahead logs are stored in DFS. When
>>>>>> 1.5 is started for the first time it will copy any 1.4
>>>>>> write ahead logs into DFS. It is possible to specify a
>>>>>> comma-separated list of directories.
>>>>>> </description>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>instance.secret</name>
>>>>>> <value></value>
>>>>>> <description>A secret unique to a given instance that all servers
>>>>>> must know in order to communicate with one another.
>>>>>> Change it before initialization. To
>>>>>> change it later use ./bin/accumulo
>>>>>> org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
>>>>>> [newpasswd],
>>>>>> and then update this file.
>>>>>> </description>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>tserver.memory.maps.max</name>
>>>>>> <value>1G</value>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>tserver.cache.data.size</name>
>>>>>> <value>128M</value>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>tserver.cache.index.size</name>
>>>>>> <value>128M</value>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>trace.token.property.password</name>
>>>>>> <!-- change this to the root user's password, and/or change the
>>>>>> user below -->
>>>>>> <value></value>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>trace.user</name>
>>>>>> <value>root</value>
>>>>>> </property>
>>>>>>
>>>>>> <property>
>>>>>> <name>general.classpaths</name>
>>>>>> <value>
>>>>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>>>>> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
>>>>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>>>>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>>>>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>>>>> /usr/lib/hadoop/.*.jar,
>>>>>> /usr/lib/hadoop/lib/.*.jar,
>>>>>> /usr/lib/hadoop-hdfs/.*.jar,
>>>>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>>>>> /usr/lib/hadoop-yarn/.*.jar,
>>>>>> $ACCUMULO_HOME/server/target/classes/,
>>>>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>>>>> $ACCUMULO_HOME/core/target/classes/,
>>>>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>>>>> $ACCUMULO_HOME/start/target/classes/,
>>>>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>>>>> $ACCUMULO_HOME/fate/target/classes/,
>>>>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>>>>> $ACCUMULO_HOME/proxy/target/classes/,
>>>>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>>>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>>>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>>>>> $HADOOP_CONF_DIR,
>>>>>> $HADOOP_PREFIX/[^.].*.jar,
>>>>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>>>>> </value>
>>>>>> <description>Classpaths that accumulo checks for updates and
>>>>>> class files.
>>>>>> When using the Security Manager, please remove the
>>>>>> ".../target/classes/" values.
>>>>>> </description>
>>>>>> </property>
>>>>>> </configuration>
>>>>>>
>>>>>>
>>>>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com>wrote:
>>>>>>
>>>>>>> Posting your accumulo-site.xml (filtering out instance.secret and
>>>>>>> trace.password before you post) would also help us figure out what exactly
>>>>>>> is going on.
>>>>>>>
>>>>>>>
>>>>>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>>>>>
>>>>>>>> Which version of Accumulo are you using?
>>>>>>>>
>>>>>>>> You might be missing the hadoop libraries from your classpath. For
>>>>>>>> this,
>>>>>>>> you would check your accumulo-site.xml and find the comment about
>>>>>>>> Hadoop
>>>>>>>> 2 in the file.
>>>>>>>>
>>>>>>>>
>>>>>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>>>>>>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>> I have a couple of issues when trying to use Accumulo on Hadoop
>>>>>>>> 2.2.0
>>>>>>>>
>>>>>>>> 1) I start with accumulo init and everything runs through just
>>>>>>>> fine,
>>>>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>>>>
>>>>>>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>>>>>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the
>>>>>>>> each
>>>>>>>> cluster node it shows all the necessary processes for both in
>>>>>>>> the
>>>>>>>> JVM. Is there something I am missing?
>>>>>>>>
>>>>>>>> --
>>>>>>>> Benjamin D. Parrish
>>>>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Benjamin D. Parrish
>>>>>> H: 540-597-7860
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
So here is the error from the tablet server...
2014-03-18 10:38:43,456 [client.ZooKeeperInstance] ERROR: unable obtain
instance id at /accumulo/instance_id
2014-03-18 10:38:43,456 [tabletserver.TabletServer] ERROR: Uncaught
exception in TabletServer.main, exiting
java.lang.RuntimeException: Accumulo not initialized, there is no instance
id at /accumulo/instance_id
at
org.apache.accumulo.core.client.ZooKeeperInstance.getInstanceIDFromHdfs(ZooKeeperInstance.java:295)
at
org.apache.accumulo.server.client.HdfsZooInstance._getInstanceID(HdfsZooInstance.java:126)
at
org.apache.accumulo.server.client.HdfsZooInstance.getInstanceID(HdfsZooInstance.java:119)
at
org.apache.accumulo.server.conf.ZooConfiguration.getInstance(ZooConfiguration.java:55)
at
org.apache.accumulo.server.conf.ServerConfiguration.getZooConfiguration(ServerConfiguration.java:50)
at
org.apache.accumulo.server.conf.ServerConfiguration.getConfiguration(ServerConfiguration.java:104)
at org.apache.accumulo.server.Accumulo.init(Accumulo.java:98)
at
org.apache.accumulo.server.tabletserver.TabletServer.main(TabletServer.java:3249)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.accumulo.start.Main$1.run(Main.java:103)
at java.lang.Thread.run(Thread.java:744)
Do I need to run bin/accumulo init on every box in the cluster?
On Tue, Mar 18, 2014 at 11:19 AM, Eric Newton <er...@gmail.com> wrote:
> Port numbers (for 1.5+)
>
> 4560 Accumulo monitor (for centralized log display)
> 9997 Tablet Server
> 9999 Master Server
> 12234 Accumulo Tracer
> 50091 Accumulo GC
> 50095 Accumulo HTTP monitor
>
>
> On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> First off, are there specific ports that need to be opened up for
>> accumulo? I have hadoop operating without any issues as a 5 node cluster.
>> Zookeeper seems to be operating with 2181, 3888, 2888 ports open.
>>
>> Here is some data from trying to get everything started and getting into
>> the shell. I discluded the bash portion as Eric suggested because the
>> mailing list rejected it for length and thinking it was spam.
>>
>> bin/start-all.sh
>>
>> [root@hadoop-node-1 zookeeper]# bash -x
>> /usr/local/accumulo/bin/start-all.sh
>> Starting monitor on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>> Starting tablet servers ....... done
>> Starting tablet server on hadoop-node-3
>> Starting tablet server on hadoop-node-5
>> Starting tablet server on hadoop-node-2
>> Starting tablet server on hadoop-node-4
>> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
>> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
>> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
>> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
>> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
>> stack guard. The VM will try to fix the stack guard no
>> w.
>> It's highly recommended that you fix the library with 'execstack -c
>> <libfile>', or link it with '-z noexecstack'.
>> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to talk to
>> zookeeper
>> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper connected and
>> initialized, attemping to talk to HDFS
>> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to HDFS
>> Starting master on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>> Starting garbage collector on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>> Starting tracer on hadoop-node-1
>> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>>
>> starting shell as root...
>>
>> [root@hadoop-node-1 zookeeper]# bash -x /usr/local/accumulo/bin/accumulo
>> shell -u root
>> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
>> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
>> stack guard. The VM will try to fix the stack guard no
>> w.
>> It's highly recommended that you fix the library with 'execstack -c
>> <libfile>', or link it with '-z noexecstack'.
>> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>> Password: ****
>> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no tablet
>> servers: check that zookeeper and accumulo are running.
>>
>> ... this is the point where it sits and acts like it doesn't do anything
>>
>> -- LOGS -- (most of this looks to be that I cannot connect to anything)
>>
>> here is the tail -f
>> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>>
>> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to locate
>> tablet for table : !0 row : ~err_
>> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to obtain
>> problem reports
>> java.lang.RuntimeException:
>> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
>> at
>> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:174)
>> at
>> org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:241)
>> at
>> org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:299)
>> at
>> org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:399)
>> at
>> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.java:530)
>> at
>> org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
>> at java.lang.Thread.run(Thread.java:744)
>> Caused by:
>> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
>> at
>> org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:212)
>> at
>> org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:82)
>> at
>> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:164)
>> ... 6 more
>>
>> here is the tail -f
>> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>>
>> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService request
>> failed null, retrying ...
>> org.apache.thrift.transport.TTransportException: Failed to connect to a
>> server
>> at
>> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:455)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:154)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
>> at
>> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
>> at
>> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
>> at
>> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
>> at
>> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
>> at
>> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:200)
>> at
>> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:295)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at org.apache.accumulo.start.Main$1.run(Main.java:103)
>> at java.lang.Thread.run(Thread.java:744)
>>
>>
>> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton <er...@gmail.com>wrote:
>>
>>> Can you post the exact error message you are seeing?
>>>
>>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being set
>>> properly in accumulo-site.xml.
>>>
>>> The output of:
>>>
>>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>>
>>>
>>> would also help.
>>>
>>> It's going to be something simple.
>>>
>>>
>>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish <
>>> benjamin.d.parrish@gmail.com> wrote:
>>>
>>>> Looking to see if there was an answer to this issue or if you could
>>>> point me in a direction or example that could lead to a solution.
>>>>
>>>>
>>>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish <
>>>> benjamin.d.parrish@gmail.com> wrote:
>>>>
>>>>> I am running Accumulo 1.5.1
>>>>>
>>>>> <?xml version="1.0" encoding="UTF-8"?>
>>>>> <!--
>>>>> Licensed to the Apache Software Foundation (ASF) under one or more
>>>>> contributor license agreements. See the NOTICE file distributed with
>>>>> this work for additional information regarding copyright ownership.
>>>>> The ASF licenses this file to You under the Apache License, Version
>>>>> 2.0
>>>>> (the "License"); you may not use this file except in compliance with
>>>>> the License. You may obtain a copy of the License at
>>>>>
>>>>> http://www.apache.org/licenses/LICENSE-2.0
>>>>>
>>>>> Unless required by applicable law or agreed to in writing, software
>>>>> distributed under the License is distributed on an "AS IS" BASIS,
>>>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
>>>>> implied.
>>>>> See the License for the specific language governing permissions and
>>>>> limitations under the License.
>>>>> -->
>>>>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>>>>>
>>>>> <configuration>
>>>>> <!-- Put your site-specific accumulo configurations here. The
>>>>> available configuration values along with their defaults are documented in
>>>>> docs/config.html Unless
>>>>> you are simply testing at your workstation, you will most
>>>>> definitely need to change the three entries below. -->
>>>>>
>>>>> <property>
>>>>> <name>instance.zookeeper.host</name>
>>>>>
>>>>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>>>>> <description>comma separated list of zookeeper
>>>>> servers</description>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>logger.dir.walog</name>
>>>>> <value>walogs</value>
>>>>> <description>The property only needs to be set if upgrading from
>>>>> 1.4 which used to store write-ahead logs on the local
>>>>> filesystem. In 1.5 write-ahead logs are stored in DFS. When 1.5
>>>>> is started for the first time it will copy any 1.4
>>>>> write ahead logs into DFS. It is possible to specify a
>>>>> comma-separated list of directories.
>>>>> </description>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>instance.secret</name>
>>>>> <value></value>
>>>>> <description>A secret unique to a given instance that all servers
>>>>> must know in order to communicate with one another.
>>>>> Change it before initialization. To
>>>>> change it later use ./bin/accumulo
>>>>> org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
>>>>> [newpasswd],
>>>>> and then update this file.
>>>>> </description>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>tserver.memory.maps.max</name>
>>>>> <value>1G</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>tserver.cache.data.size</name>
>>>>> <value>128M</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>tserver.cache.index.size</name>
>>>>> <value>128M</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>trace.token.property.password</name>
>>>>> <!-- change this to the root user's password, and/or change the
>>>>> user below -->
>>>>> <value></value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>trace.user</name>
>>>>> <value>root</value>
>>>>> </property>
>>>>>
>>>>> <property>
>>>>> <name>general.classpaths</name>
>>>>> <value>
>>>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>>>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>>>> /usr/lib/hadoop/.*.jar,
>>>>> /usr/lib/hadoop/lib/.*.jar,
>>>>> /usr/lib/hadoop-hdfs/.*.jar,
>>>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>>>> /usr/lib/hadoop-yarn/.*.jar,
>>>>> $ACCUMULO_HOME/server/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>>>> $ACCUMULO_HOME/core/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>>>> $ACCUMULO_HOME/start/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>>>> $ACCUMULO_HOME/fate/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>>>> $ACCUMULO_HOME/proxy/target/classes/,
>>>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>>>> $HADOOP_CONF_DIR,
>>>>> $HADOOP_PREFIX/[^.].*.jar,
>>>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>>>> </value>
>>>>> <description>Classpaths that accumulo checks for updates and class
>>>>> files.
>>>>> When using the Security Manager, please remove the
>>>>> ".../target/classes/" values.
>>>>> </description>
>>>>> </property>
>>>>> </configuration>
>>>>>
>>>>>
>>>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com>wrote:
>>>>>
>>>>>> Posting your accumulo-site.xml (filtering out instance.secret and
>>>>>> trace.password before you post) would also help us figure out what exactly
>>>>>> is going on.
>>>>>>
>>>>>>
>>>>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>>>>
>>>>>>> Which version of Accumulo are you using?
>>>>>>>
>>>>>>> You might be missing the hadoop libraries from your classpath. For
>>>>>>> this,
>>>>>>> you would check your accumulo-site.xml and find the comment about
>>>>>>> Hadoop
>>>>>>> 2 in the file.
>>>>>>>
>>>>>>>
>>>>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>>>>>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>>>>>> wrote:
>>>>>>>
>>>>>>> I have a couple of issues when trying to use Accumulo on Hadoop
>>>>>>> 2.2.0
>>>>>>>
>>>>>>> 1) I start with accumulo init and everything runs through just
>>>>>>> fine,
>>>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>>>
>>>>>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>>>>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the
>>>>>>> each
>>>>>>> cluster node it shows all the necessary processes for both in the
>>>>>>> JVM. Is there something I am missing?
>>>>>>>
>>>>>>> --
>>>>>>> Benjamin D. Parrish
>>>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860
>>>>
>>>
>>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Eric Newton <er...@gmail.com>.
Port numbers (for 1.5+)
4560 Accumulo monitor (for centralized log display)
9997 Tablet Server
9999 Master Server
12234 Accumulo Tracer
50091 Accumulo GC
50095 Accumulo HTTP monitor
On Tue, Mar 18, 2014 at 11:04 AM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> First off, are there specific ports that need to be opened up for
> accumulo? I have hadoop operating without any issues as a 5 node cluster.
> Zookeeper seems to be operating with 2181, 3888, 2888 ports open.
>
> Here is some data from trying to get everything started and getting into
> the shell. I discluded the bash portion as Eric suggested because the
> mailing list rejected it for length and thinking it was spam.
>
> bin/start-all.sh
>
> [root@hadoop-node-1 zookeeper]# bash -x
> /usr/local/accumulo/bin/start-all.sh
> Starting monitor on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting tablet servers ....... done
> Starting tablet server on hadoop-node-3
> Starting tablet server on hadoop-node-5
> Starting tablet server on hadoop-node-2
> Starting tablet server on hadoop-node-4
> WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
> WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
> stack guard. The VM will try to fix the stack guard no
> w.
> It's highly recommended that you fix the library with 'execstack -c
> <libfile>', or link it with '-z noexecstack'.
> 2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> 2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to talk to
> zookeeper
> 2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper connected and
> initialized, attemping to talk to HDFS
> 2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to HDFS
> Starting master on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting garbage collector on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
> Starting tracer on hadoop-node-1
> WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
>
> starting shell as root...
>
> [root@hadoop-node-1 zookeeper]# bash -x /usr/local/accumulo/bin/accumulo
> shell -u root
> Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
> /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
> stack guard. The VM will try to fix the stack guard no
> w.
> It's highly recommended that you fix the library with 'execstack -c
> <libfile>', or link it with '-z noexecstack'.
> 2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to load
> native-hadoop library for your platform... using builtin-java classes where
> applicable
> Password: ****
> 2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no tablet
> servers: check that zookeeper and accumulo are running.
>
> ... this is the point where it sits and acts like it doesn't do anything
>
> -- LOGS -- (most of this looks to be that I cannot connect to anything)
>
> here is the tail -f
> $ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
>
> 2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to locate
> tablet for table : !0 row : ~err_
> 2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to obtain problem
> reports
> java.lang.RuntimeException:
> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
> at
> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:174)
> at
> org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:241)
> at
> org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:299)
> at
> org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:399)
> at
> org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.java:530)
> at
> org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> at java.lang.Thread.run(Thread.java:744)
> Caused by:
> org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
> at
> org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:212)
> at
> org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:82)
> at
> org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:164)
> ... 6 more
>
> here is the tail -f
> $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
>
> 2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService request
> failed null, retrying ...
> org.apache.thrift.transport.TTransportException: Failed to connect to a
> server
> at
> org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:455)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:154)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
> at
> org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
> at
> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
> at
> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
> at
> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
> at
> org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
> at
> org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:200)
> at
> org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:295)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.accumulo.start.Main$1.run(Main.java:103)
> at java.lang.Thread.run(Thread.java:744)
>
>
> On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton <er...@gmail.com>wrote:
>
>> Can you post the exact error message you are seeing?
>>
>> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being set properly
>> in accumulo-site.xml.
>>
>> The output of:
>>
>> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>>
>>
>> would also help.
>>
>> It's going to be something simple.
>>
>>
>> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> Looking to see if there was an answer to this issue or if you could
>>> point me in a direction or example that could lead to a solution.
>>>
>>>
>>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish <
>>> benjamin.d.parrish@gmail.com> wrote:
>>>
>>>> I am running Accumulo 1.5.1
>>>>
>>>> <?xml version="1.0" encoding="UTF-8"?>
>>>> <!--
>>>> Licensed to the Apache Software Foundation (ASF) under one or more
>>>> contributor license agreements. See the NOTICE file distributed with
>>>> this work for additional information regarding copyright ownership.
>>>> The ASF licenses this file to You under the Apache License, Version
>>>> 2.0
>>>> (the "License"); you may not use this file except in compliance with
>>>> the License. You may obtain a copy of the License at
>>>>
>>>> http://www.apache.org/licenses/LICENSE-2.0
>>>>
>>>> Unless required by applicable law or agreed to in writing, software
>>>> distributed under the License is distributed on an "AS IS" BASIS,
>>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
>>>> implied.
>>>> See the License for the specific language governing permissions and
>>>> limitations under the License.
>>>> -->
>>>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>>>>
>>>> <configuration>
>>>> <!-- Put your site-specific accumulo configurations here. The
>>>> available configuration values along with their defaults are documented in
>>>> docs/config.html Unless
>>>> you are simply testing at your workstation, you will most
>>>> definitely need to change the three entries below. -->
>>>>
>>>> <property>
>>>> <name>instance.zookeeper.host</name>
>>>>
>>>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>>>> <description>comma separated list of zookeeper servers</description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>logger.dir.walog</name>
>>>> <value>walogs</value>
>>>> <description>The property only needs to be set if upgrading from
>>>> 1.4 which used to store write-ahead logs on the local
>>>> filesystem. In 1.5 write-ahead logs are stored in DFS. When 1.5
>>>> is started for the first time it will copy any 1.4
>>>> write ahead logs into DFS. It is possible to specify a
>>>> comma-separated list of directories.
>>>> </description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>instance.secret</name>
>>>> <value></value>
>>>> <description>A secret unique to a given instance that all servers
>>>> must know in order to communicate with one another.
>>>> Change it before initialization. To
>>>> change it later use ./bin/accumulo
>>>> org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
>>>> [newpasswd],
>>>> and then update this file.
>>>> </description>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.memory.maps.max</name>
>>>> <value>1G</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.cache.data.size</name>
>>>> <value>128M</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>tserver.cache.index.size</name>
>>>> <value>128M</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>trace.token.property.password</name>
>>>> <!-- change this to the root user's password, and/or change the
>>>> user below -->
>>>> <value></value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>trace.user</name>
>>>> <value>root</value>
>>>> </property>
>>>>
>>>> <property>
>>>> <name>general.classpaths</name>
>>>> <value>
>>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>>> /usr/lib/hadoop/.*.jar,
>>>> /usr/lib/hadoop/lib/.*.jar,
>>>> /usr/lib/hadoop-hdfs/.*.jar,
>>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>>> /usr/lib/hadoop-yarn/.*.jar,
>>>> $ACCUMULO_HOME/server/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>>> $ACCUMULO_HOME/core/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>>> $ACCUMULO_HOME/start/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>>> $ACCUMULO_HOME/fate/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>>> $ACCUMULO_HOME/proxy/target/classes/,
>>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>>> $HADOOP_CONF_DIR,
>>>> $HADOOP_PREFIX/[^.].*.jar,
>>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>>> </value>
>>>> <description>Classpaths that accumulo checks for updates and class
>>>> files.
>>>> When using the Security Manager, please remove the
>>>> ".../target/classes/" values.
>>>> </description>
>>>> </property>
>>>> </configuration>
>>>>
>>>>
>>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com>wrote:
>>>>
>>>>> Posting your accumulo-site.xml (filtering out instance.secret and
>>>>> trace.password before you post) would also help us figure out what exactly
>>>>> is going on.
>>>>>
>>>>>
>>>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>>>
>>>>>> Which version of Accumulo are you using?
>>>>>>
>>>>>> You might be missing the hadoop libraries from your classpath. For
>>>>>> this,
>>>>>> you would check your accumulo-site.xml and find the comment about
>>>>>> Hadoop
>>>>>> 2 in the file.
>>>>>>
>>>>>>
>>>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>>>>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>>>>> wrote:
>>>>>>
>>>>>> I have a couple of issues when trying to use Accumulo on Hadoop
>>>>>> 2.2.0
>>>>>>
>>>>>> 1) I start with accumulo init and everything runs through just
>>>>>> fine,
>>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>>
>>>>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>>>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the
>>>>>> each
>>>>>> cluster node it shows all the necessary processes for both in the
>>>>>> JVM. Is there something I am missing?
>>>>>>
>>>>>> --
>>>>>> Benjamin D. Parrish
>>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>>
>>>>>>
>>>>>>
>>>>
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860
>>>>
>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
First off, are there specific ports that need to be opened up for accumulo?
I have hadoop operating without any issues as a 5 node cluster. Zookeeper
seems to be operating with 2181, 3888, 2888 ports open.
Here is some data from trying to get everything started and getting into
the shell. I discluded the bash portion as Eric suggested because the
mailing list rejected it for length and thinking it was spam.
bin/start-all.sh
[root@hadoop-node-1 zookeeper]# bash -x /usr/local/accumulo/bin/start-all.sh
Starting monitor on hadoop-node-1
WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
Starting tablet servers ....... done
Starting tablet server on hadoop-node-3
Starting tablet server on hadoop-node-5
Starting tablet server on hadoop-node-2
Starting tablet server on hadoop-node-4
WARN : Max files open on hadoop-node-3 is 1024, recommend 65536
WARN : Max files open on hadoop-node-2 is 1024, recommend 65536
WARN : Max files open on hadoop-node-5 is 1024, recommend 65536
WARN : Max files open on hadoop-node-4 is 1024, recommend 65536
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
/usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
stack guard. The VM will try to fix the stack guard no
w.
It's highly recommended that you fix the library with 'execstack -c
<libfile>', or link it with '-z noexecstack'.
2014-03-18 10:38:43,143 [util.NativeCodeLoader] WARN : Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
2014-03-18 10:38:44,194 [server.Accumulo] INFO : Attempting to talk to
zookeeper
2014-03-18 10:38:44,389 [server.Accumulo] INFO : Zookeeper connected and
initialized, attemping to talk to HDFS
2014-03-18 10:38:44,558 [server.Accumulo] INFO : Connected to HDFS
Starting master on hadoop-node-1
WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
Starting garbage collector on hadoop-node-1
WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
Starting tracer on hadoop-node-1
WARN : Max files open on hadoop-node-1 is 1024, recommend 65536
starting shell as root...
[root@hadoop-node-1 zookeeper]# bash -x /usr/local/accumulo/bin/accumulo
shell -u root
Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library
/usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled
stack guard. The VM will try to fix the stack guard no
w.
It's highly recommended that you fix the library with 'execstack -c
<libfile>', or link it with '-z noexecstack'.
2014-03-18 10:38:56,002 [util.NativeCodeLoader] WARN : Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
Password: ****
2014-03-18 10:38:58,762 [impl.ServerClient] WARN : There are no tablet
servers: check that zookeeper and accumulo are running.
... this is the point where it sits and acts like it doesn't do anything
-- LOGS -- (most of this looks to be that I cannot connect to anything)
here is the tail -f
$ACCUMULO_HOME/logs/monitor_hadoop-node-1.local.debug.log
2014-03-18 10:42:54,617 [impl.ThriftScanner] DEBUG: Failed to locate
tablet for table : !0 row : ~err_
2014-03-18 10:42:57,625 [monitor.Monitor] INFO : Failed to obtain problem
reports
java.lang.RuntimeException:
org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
at
org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:174)
at
org.apache.accumulo.server.problems.ProblemReports$3.hasNext(ProblemReports.java:241)
at
org.apache.accumulo.server.problems.ProblemReports.summarize(ProblemReports.java:299)
at
org.apache.accumulo.server.monitor.Monitor.fetchData(Monitor.java:399)
at
org.apache.accumulo.server.monitor.Monitor$1.run(Monitor.java:530)
at
org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
at java.lang.Thread.run(Thread.java:744)
Caused by:
org.apache.accumulo.core.client.impl.ThriftScanner$ScanTimedOutException
at
org.apache.accumulo.core.client.impl.ThriftScanner.scan(ThriftScanner.java:212)
at
org.apache.accumulo.core.client.impl.ScannerIterator$Reader.run(ScannerIterator.java:82)
at
org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:164)
... 6 more
here is the tail -f $ACCUMULO+HOME/logs/tracer_hadoop-node-1.local.debug.log
2014-03-18 10:47:44,759 [impl.ServerClient] DEBUG: ClientService request
failed null, retrying ...
org.apache.thrift.transport.TTransportException: Failed to connect to a
server
at
org.apache.accumulo.core.client.impl.ThriftTransportPool.getAnyTransport(ThriftTransportPool.java:455)
at
org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:154)
at
org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:128)
at
org.apache.accumulo.core.client.impl.ServerClient.getConnection(ServerClient.java:123)
at
org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:105)
at
org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
at
org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
at
org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:154)
at
org.apache.accumulo.server.client.HdfsZooInstance.getConnector(HdfsZooInstance.java:149)
at
org.apache.accumulo.server.trace.TraceServer.<init>(TraceServer.java:200)
at
org.apache.accumulo.server.trace.TraceServer.main(TraceServer.java:295)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.accumulo.start.Main$1.run(Main.java:103)
at java.lang.Thread.run(Thread.java:744)
On Tue, Mar 18, 2014 at 9:37 AM, Eric Newton <er...@gmail.com> wrote:
> Can you post the exact error message you are seeing?
>
> Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being set properly
> in accumulo-site.xml.
>
> The output of:
>
> bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
>
>
> would also help.
>
> It's going to be something simple.
>
>
> On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> Looking to see if there was an answer to this issue or if you could point
>> me in a direction or example that could lead to a solution.
>>
>>
>> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish <
>> benjamin.d.parrish@gmail.com> wrote:
>>
>>> I am running Accumulo 1.5.1
>>>
>>> <?xml version="1.0" encoding="UTF-8"?>
>>> <!--
>>> Licensed to the Apache Software Foundation (ASF) under one or more
>>> contributor license agreements. See the NOTICE file distributed with
>>> this work for additional information regarding copyright ownership.
>>> The ASF licenses this file to You under the Apache License, Version 2.0
>>> (the "License"); you may not use this file except in compliance with
>>> the License. You may obtain a copy of the License at
>>>
>>> http://www.apache.org/licenses/LICENSE-2.0
>>>
>>> Unless required by applicable law or agreed to in writing, software
>>> distributed under the License is distributed on an "AS IS" BASIS,
>>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
>>> implied.
>>> See the License for the specific language governing permissions and
>>> limitations under the License.
>>> -->
>>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>>>
>>> <configuration>
>>> <!-- Put your site-specific accumulo configurations here. The
>>> available configuration values along with their defaults are documented in
>>> docs/config.html Unless
>>> you are simply testing at your workstation, you will most definitely
>>> need to change the three entries below. -->
>>>
>>> <property>
>>> <name>instance.zookeeper.host</name>
>>>
>>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>>> <description>comma separated list of zookeeper servers</description>
>>> </property>
>>>
>>> <property>
>>> <name>logger.dir.walog</name>
>>> <value>walogs</value>
>>> <description>The property only needs to be set if upgrading from 1.4
>>> which used to store write-ahead logs on the local
>>> filesystem. In 1.5 write-ahead logs are stored in DFS. When 1.5
>>> is started for the first time it will copy any 1.4
>>> write ahead logs into DFS. It is possible to specify a
>>> comma-separated list of directories.
>>> </description>
>>> </property>
>>>
>>> <property>
>>> <name>instance.secret</name>
>>> <value></value>
>>> <description>A secret unique to a given instance that all servers
>>> must know in order to communicate with one another.
>>> Change it before initialization. To
>>> change it later use ./bin/accumulo
>>> org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
>>> [newpasswd],
>>> and then update this file.
>>> </description>
>>> </property>
>>>
>>> <property>
>>> <name>tserver.memory.maps.max</name>
>>> <value>1G</value>
>>> </property>
>>>
>>> <property>
>>> <name>tserver.cache.data.size</name>
>>> <value>128M</value>
>>> </property>
>>>
>>> <property>
>>> <name>tserver.cache.index.size</name>
>>> <value>128M</value>
>>> </property>
>>>
>>> <property>
>>> <name>trace.token.property.password</name>
>>> <!-- change this to the root user's password, and/or change the user
>>> below -->
>>> <value></value>
>>> </property>
>>>
>>> <property>
>>> <name>trace.user</name>
>>> <value>root</value>
>>> </property>
>>>
>>> <property>
>>> <name>general.classpaths</name>
>>> <value>
>>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>>> /usr/lib/hadoop/.*.jar,
>>> /usr/lib/hadoop/lib/.*.jar,
>>> /usr/lib/hadoop-hdfs/.*.jar,
>>> /usr/lib/hadoop-mapreduce/.*.jar,
>>> /usr/lib/hadoop-yarn/.*.jar,
>>> $ACCUMULO_HOME/server/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>>> $ACCUMULO_HOME/core/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>>> $ACCUMULO_HOME/start/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>>> $ACCUMULO_HOME/fate/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>>> $ACCUMULO_HOME/proxy/target/classes/,
>>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>>> $ACCUMULO_HOME/lib/[^.].*.jar,
>>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>>> $HADOOP_CONF_DIR,
>>> $HADOOP_PREFIX/[^.].*.jar,
>>> $HADOOP_PREFIX/lib/[^.].*.jar,
>>> </value>
>>> <description>Classpaths that accumulo checks for updates and class
>>> files.
>>> When using the Security Manager, please remove the
>>> ".../target/classes/" values.
>>> </description>
>>> </property>
>>> </configuration>
>>>
>>>
>>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com>wrote:
>>>
>>>> Posting your accumulo-site.xml (filtering out instance.secret and
>>>> trace.password before you post) would also help us figure out what exactly
>>>> is going on.
>>>>
>>>>
>>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>>
>>>>> Which version of Accumulo are you using?
>>>>>
>>>>> You might be missing the hadoop libraries from your classpath. For
>>>>> this,
>>>>> you would check your accumulo-site.xml and find the comment about
>>>>> Hadoop
>>>>> 2 in the file.
>>>>>
>>>>>
>>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>>>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>>>> wrote:
>>>>>
>>>>> I have a couple of issues when trying to use Accumulo on Hadoop
>>>>> 2.2.0
>>>>>
>>>>> 1) I start with accumulo init and everything runs through just
>>>>> fine,
>>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>>
>>>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the
>>>>> each
>>>>> cluster node it shows all the necessary processes for both in the
>>>>> JVM. Is there something I am missing?
>>>>>
>>>>> --
>>>>> Benjamin D. Parrish
>>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>>
>>>>>
>>>>>
>>>
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860
>>>
>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Eric Newton <er...@gmail.com>.
Can you post the exact error message you are seeing?
Verify that your HADOOP_PREFIX and HADOOP_CONF_DIR are being set properly
in accumulo-site.xml.
The output of:
bash -x $ACCUMULO_HOME/bin/accumulo shell -u root
would also help.
It's going to be something simple.
On Tue, Mar 18, 2014 at 9:14 AM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> Looking to see if there was an answer to this issue or if you could point
> me in a direction or example that could lead to a solution.
>
>
> On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish <
> benjamin.d.parrish@gmail.com> wrote:
>
>> I am running Accumulo 1.5.1
>>
>> <?xml version="1.0" encoding="UTF-8"?>
>> <!--
>> Licensed to the Apache Software Foundation (ASF) under one or more
>> contributor license agreements. See the NOTICE file distributed with
>> this work for additional information regarding copyright ownership.
>> The ASF licenses this file to You under the Apache License, Version 2.0
>> (the "License"); you may not use this file except in compliance with
>> the License. You may obtain a copy of the License at
>>
>> http://www.apache.org/licenses/LICENSE-2.0
>>
>> Unless required by applicable law or agreed to in writing, software
>> distributed under the License is distributed on an "AS IS" BASIS,
>> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
>> See the License for the specific language governing permissions and
>> limitations under the License.
>> -->
>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>>
>> <configuration>
>> <!-- Put your site-specific accumulo configurations here. The available
>> configuration values along with their defaults are documented in
>> docs/config.html Unless
>> you are simply testing at your workstation, you will most definitely
>> need to change the three entries below. -->
>>
>> <property>
>> <name>instance.zookeeper.host</name>
>>
>> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
>> <description>comma separated list of zookeeper servers</description>
>> </property>
>>
>> <property>
>> <name>logger.dir.walog</name>
>> <value>walogs</value>
>> <description>The property only needs to be set if upgrading from 1.4
>> which used to store write-ahead logs on the local
>> filesystem. In 1.5 write-ahead logs are stored in DFS. When 1.5 is
>> started for the first time it will copy any 1.4
>> write ahead logs into DFS. It is possible to specify a
>> comma-separated list of directories.
>> </description>
>> </property>
>>
>> <property>
>> <name>instance.secret</name>
>> <value></value>
>> <description>A secret unique to a given instance that all servers
>> must know in order to communicate with one another.
>> Change it before initialization. To
>> change it later use ./bin/accumulo
>> org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
>> [newpasswd],
>> and then update this file.
>> </description>
>> </property>
>>
>> <property>
>> <name>tserver.memory.maps.max</name>
>> <value>1G</value>
>> </property>
>>
>> <property>
>> <name>tserver.cache.data.size</name>
>> <value>128M</value>
>> </property>
>>
>> <property>
>> <name>tserver.cache.index.size</name>
>> <value>128M</value>
>> </property>
>>
>> <property>
>> <name>trace.token.property.password</name>
>> <!-- change this to the root user's password, and/or change the user
>> below -->
>> <value></value>
>> </property>
>>
>> <property>
>> <name>trace.user</name>
>> <value>root</value>
>> </property>
>>
>> <property>
>> <name>general.classpaths</name>
>> <value>
>> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
>> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
>> /usr/lib/hadoop/.*.jar,
>> /usr/lib/hadoop/lib/.*.jar,
>> /usr/lib/hadoop-hdfs/.*.jar,
>> /usr/lib/hadoop-mapreduce/.*.jar,
>> /usr/lib/hadoop-yarn/.*.jar,
>> $ACCUMULO_HOME/server/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-server.jar,
>> $ACCUMULO_HOME/core/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-core.jar,
>> $ACCUMULO_HOME/start/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-start.jar,
>> $ACCUMULO_HOME/fate/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-fate.jar,
>> $ACCUMULO_HOME/proxy/target/classes/,
>> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
>> $ACCUMULO_HOME/lib/[^.].*.jar,
>> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
>> $HADOOP_CONF_DIR,
>> $HADOOP_PREFIX/[^.].*.jar,
>> $HADOOP_PREFIX/lib/[^.].*.jar,
>> </value>
>> <description>Classpaths that accumulo checks for updates and class
>> files.
>> When using the Security Manager, please remove the
>> ".../target/classes/" values.
>> </description>
>> </property>
>> </configuration>
>>
>>
>> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com> wrote:
>>
>>> Posting your accumulo-site.xml (filtering out instance.secret and
>>> trace.password before you post) would also help us figure out what exactly
>>> is going on.
>>>
>>>
>>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>>
>>>> Which version of Accumulo are you using?
>>>>
>>>> You might be missing the hadoop libraries from your classpath. For this,
>>>> you would check your accumulo-site.xml and find the comment about Hadoop
>>>> 2 in the file.
>>>>
>>>>
>>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>>> wrote:
>>>>
>>>> I have a couple of issues when trying to use Accumulo on Hadoop
>>>> 2.2.0
>>>>
>>>> 1) I start with accumulo init and everything runs through just fine,
>>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>>
>>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the each
>>>> cluster node it shows all the necessary processes for both in the
>>>> JVM. Is there something I am missing?
>>>>
>>>> --
>>>> Benjamin D. Parrish
>>>> H: 540-597-7860 <tel:540-597-7860>
>>>>
>>>>
>>>>
>>
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860
>>
>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
Looking to see if there was an answer to this issue or if you could point
me in a direction or example that could lead to a solution.
On Sun, Mar 16, 2014 at 9:52 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> I am running Accumulo 1.5.1
>
> <?xml version="1.0" encoding="UTF-8"?>
> <!--
> Licensed to the Apache Software Foundation (ASF) under one or more
> contributor license agreements. See the NOTICE file distributed with
> this work for additional information regarding copyright ownership.
> The ASF licenses this file to You under the Apache License, Version 2.0
> (the "License"); you may not use this file except in compliance with
> the License. You may obtain a copy of the License at
>
> http://www.apache.org/licenses/LICENSE-2.0
>
> Unless required by applicable law or agreed to in writing, software
> distributed under the License is distributed on an "AS IS" BASIS,
> WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
> See the License for the specific language governing permissions and
> limitations under the License.
> -->
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>
> <configuration>
> <!-- Put your site-specific accumulo configurations here. The available
> configuration values along with their defaults are documented in
> docs/config.html Unless
> you are simply testing at your workstation, you will most definitely
> need to change the three entries below. -->
>
> <property>
> <name>instance.zookeeper.host</name>
>
> <value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
> <description>comma separated list of zookeeper servers</description>
> </property>
>
> <property>
> <name>logger.dir.walog</name>
> <value>walogs</value>
> <description>The property only needs to be set if upgrading from 1.4
> which used to store write-ahead logs on the local
> filesystem. In 1.5 write-ahead logs are stored in DFS. When 1.5 is
> started for the first time it will copy any 1.4
> write ahead logs into DFS. It is possible to specify a
> comma-separated list of directories.
> </description>
> </property>
>
> <property>
> <name>instance.secret</name>
> <value></value>
> <description>A secret unique to a given instance that all servers must
> know in order to communicate with one another.
> Change it before initialization. To
> change it later use ./bin/accumulo
> org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
> [newpasswd],
> and then update this file.
> </description>
> </property>
>
> <property>
> <name>tserver.memory.maps.max</name>
> <value>1G</value>
> </property>
>
> <property>
> <name>tserver.cache.data.size</name>
> <value>128M</value>
> </property>
>
> <property>
> <name>tserver.cache.index.size</name>
> <value>128M</value>
> </property>
>
> <property>
> <name>trace.token.property.password</name>
> <!-- change this to the root user's password, and/or change the user
> below -->
> <value></value>
> </property>
>
> <property>
> <name>trace.user</name>
> <value>root</value>
> </property>
>
> <property>
> <name>general.classpaths</name>
> <value>
> $HADOOP_PREFIX/share/hadoop/common/.*.jar,
> $HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
> $HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
> $HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
> $HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
> /usr/lib/hadoop/.*.jar,
> /usr/lib/hadoop/lib/.*.jar,
> /usr/lib/hadoop-hdfs/.*.jar,
> /usr/lib/hadoop-mapreduce/.*.jar,
> /usr/lib/hadoop-yarn/.*.jar,
> $ACCUMULO_HOME/server/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-server.jar,
> $ACCUMULO_HOME/core/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-core.jar,
> $ACCUMULO_HOME/start/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-start.jar,
> $ACCUMULO_HOME/fate/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-fate.jar,
> $ACCUMULO_HOME/proxy/target/classes/,
> $ACCUMULO_HOME/lib/accumulo-proxy.jar,
> $ACCUMULO_HOME/lib/[^.].*.jar,
> $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
> $HADOOP_CONF_DIR,
> $HADOOP_PREFIX/[^.].*.jar,
> $HADOOP_PREFIX/lib/[^.].*.jar,
> </value>
> <description>Classpaths that accumulo checks for updates and class
> files.
> When using the Security Manager, please remove the
> ".../target/classes/" values.
> </description>
> </property>
> </configuration>
>
>
> On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com> wrote:
>
>> Posting your accumulo-site.xml (filtering out instance.secret and
>> trace.password before you post) would also help us figure out what exactly
>> is going on.
>>
>>
>> On 3/16/14, 8:41 PM, Mike Drob wrote:
>>
>>> Which version of Accumulo are you using?
>>>
>>> You might be missing the hadoop libraries from your classpath. For this,
>>> you would check your accumulo-site.xml and find the comment about Hadoop
>>> 2 in the file.
>>>
>>>
>>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>>> wrote:
>>>
>>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>>
>>> 1) I start with accumulo init and everything runs through just fine,
>>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>>
>>> 2) I try to run 'accumulo shell -u root' and it says that that
>>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the each
>>> cluster node it shows all the necessary processes for both in the
>>> JVM. Is there something I am missing?
>>>
>>> --
>>> Benjamin D. Parrish
>>> H: 540-597-7860 <tel:540-597-7860>
>>>
>>>
>>>
>
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Benjamin Parrish <be...@gmail.com>.
I am running Accumulo 1.5.1
<?xml version="1.0" encoding="UTF-8"?>
<!--
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<!-- Put your site-specific accumulo configurations here. The available
configuration values along with their defaults are documented in
docs/config.html Unless
you are simply testing at your workstation, you will most definitely
need to change the three entries below. -->
<property>
<name>instance.zookeeper.host</name>
<value>hadoop-node-1:2181,hadoop-node-2:2181,hadoop-node-3:2181,hadoop-node-4:2181,hadoop-node-5:2181</value>
<description>comma separated list of zookeeper servers</description>
</property>
<property>
<name>logger.dir.walog</name>
<value>walogs</value>
<description>The property only needs to be set if upgrading from 1.4
which used to store write-ahead logs on the local
filesystem. In 1.5 write-ahead logs are stored in DFS. When 1.5 is
started for the first time it will copy any 1.4
write ahead logs into DFS. It is possible to specify a
comma-separated list of directories.
</description>
</property>
<property>
<name>instance.secret</name>
<value></value>
<description>A secret unique to a given instance that all servers must
know in order to communicate with one another.
Change it before initialization. To
change it later use ./bin/accumulo
org.apache.accumulo.server.util.ChangeSecret --old [oldpasswd] --new
[newpasswd],
and then update this file.
</description>
</property>
<property>
<name>tserver.memory.maps.max</name>
<value>1G</value>
</property>
<property>
<name>tserver.cache.data.size</name>
<value>128M</value>
</property>
<property>
<name>tserver.cache.index.size</name>
<value>128M</value>
</property>
<property>
<name>trace.token.property.password</name>
<!-- change this to the root user's password, and/or change the user
below -->
<value></value>
</property>
<property>
<name>trace.user</name>
<value>root</value>
</property>
<property>
<name>general.classpaths</name>
<value>
$HADOOP_PREFIX/share/hadoop/common/.*.jar,
$HADOOP_PREFIX/share/hadoop/common/lib/.*.jar,
$HADOOP_PREFIX/share/hadoop/hdfs/.*.jar,
$HADOOP_PREFIX/share/hadoop/mapreduce/.*.jar,
$HADOOP_PREFIX/share/hadoop/yarn/.*.jar,
/usr/lib/hadoop/.*.jar,
/usr/lib/hadoop/lib/.*.jar,
/usr/lib/hadoop-hdfs/.*.jar,
/usr/lib/hadoop-mapreduce/.*.jar,
/usr/lib/hadoop-yarn/.*.jar,
$ACCUMULO_HOME/server/target/classes/,
$ACCUMULO_HOME/lib/accumulo-server.jar,
$ACCUMULO_HOME/core/target/classes/,
$ACCUMULO_HOME/lib/accumulo-core.jar,
$ACCUMULO_HOME/start/target/classes/,
$ACCUMULO_HOME/lib/accumulo-start.jar,
$ACCUMULO_HOME/fate/target/classes/,
$ACCUMULO_HOME/lib/accumulo-fate.jar,
$ACCUMULO_HOME/proxy/target/classes/,
$ACCUMULO_HOME/lib/accumulo-proxy.jar,
$ACCUMULO_HOME/lib/[^.].*.jar,
$ZOOKEEPER_HOME/zookeeper[^.].*.jar,
$HADOOP_CONF_DIR,
$HADOOP_PREFIX/[^.].*.jar,
$HADOOP_PREFIX/lib/[^.].*.jar,
</value>
<description>Classpaths that accumulo checks for updates and class
files.
When using the Security Manager, please remove the
".../target/classes/" values.
</description>
</property>
</configuration>
On Sun, Mar 16, 2014 at 9:06 PM, Josh Elser <jo...@gmail.com> wrote:
> Posting your accumulo-site.xml (filtering out instance.secret and
> trace.password before you post) would also help us figure out what exactly
> is going on.
>
>
> On 3/16/14, 8:41 PM, Mike Drob wrote:
>
>> Which version of Accumulo are you using?
>>
>> You might be missing the hadoop libraries from your classpath. For this,
>> you would check your accumulo-site.xml and find the comment about Hadoop
>> 2 in the file.
>>
>>
>> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
>> <benjamin.d.parrish@gmail.com <ma...@gmail.com>>
>> wrote:
>>
>> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>>
>> 1) I start with accumulo init and everything runs through just fine,
>> but I can find '/accumulo' using 'hadoop fs -ls /'
>>
>> 2) I try to run 'accumulo shell -u root' and it says that that
>> Hadoop and ZooKeeper are not started, but if I run 'jps' on the each
>> cluster node it shows all the necessary processes for both in the
>> JVM. Is there something I am missing?
>>
>> --
>> Benjamin D. Parrish
>> H: 540-597-7860 <tel:540-597-7860>
>>
>>
>>
--
Benjamin D. Parrish
H: 540-597-7860
Re: Installing with Hadoop 2.2.0
Posted by Josh Elser <jo...@gmail.com>.
Posting your accumulo-site.xml (filtering out instance.secret and
trace.password before you post) would also help us figure out what
exactly is going on.
On 3/16/14, 8:41 PM, Mike Drob wrote:
> Which version of Accumulo are you using?
>
> You might be missing the hadoop libraries from your classpath. For this,
> you would check your accumulo-site.xml and find the comment about Hadoop
> 2 in the file.
>
>
> On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish
> <benjamin.d.parrish@gmail.com <ma...@gmail.com>> wrote:
>
> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>
> 1) I start with accumulo init and everything runs through just fine,
> but I can find '/accumulo' using 'hadoop fs -ls /'
>
> 2) I try to run 'accumulo shell -u root' and it says that that
> Hadoop and ZooKeeper are not started, but if I run 'jps' on the each
> cluster node it shows all the necessary processes for both in the
> JVM. Is there something I am missing?
>
> --
> Benjamin D. Parrish
> H: 540-597-7860 <tel:540-597-7860>
>
>
Re: Installing with Hadoop 2.2.0
Posted by Mike Drob <md...@mdrob.com>.
Which version of Accumulo are you using?
You might be missing the hadoop libraries from your classpath. For this,
you would check your accumulo-site.xml and find the comment about Hadoop 2
in the file.
On Sun, Mar 16, 2014 at 8:28 PM, Benjamin Parrish <
benjamin.d.parrish@gmail.com> wrote:
> I have a couple of issues when trying to use Accumulo on Hadoop 2.2.0
>
> 1) I start with accumulo init and everything runs through just fine, but I
> can find '/accumulo' using 'hadoop fs -ls /'
>
> 2) I try to run 'accumulo shell -u root' and it says that that Hadoop and
> ZooKeeper are not started, but if I run 'jps' on the each cluster node it
> shows all the necessary processes for both in the JVM. Is there something
> I am missing?
>
> --
> Benjamin D. Parrish
> H: 540-597-7860
>