You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by David Medinets <da...@gmail.com> on 2013/05/14 02:29:47 UTC

v1.5.0 Branch - Unable to see monitor page

I've been having problems getting the monitor page to display. I thought I
was doing something wrong but now I'm thinking that something has changed
in the last few months. I have a script that works to install v1.4.2 and
v1.4.3. I only changed the script to pull the v1.5.0 Branch from github.
The scripts are in my accumulo-at-home github project.

After using start-here.sh, I saw a 'no masters' messages in the monitor
log. However, the master seems to be running as shown by the jps command:

medined@ubuntu-10-04-4:~/accumulo_home/bin/accumulo/logs$ jps -v | grep
master
16937 Main -Dapp=master -XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75 -Xmx128m -Xms128m
-XX:OnOutOfMemoryError=kill -9 %p
-Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl
-Djava.library.path=/home/medined/accumulo_home/bin/hadoop/lib/native/Linux-i386-32
-Dorg.apache.accumulo.core.home.dir=/home/medined/accumulo_home/bin/accumulo
-Dhadoop.home.dir=/home/medined/accumulo_home/bin/hadoop
-Dzookeeper.home.dir=/home/medined/accumulo_home/bin/zookeeper

I killed the monitor process, delete the monitor log file, and restarted
the monitor. The monitor page does not respond. I see nothing wrong in the
logs.

The processing is running:

31004 Main -Dapp=monitor -XX:+UseConcMarkSweepGC
-XX:CMSInitiatingOccupancyFraction=75 -Xmx64m -Xms64m
-XX:OnOutOfMemoryError=kill -9 %p
-Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl
-Djava.library.path=/home/medined/accumulo_home/bin/hadoop/lib/native/Linux-i386-32
-Dorg.apache.accumulo.core.home.dir=/home/medined/accumulo_home/bin/accumulo
-Dhadoop.home.dir=/home/medined/accumulo_home/bin/hadoop
-Dzookeeper.home.dir=/home/medined/accumulo_home/bin/zookeeper

If you have any suggestions please let me know.

Here are the log messages:

2013-05-13 20:08:39,238 [server.Accumulo] INFO :  monitor starting
2013-05-13 20:08:39,247 [client.ZooKeeperInstance] DEBUG:  Trying to read
instance id from /user/accumulo/accumulo/instance_id
2013-05-13 20:08:39,247 [server.Accumulo] INFO :  Instance
03149faa-6f01-455e-9cc9-6acb2e6224da
2013-05-13 20:08:39,247 [server.Accumulo] INFO :  Data Version 5
2013-05-13 20:08:39,248 [server.Accumulo] INFO :  Attempting to talk to
zookeeper
2013-05-13 20:08:39,249 [zookeeper.ZooSession] DEBUG:  Connecting to
localhost:2181 with timeout 30000 with auth
2013-05-13 20:08:39,428 [server.Accumulo] INFO :  Zookeeper connected and
initialized, attemping to talk to HDFS
2013-05-13 20:08:39,429 [server.Accumulo] INFO :  Connected to HDFS
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  gc.cycle.delay = 5m
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  gc.cycle.start = 30s
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  gc.port.client = 50091
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  gc.threads.delete = 16
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  gc.trash.ignore = false
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  general.classpaths =
    $ACCUMULO_HOME/server/target/classes/,
    $ACCUMULO_HOME/core/target/classes/,
    $ACCUMULO_HOME/start/target/classes/,
    $ACCUMULO_HOME/examples/target/classes/,
    $ACCUMULO_HOME/lib/[^.].$ACCUMULO_VERSION.jar,
    $ACCUMULO_HOME/lib/[^.].*.jar,
    $ZOOKEEPER_HOME/zookeeper[^.].*.jar,
    $HADOOP_HOME/conf,
    $HADOOP_HOME/[^.].*.jar,
    $HADOOP_HOME/lib/[^.].*.jar,

2013-05-13 20:08:39,440 [server.Accumulo] INFO :
general.dynamic.classpaths = $ACCUMULO_HOME/lib/ext/[^.].*.jar

2013-05-13 20:08:39,440 [server.Accumulo] INFO :  general.kerberos.keytab =
2013-05-13 20:08:39,440 [server.Accumulo] INFO :
general.kerberos.principal =
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  general.rpc.timeout = 120s
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  general.vfs.cache.dir =
/tmp/accumulo-vfs-cache-medined
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  general.vfs.classpaths =
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  instance.dfs.dir =
/user/accumulo/accumulo
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  instance.dfs.uri =
2013-05-13 20:08:39,440 [server.Accumulo] INFO :  instance.secret = <hidden>
2013-05-13 20:08:39,440 [server.Accumulo] INFO :
instance.security.authenticator =
org.apache.accumulo.server.security.handler.ZKAuthenticator
2013-05-13 20:08:39,440 [server.Accumulo] INFO :
instance.security.authorizor =
org.apache.accumulo.server.security.handler.ZKAuthorizor
2013-05-13 20:08:39,440 [server.Accumulo] INFO :
instance.security.permissionHandler =
org.apache.accumulo.server.security.handler.ZKPermHandler
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  instance.zookeeper.host =
localhost:2181
2013-05-13 20:08:39,441 [server.Accumulo] INFO :
instance.zookeeper.timeout = 30s
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  logger.dir.walog = walogs
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  master.bulk.retries = 3
2013-05-13 20:08:39,441 [server.Accumulo] INFO :
master.bulk.threadpool.size = 5
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  master.bulk.timeout = 5m
2013-05-13 20:08:39,441 [server.Accumulo] INFO :
master.fate.threadpool.size = 4
2013-05-13 20:08:39,441 [server.Accumulo] INFO :
master.lease.recovery.interval = 5s
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  master.port.client = 9999
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  master.recovery.delay =
10s
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  master.recovery.max.age =
60m
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  master.recovery.time.max
= 30m
2013-05-13 20:08:39,441 [server.Accumulo] INFO :
master.server.threadcheck.time = 1s
2013-05-13 20:08:39,441 [server.Accumulo] INFO :
master.server.threads.minimum = 20
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  master.tablet.balancer =
org.apache.accumulo.server.master.balancer.TableLoadBalancer
2013-05-13 20:08:39,441 [server.Accumulo] INFO :
master.walog.closer.implementation =
org.apache.accumulo.server.master.recovery.HadoopLogCloser
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  monitor.banner.background
= #304065
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  monitor.banner.color =
#c4c4c4
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  monitor.banner.text =
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  monitor.port.client =
50095
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  monitor.port.log4j = 4560
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  table.balancer =
org.apache.accumulo.server.master.balancer.DefaultLoadBalancer
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  table.bloom.enabled =
false
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  table.bloom.error.rate =
0.5%
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  table.bloom.hash.type =
murmur
2013-05-13 20:08:39,441 [server.Accumulo] INFO :  table.bloom.key.functor =
org.apache.accumulo.core.file.keyfunctor.RowFunctor
2013-05-13 20:08:39,442 [server.Accumulo] INFO :
table.bloom.load.threshold = 1
2013-05-13 20:08:39,442 [server.Accumulo] INFO :  table.bloom.size = 1048576
2013-05-13 20:08:39,442 [server.Accumulo] INFO :  table.cache.block.enable
= false
2013-05-13 20:08:39,442 [server.Accumulo] INFO :  table.cache.index.enable
= true
2013-05-13 20:08:39,442 [server.Accumulo] INFO :  table.classpath.context =
2013-05-13 20:08:39,442 [server.Accumulo] INFO :
table.compaction.major.everything.idle = 1h
2013-05-13 20:08:39,442 [server.Accumulo] INFO :
table.compaction.major.ratio = 3
2013-05-13 20:08:39,442 [server.Accumulo] INFO :
table.compaction.minor.idle = 5m
2013-05-13 20:08:39,442 [server.Accumulo] INFO :
table.compaction.minor.logs.threshold = 3
2013-05-13 20:08:39,442 [server.Accumulo] INFO :  table.failures.ignore =
false
2013-05-13 20:08:39,442 [server.Accumulo] INFO :  table.file.blocksize = 0B
2013-05-13 20:08:39,442 [server.Accumulo] INFO :
table.file.compress.blocksize = 100K
2013-05-13 20:08:39,442 [server.Accumulo] INFO :
table.file.compress.blocksize.index = 128K
2013-05-13 20:08:39,442 [server.Accumulo] INFO :  table.file.compress.type
= gz
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.file.max = 15
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.file.replication = 0
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.file.type = rf
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.formatter =
org.apache.accumulo.core.util.format.DefaultFormatter
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.groups.enabled =
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.interepreter =
org.apache.accumulo.core.util.interpret.DefaultScanInterpreter
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.scan.max.memory =
512K
2013-05-13 20:08:39,443 [server.Accumulo] INFO :
table.security.scan.visibility.default =
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.split.threshold = 1G
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  table.walog.enabled = true
2013-05-13 20:08:39,443 [server.Accumulo] INFO :  trace.password = <hidden>
2013-05-13 20:08:39,444 [server.Accumulo] INFO :  trace.port.client = 12234
2013-05-13 20:08:39,444 [server.Accumulo] INFO :  trace.table = trace
2013-05-13 20:08:39,444 [server.Accumulo] INFO :  trace.token.type =
org.apache.accumulo.core.client.security.tokens.PasswordToken
2013-05-13 20:08:39,444 [server.Accumulo] INFO :  trace.user = root
2013-05-13 20:08:39,444 [server.Accumulo] INFO :  tserver.archive.walogs =
false
2013-05-13 20:08:39,444 [server.Accumulo] INFO :
tserver.bloom.load.concurrent.max = 4
2013-05-13 20:08:39,445 [server.Accumulo] INFO :
tserver.bulk.assign.threads = 1
2013-05-13 20:08:39,445 [server.Accumulo] INFO :
tserver.bulk.process.threads = 1
2013-05-13 20:08:39,445 [server.Accumulo] INFO :  tserver.bulk.retry.max = 5
2013-05-13 20:08:39,445 [server.Accumulo] INFO :  tserver.bulk.timeout = 5m
2013-05-13 20:08:39,445 [server.Accumulo] INFO :  tserver.cache.data.size =
7M
2013-05-13 20:08:39,445 [server.Accumulo] INFO :  tserver.cache.index.size
= 20M
2013-05-13 20:08:39,445 [server.Accumulo] INFO :  tserver.client.timeout =
3s
2013-05-13 20:08:39,445 [server.Accumulo] INFO :
tserver.compaction.major.concurrent.max = 3
2013-05-13 20:08:39,445 [server.Accumulo] INFO :
tserver.compaction.major.delay = 30s
2013-05-13 20:08:39,445 [server.Accumulo] INFO :
tserver.compaction.major.thread.files.open.max = 10
2013-05-13 20:08:39,445 [server.Accumulo] INFO :
tserver.compaction.minor.concurrent.max = 4
2013-05-13 20:08:39,445 [server.Accumulo] INFO :  tserver.default.blocksize
= 1M
2013-05-13 20:08:39,445 [server.Accumulo] INFO :  tserver.dir.memdump = /tmp
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.files.open.idle =
1m
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.hold.time.max = 5m
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.memory.lock =
false
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.memory.manager =
org.apache.accumulo.server.tabletserver.LargestFirstMemoryManager
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.memory.maps.max =
80M
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.memory.maps.native.enabled = true
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.metadata.readahead.concurrent.max = 8
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.migrations.concurrent.max = 1
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.monitor.fs = true
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.mutation.queue.max = 256K
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.port.client = 9997
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.port.search =
false
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.readahead.concurrent.max = 16
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.recovery.concurrent.max = 2
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.scan.files.open.max = 100
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.server.message.size.max = 1G
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.server.threadcheck.time = 1s
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.server.threads.minimum = 20
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.session.idle.max
= 1m
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.sort.buffer.size
= 50M
2013-05-13 20:08:39,446 [server.Accumulo] INFO :
tserver.tablet.split.midpoint.files.max = 30
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.wal.blocksize = 0
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.wal.replication =
0
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.walog.max.size =
100M
2013-05-13 20:08:39,446 [server.Accumulo] INFO :  tserver.workq.threads = 2
2013-05-13 20:08:39,467 [trace.ZooTraceClient] DEBUG:  Scanning trace hosts
in zookeeper: /accumulo/03149faa-6f01-455e-9cc9-6acb2e6224da/tracers
2013-05-13 20:08:39,471 [trace.ZooTraceClient] DEBUG:  Trace hosts: [
127.0.1.1:12234]
2013-05-13 20:08:39,471 [monitor.Monitor] DEBUG:  Creating monitor on port
50095
2013-05-13 20:08:39,558 [monitor.LogService] DEBUG:  Waiting for log
message senders
2013-05-13 20:08:39,737 [monitor.Monitor] DEBUG:  connecting to zookeepers
localhost:2181
2013-05-13 20:08:44,923 [monitor.Monitor] DEBUG:  connecting to zookeepers
localhost:2181
2013-05-13 20:08:50,008 [monitor.Monitor] DEBUG:  connecting to zookeepers
localhost:2181
2013-05-13 20:08:55,089 [monitor.Monitor] DEBUG:  connecting to zookeepers
localhost:2181
.... more of the same connecting message over and over.