You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Bob Futrelle <bo...@gmail.com> on 2011/03/12 05:40:15 UTC

Cassandra still won't start - in-use ports block it

My frustration continues, especially exasperating because so many people
just seem to download Cassandra and run it with no problems.
All my efforts have been stymied by one port-in-use problem after another.
People on this list have helped and their suggestions got me a little bit
further, but no further.

Platform,  MacBook Pro, OS 10.6.6

Java(TM) SE Runtime Environment (build 1.6.0_24-b07-334-10M3326)
Java HotSpot(TM) 64-Bit Server VM (build 19.1-b02-334, mixed mode)

Highlights of the problems:
...
WARN 07:48:28,482 Could not start register mbean in JMX
...
Caused by: java.net.BindException: Address already in use
...
ERROR 07:48:28,511 Exception encountered during startup.
java.lang.RuntimeException: Unable to create thrift socket to localhost/
10.0.1.3:9160
...
Caused by: org.apache.thrift.transport.TTransportException: Could not create
ServerSocket on address localhost/10.0.1.3:9160.
...

  - Bob Futrelle

Details:

apache-cassandra-0.7.3: sudo ./bin/cassandra -f -p pidfile
Password:
 INFO 07:48:27,851 Logging initialized
 INFO 07:48:27,862 Heap size: 1052770304/1052770304
 INFO 07:48:27,864 JNA not found. Native methods will be disabled.
 INFO 07:48:27,872 Loading settings from
file:/Users/robertfutrelle/Research/Cassandra/apache-cassandra-0.7.3/conf/cassandra.yaml
 INFO 07:48:27,993 DiskAccessMode 'auto' determined to be mmap,
indexAccessMode is mmap
 INFO 07:48:28,095 reading saved cache
/var/lib/cassandra/saved_caches/system-LocationInfo-KeyCache
 INFO 07:48:28,101 Opening /var/lib/cassandra/data/system/LocationInfo-f-9
 INFO 07:48:28,126 Opening /var/lib/cassandra/data/system/LocationInfo-f-10
 INFO 07:48:28,164 Couldn't detect any schema definitions in local storage.
 INFO 07:48:28,165 Found table data in data directories. Consider using JMX
to call org.apache.cassandra.service.StorageService.loadSchemaFromYaml().
 INFO 07:48:28,176 Creating new commitlog segment
/var/lib/cassandra/commitlog/CommitLog-1299847708176.log
 INFO 07:48:28,184 Replaying
/var/lib/cassandra/commitlog/CommitLog-1299809981227.log
 INFO 07:48:28,187 Finished reading
/var/lib/cassandra/commitlog/CommitLog-1299809981227.log
 INFO 07:48:28,187 Log replay complete
 INFO 07:48:28,207 Cassandra version: 0.7.3
 INFO 07:48:28,207 Thrift API version: 19.4.0
 INFO 07:48:28,209 Loading persisted ring state
 INFO 07:48:28,213 Starting up server gossip
 INFO 07:48:28,224 switching in a fresh Memtable for LocationInfo at
CommitLogContext(file='/var/lib/cassandra/commitlog/CommitLog-1299847708176.log',
position=148)
 INFO 07:48:28,224 Enqueuing flush of Memtable-LocationInfo@2098581612(29
bytes, 1 operations)
 INFO 07:48:28,225 Writing Memtable-LocationInfo@2098581612(29 bytes, 1
operations)
 INFO 07:48:28,305 Completed flushing
/var/lib/cassandra/data/system/LocationInfo-f-11-Data.db (80 bytes)
 INFO 07:48:28,336 Using saved token 68734258064819962813495316844051960711
 INFO 07:48:28,337 switching in a fresh Memtable for LocationInfo at
CommitLogContext(file='/var/lib/cassandra/commitlog/CommitLog-1299847708176.log',
position=444)
 INFO 07:48:28,337 Enqueuing flush of Memtable-LocationInfo@389001391(53
bytes, 2 operations)
 INFO 07:48:28,338 Writing Memtable-LocationInfo@389001391(53 bytes, 2
operations)
 INFO 07:48:28,404 Completed flushing
/var/lib/cassandra/data/system/LocationInfo-f-12-Data.db (163 bytes)
 INFO 07:48:28,405 Compacting
[SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-9-Data.db'),SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-10-Data.db'),SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-11-Data.db'),SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-12-Data.db')]
 INFO 07:48:28,472 Compacted to
/var/lib/cassandra/data/system/LocationInfo-tmp-f-13-Data.db.  770 to 447
(~58% of original) bytes for 3 keys.  Time: 65ms.
 WARN 07:48:28,482 Could not start register mbean in JMX
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.cassandra.utils.Mx4jTool.maybeLoad(Mx4jTool.java:66)
at
org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:203)
at
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:316)
at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
Caused by: java.net.BindException: Address already in use
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:383)
at java.net.ServerSocket.bind(ServerSocket.java:328)
at java.net.ServerSocket.<init>(ServerSocket.java:194)
at
mx4j.tools.adaptor.PlainAdaptorServerSocketFactory.createServerSocket(PlainAdaptorServerSocketFactory.java:24)
at
mx4j.tools.adaptor.http.HttpAdaptor.createServerSocket(HttpAdaptor.java:672)
at mx4j.tools.adaptor.http.HttpAdaptor.start(HttpAdaptor.java:478)
... 8 more
ERROR 07:48:28,511 Exception encountered during startup.
java.lang.RuntimeException: Unable to create thrift socket to localhost/
10.0.1.3:9160
at
org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:108)
at
org.apache.cassandra.thrift.CassandraDaemon.startServer(CassandraDaemon.java:55)
at
org.apache.cassandra.service.AbstractCassandraDaemon.startRPCServer(AbstractCassandraDaemon.java:260)
at
org.apache.cassandra.service.AbstractCassandraDaemon.start(AbstractCassandraDaemon.java:232)
at
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:329)
at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
Caused by: org.apache.thrift.transport.TTransportException: Could not create
ServerSocket on address localhost/10.0.1.3:9160.
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:99)
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:85)
at
org.apache.cassandra.thrift.TCustomServerSocket.<init>(TCustomServerSocket.java:59)
at
org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:101)
... 5 more
Exception encountered during startup.
java.lang.RuntimeException: Unable to create thrift socket to localhost/
10.0.1.3:9160
at
org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:108)
at
org.apache.cassandra.thrift.CassandraDaemon.startServer(CassandraDaemon.java:55)
at
org.apache.cassandra.service.AbstractCassandraDaemon.startRPCServer(AbstractCassandraDaemon.java:260)
at
org.apache.cassandra.service.AbstractCassandraDaemon.start(AbstractCassandraDaemon.java:232)
at
org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:329)
at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
Caused by: org.apache.thrift.transport.TTransportException: Could not create
ServerSocket on address localhost/10.0.1.3:9160.
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:99)
at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:85)
at
org.apache.cassandra.thrift.TCustomServerSocket.<init>(TCustomServerSocket.java:59)
at
org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:101)
... 5 more

Re: Cassandra still won't start - in-use ports block it

Posted by Maki Watanabe <wa...@gmail.com>.
Hello Bob,

1. What does lsof says on TCP:9160 port?

$ lsof -i TCP:9160

2. Have you try to change rpc_port in conf/cassandra.yaml?
ex. rpc_port: 19160

maki

2011/3/12 Jeremy Hanna <je...@gmail.com>:
> I don't know if others have asked this but do you have a firewall running that would prevent access to those ports or something like that?
>
> On Mar 11, 2011, at 10:40 PM, Bob Futrelle wrote:
>
>> My frustration continues, especially exasperating because so many people just seem to download Cassandra and run it with no problems.
>> All my efforts have been stymied by one port-in-use problem after another.
>> People on this list have helped and their suggestions got me a little bit further, but no further.
>>
>> Platform,  MacBook Pro, OS 10.6.6
>>
>> Java(TM) SE Runtime Environment (build 1.6.0_24-b07-334-10M3326)
>> Java HotSpot(TM) 64-Bit Server VM (build 19.1-b02-334, mixed mode)
>>
>> Highlights of the problems:
>> ...
>> WARN 07:48:28,482 Could not start register mbean in JMX
>> ...
>> Caused by: java.net.BindException: Address already in use
>> ...
>> ERROR 07:48:28,511 Exception encountered during startup.
>> java.lang.RuntimeException: Unable to create thrift socket to localhost/10.0.1.3:9160
>> ...
>> Caused by: org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address localhost/10.0.1.3:9160.
>> ...
>>
>>   - Bob Futrelle

Re: Cassandra still won't start - in-use ports block it

Posted by Jeremy Hanna <je...@gmail.com>.
I don't know if others have asked this but do you have a firewall running that would prevent access to those ports or something like that?

On Mar 11, 2011, at 10:40 PM, Bob Futrelle wrote:

> My frustration continues, especially exasperating because so many people just seem to download Cassandra and run it with no problems.
> All my efforts have been stymied by one port-in-use problem after another.
> People on this list have helped and their suggestions got me a little bit further, but no further.
> 
> Platform,  MacBook Pro, OS 10.6.6
> 
> Java(TM) SE Runtime Environment (build 1.6.0_24-b07-334-10M3326)
> Java HotSpot(TM) 64-Bit Server VM (build 19.1-b02-334, mixed mode)
> 
> Highlights of the problems:
> ...
> WARN 07:48:28,482 Could not start register mbean in JMX
> ...
> Caused by: java.net.BindException: Address already in use
> ...
> ERROR 07:48:28,511 Exception encountered during startup.
> java.lang.RuntimeException: Unable to create thrift socket to localhost/10.0.1.3:9160
> ...
> Caused by: org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address localhost/10.0.1.3:9160.
> ...
> 
>   - Bob Futrelle
> 
> Details:
> 
> apache-cassandra-0.7.3: sudo ./bin/cassandra -f -p pidfile
> Password:
>  INFO 07:48:27,851 Logging initialized
>  INFO 07:48:27,862 Heap size: 1052770304/1052770304
>  INFO 07:48:27,864 JNA not found. Native methods will be disabled.
>  INFO 07:48:27,872 Loading settings from file:/Users/robertfutrelle/Research/Cassandra/apache-cassandra-0.7.3/conf/cassandra.yaml
>  INFO 07:48:27,993 DiskAccessMode 'auto' determined to be mmap, indexAccessMode is mmap
>  INFO 07:48:28,095 reading saved cache /var/lib/cassandra/saved_caches/system-LocationInfo-KeyCache
>  INFO 07:48:28,101 Opening /var/lib/cassandra/data/system/LocationInfo-f-9
>  INFO 07:48:28,126 Opening /var/lib/cassandra/data/system/LocationInfo-f-10
>  INFO 07:48:28,164 Couldn't detect any schema definitions in local storage.
>  INFO 07:48:28,165 Found table data in data directories. Consider using JMX to call org.apache.cassandra.service.StorageService.loadSchemaFromYaml().
>  INFO 07:48:28,176 Creating new commitlog segment /var/lib/cassandra/commitlog/CommitLog-1299847708176.log
>  INFO 07:48:28,184 Replaying /var/lib/cassandra/commitlog/CommitLog-1299809981227.log
>  INFO 07:48:28,187 Finished reading /var/lib/cassandra/commitlog/CommitLog-1299809981227.log
>  INFO 07:48:28,187 Log replay complete
>  INFO 07:48:28,207 Cassandra version: 0.7.3
>  INFO 07:48:28,207 Thrift API version: 19.4.0
>  INFO 07:48:28,209 Loading persisted ring state
>  INFO 07:48:28,213 Starting up server gossip
>  INFO 07:48:28,224 switching in a fresh Memtable for LocationInfo at CommitLogContext(file='/var/lib/cassandra/commitlog/CommitLog-1299847708176.log', position=148)
>  INFO 07:48:28,224 Enqueuing flush of Memtable-LocationInfo@2098581612(29 bytes, 1 operations)
>  INFO 07:48:28,225 Writing Memtable-LocationInfo@2098581612(29 bytes, 1 operations)
>  INFO 07:48:28,305 Completed flushing /var/lib/cassandra/data/system/LocationInfo-f-11-Data.db (80 bytes)
>  INFO 07:48:28,336 Using saved token 68734258064819962813495316844051960711
>  INFO 07:48:28,337 switching in a fresh Memtable for LocationInfo at CommitLogContext(file='/var/lib/cassandra/commitlog/CommitLog-1299847708176.log', position=444)
>  INFO 07:48:28,337 Enqueuing flush of Memtable-LocationInfo@389001391(53 bytes, 2 operations)
>  INFO 07:48:28,338 Writing Memtable-LocationInfo@389001391(53 bytes, 2 operations)
>  INFO 07:48:28,404 Completed flushing /var/lib/cassandra/data/system/LocationInfo-f-12-Data.db (163 bytes)
>  INFO 07:48:28,405 Compacting [SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-9-Data.db'),SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-10-Data.db'),SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-11-Data.db'),SSTableReader(path='/var/lib/cassandra/data/system/LocationInfo-f-12-Data.db')]
>  INFO 07:48:28,472 Compacted to /var/lib/cassandra/data/system/LocationInfo-tmp-f-13-Data.db.  770 to 447 (~58% of original) bytes for 3 keys.  Time: 65ms.
>  WARN 07:48:28,482 Could not start register mbean in JMX
> java.lang.reflect.InvocationTargetException
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.cassandra.utils.Mx4jTool.maybeLoad(Mx4jTool.java:66)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:203)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:316)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
> Caused by: java.net.BindException: Address already in use
> 	at java.net.PlainSocketImpl.socketBind(Native Method)
> 	at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:383)
> 	at java.net.ServerSocket.bind(ServerSocket.java:328)
> 	at java.net.ServerSocket.<init>(ServerSocket.java:194)
> 	at mx4j.tools.adaptor.PlainAdaptorServerSocketFactory.createServerSocket(PlainAdaptorServerSocketFactory.java:24)
> 	at mx4j.tools.adaptor.http.HttpAdaptor.createServerSocket(HttpAdaptor.java:672)
> 	at mx4j.tools.adaptor.http.HttpAdaptor.start(HttpAdaptor.java:478)
> 	... 8 more
> ERROR 07:48:28,511 Exception encountered during startup.
> java.lang.RuntimeException: Unable to create thrift socket to localhost/10.0.1.3:9160
> 	at org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:108)
> 	at org.apache.cassandra.thrift.CassandraDaemon.startServer(CassandraDaemon.java:55)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.startRPCServer(AbstractCassandraDaemon.java:260)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.start(AbstractCassandraDaemon.java:232)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:329)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
> Caused by: org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address localhost/10.0.1.3:9160.
> 	at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:99)
> 	at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:85)
> 	at org.apache.cassandra.thrift.TCustomServerSocket.<init>(TCustomServerSocket.java:59)
> 	at org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:101)
> 	... 5 more
> Exception encountered during startup.
> java.lang.RuntimeException: Unable to create thrift socket to localhost/10.0.1.3:9160
> 	at org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:108)
> 	at org.apache.cassandra.thrift.CassandraDaemon.startServer(CassandraDaemon.java:55)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.startRPCServer(AbstractCassandraDaemon.java:260)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.start(AbstractCassandraDaemon.java:232)
> 	at org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:329)
> 	at org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:79)
> Caused by: org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address localhost/10.0.1.3:9160.
> 	at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:99)
> 	at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:85)
> 	at org.apache.cassandra.thrift.TCustomServerSocket.<init>(TCustomServerSocket.java:59)
> 	at org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.<init>(CassandraDaemon.java:101)
> 	... 5 more
>