You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@cassandra.apache.org by MSJ <ms...@icloud.com> on 2015/02/26 23:03:13 UTC

Spark BlockManager: use IP?

Hi All,

Using DSE 4.6.1 (Spark 1.1.0.2).

I am having trouble convincing BlockManager in a Spark Worker process to use a machine’s IP instead of its hostname. Everything else in the Spark Workers is using the IP correctly.

ERROR 2015-02-26 21:49:01 org.apache.spark.network.SendingConnection: Error connecting to 3a831deac5a5:42000
java.nio.channels.UnresolvedAddressException
        at sun.nio.ch.Net.checkAddress(Net.java:123)
        at sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:621)
        at org.apache.spark.network.SendingConnection.connect(Connection.scala:299)
        at org.apache.spark.network.ConnectionManager.run(ConnectionManager.scala:278)
        at org.apache.spark.network.ConnectionManager$$anon$4.run(ConnectionManager.scala:139)
INFO 2015-02-26 21:49:01 org.apache.spark.network.ConnectionManager: Handling connection error on connection to ConnectionManagerId(3a831deac5a5,42000)
INFO 2015-02-26 21:49:01 org.apache.spark.network.ConnectionManager: Removing SendingConnection to ConnectionManagerId(3a831deac5a5,42000)


Any suggestions, tricks, recommendations?

Thanks!

MSJ