You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "luwei (JIRA)" <ji...@apache.org> on 2011/09/08 18:28:08 UTC
[jira] [Commented] (CASSANDRA-3037) Could not get input splits
Caused by: java.io.IOException: failed connecting to all endpoints
slave1/123.198.69.242
[ https://issues.apache.org/jira/browse/CASSANDRA-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13100430#comment-13100430 ]
luwei commented on CASSANDRA-3037:
----------------------------------
hi, I don't know whether you have solved the problem. I met with the same problem as yours (Same configuration as yours too) and trrie to solve it.
Problem location:
public List<InputSplit> call() throws Exception
{
...
List<String> tokens = getSubSplits(keyspace, cfName, range, conf);
...
In the method getSubSplits when calling method createConnection(host, ConfigHelper.getRpcPort(conf), true), the format of host is not right. It is hostname/10.197.34.111 sometimes (ip_address), so createConnection will fail. We need to extract the ip address and then call createConnection.
You can try to change the code and try Hadoop again.
Good luck!
> Could not get input splits Caused by: java.io.IOException: failed connecting to all endpoints slave1/123.198.69.242
> -------------------------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-3037
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3037
> Project: Cassandra
> Issue Type: Bug
> Components: Hadoop
> Affects Versions: 0.8.4
> Environment: Ubuntu 10.04 LTS
> Hadoop from Cloudera 0.20.203
> Latest java
> Reporter: Anton Vedeshin
> Priority: Blocker
>
> After upgrade of cassandra from 0.8.2 to 0.8.4, got this error, before upgrade everything was working fine
> I have restarted cassandra, removed data, etc. nothing helps
> I have 6 identical machines in the cloud, before it was working fine. If I make netstat then it shows port 9160 listening nodetool ... ring - responces with 6 machines UP.
> Finally I have truncated all 6 servers and reinstalled hadoop + cassandra 0.8.4 from scratch.
> compiled and tried to execute word_cound
> receive the same error as after upgrade
> Error:
> 11/08/15 15:23:54 INFO WordCount: output reducer type: cassandra
> 11/08/15 15:23:54 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> Exception in thread "main" java.io.IOException: Could not get input splits
> at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSplits(ColumnFamilyInputFormat.java:157)
> at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
> at WordCount.run(Unknown Source)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at WordCount.main(Unknown Source)
> Caused by: java.util.concurrent.ExecutionException: java.io.IOException: failed connecting to all endpoints slave1/154.198.69.242
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222)
> at java.util.concurrent.FutureTask.get(FutureTask.java:83)
> at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSplits(ColumnFamilyInputFormat.java:153)
> ... 7 more
> Caused by: java.io.IOException: failed connecting to all endpoints slave1/154.198.69.242
> at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.getSubSplits(ColumnFamilyInputFormat.java:234)
> at org.apache.cassandra.hadoop.ColumnFamilyInputFormat.access$200(ColumnFamilyInputFormat.java:70)
> at org.apache.cassandra.hadoop.ColumnFamilyInputFormat$SplitCallable.call(ColumnFamilyInputFormat.java:190)
> at org.apache.cassandra.hadoop.ColumnFamilyInputFormat$SplitCallable.call(ColumnFamilyInputFormat.java:175)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira