You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Tharindu Mathew (JIRA)" <ji...@apache.org> on 2011/09/16 11:49:09 UTC

[jira] [Created] (CASSANDRA-3215) The word count example demonstrating hadoop integration fails in trunk

The word count example demonstrating hadoop integration fails in trunk
----------------------------------------------------------------------

                 Key: CASSANDRA-3215
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3215
             Project: Cassandra
          Issue Type: Bug
            Reporter: Tharindu Mathew


The following stack traces after running, bin/hadoop in the trunk (0.8.3-SNAPSHOT):

./bin/word_count
11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (CASSANDRA-3215) The word count example demonstrating hadoop integration fails in trunk

Posted by "Brandon Williams (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13106822#comment-13106822 ] 

Brandon Williams commented on CASSANDRA-3215:
---------------------------------------------

This shouldn't happen with the reverted CASSANDRA-2388, can you update to the latest trunk and try again?

> The word count example demonstrating hadoop integration fails in trunk
> ----------------------------------------------------------------------
>
>                 Key: CASSANDRA-3215
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3215
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Contrib, Hadoop
>    Affects Versions: 1.0.0
>            Reporter: Tharindu Mathew
>            Assignee: Brandon Williams
>            Priority: Minor
>              Labels: hadoop
>             Fix For: 1.0.0
>
>
> The following stack traces after running, bin/hadoop in the trunk (0.8.2-dev-SNAPSHOT):
> ./bin/word_count
> 11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
> 11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
> 11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
> 11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
> 11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
> 11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
> 11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
> 11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
> 11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
> 11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-3215) The word count example demonstrating hadoop integration fails in trunk

Posted by "Tharindu Mathew (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tharindu Mathew updated CASSANDRA-3215:
---------------------------------------

    Description: 
The following stack traces after running, bin/hadoop in the trunk (0.8.2-dev-SNAPSHOT):

./bin/word_count
11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0

  was:
The following stack traces after running, bin/hadoop in the trunk (0.8.3-SNAPSHOT):

./bin/word_count
11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
Caused by: java.lang.UnsupportedOperationException: no local connection available
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
	... 4 more
11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0


> The word count example demonstrating hadoop integration fails in trunk
> ----------------------------------------------------------------------
>
>                 Key: CASSANDRA-3215
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3215
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Tharindu Mathew
>              Labels: hadoop
>
> The following stack traces after running, bin/hadoop in the trunk (0.8.2-dev-SNAPSHOT):
> ./bin/word_count
> 11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
> 11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
> 11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
> 11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
> 11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
> 11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
> 11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
> 11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
> 11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
> 11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (CASSANDRA-3215) The word count example demonstrating hadoop integration fails in trunk

Posted by "Tharindu Mathew (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tharindu Mathew resolved CASSANDRA-3215.
----------------------------------------

    Resolution: Fixed

This is fixed after updating trunk and building. As per Brandon's comment reverting CASSANDRA-2388 was the fix.

> The word count example demonstrating hadoop integration fails in trunk
> ----------------------------------------------------------------------
>
>                 Key: CASSANDRA-3215
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3215
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Contrib, Hadoop
>    Affects Versions: 1.0.0
>            Reporter: Tharindu Mathew
>            Assignee: Brandon Williams
>            Priority: Minor
>              Labels: hadoop
>             Fix For: 1.0.0
>
>
> The following stack traces after running, bin/hadoop in the trunk (0.8.2-dev-SNAPSHOT):
> ./bin/word_count
> 11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
> 11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
> 11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
> 11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
> 11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
> 11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
> 11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
> 11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
> 11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
> 11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (CASSANDRA-3215) The word count example demonstrating hadoop integration fails in trunk

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-3215:
--------------------------------------

          Component/s: Hadoop
                       Contrib
             Priority: Minor  (was: Major)
    Affects Version/s: 1.0.0
        Fix Version/s: 1.0.0
             Assignee: Brandon Williams

> The word count example demonstrating hadoop integration fails in trunk
> ----------------------------------------------------------------------
>
>                 Key: CASSANDRA-3215
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-3215
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Contrib, Hadoop
>    Affects Versions: 1.0.0
>            Reporter: Tharindu Mathew
>            Assignee: Brandon Williams
>            Priority: Minor
>              Labels: hadoop
>             Fix For: 1.0.0
>
>
> The following stack traces after running, bin/hadoop in the trunk (0.8.2-dev-SNAPSHOT):
> ./bin/word_count
> 11/09/15 12:28:28 INFO WordCount: output reducer type: cassandra
> 11/09/15 12:28:29 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
> 11/09/15 12:28:30 INFO mapred.JobClient: Running job: job_local_0001
> 11/09/15 12:28:30 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:30 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:30 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:30 WARN mapred.LocalJobRunner: job_local_0001
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:31 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:31 INFO mapred.JobClient: Job complete: job_local_0001
> 11/09/15 12:28:31 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:31 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:32 INFO mapred.JobClient: Running job: job_local_0002
> 11/09/15 12:28:32 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:32 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:32 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:32 WARN mapred.LocalJobRunner: job_local_0002
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:33 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:33 INFO mapred.JobClient: Job complete: job_local_0002
> 11/09/15 12:28:33 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:33 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:34 INFO mapred.JobClient: Running job: job_local_0003
> 11/09/15 12:28:34 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:34 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:34 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:34 WARN mapred.LocalJobRunner: job_local_0003
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:35 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:35 INFO mapred.JobClient: Job complete: job_local_0003
> 11/09/15 12:28:35 INFO mapred.JobClient: Counters: 0
> 11/09/15 12:28:35 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
> 11/09/15 12:28:36 INFO mapred.JobClient: Running job: job_local_0004
> 11/09/15 12:28:36 INFO mapred.MapTask: io.sort.mb = 100
> 11/09/15 12:28:37 INFO mapred.MapTask: data buffer = 79691776/99614720
> 11/09/15 12:28:37 INFO mapred.MapTask: record buffer = 262144/327680
> 11/09/15 12:28:37 WARN mapred.LocalJobRunner: job_local_0004
> java.lang.RuntimeException: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:132)
> 	at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:418)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:620)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> Caused by: java.lang.UnsupportedOperationException: no local connection available
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.getLocation(ColumnFamilyRecordReader.java:176)
> 	at org.apache.cassandra.hadoop.ColumnFamilyRecordReader.initialize(ColumnFamilyRecordReader.java:113)
> 	... 4 more
> 11/09/15 12:28:37 INFO mapred.JobClient:  map 0% reduce 0%
> 11/09/15 12:28:37 INFO mapred.JobClient: Job complete: job_local_0004
> 11/09/15 12:28:37 INFO mapred.JobClient: Counters: 0

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira