You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jeremy Hanna (JIRA)" <ji...@apache.org> on 2011/04/15 18:36:05 UTC

[jira] [Created] (CASSANDRA-2487) Pig example script no longer working

Pig example script no longer working
------------------------------------

                 Key: CASSANDRA-2487
                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2487
             Project: Cassandra
          Issue Type: Bug
            Reporter: Jeremy Hanna
            Assignee: Jeremy Hanna
            Priority: Minor
             Fix For: 0.7.5


There is a strange error given when trying to run the example-script.pig.

java.io.IOException: Type mismatch in key from map: expected org.apache.pig.impl.io.NullableBytesWritable, recieved org.apache.pig.impl.io.NullableText
	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:870)
	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:573)
	at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.collect(PigMapReduce.java:116)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:238)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:231)
	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:646)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)

Looks like it has to do with PIG-919 and PIG-1277.  For now we can just cast the var as a chararray and it works though.  Will attach a patch.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (CASSANDRA-2487) Pig example script no longer working

Posted by "Jonathan Ellis (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jonathan Ellis updated CASSANDRA-2487:
--------------------------------------

    Reviewer: brandon.williams

> Pig example script no longer working
> ------------------------------------
>
>                 Key: CASSANDRA-2487
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2487
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jeremy Hanna
>            Assignee: Jeremy Hanna
>            Priority: Minor
>              Labels: hadoop, pig
>             Fix For: 0.7.6
>
>         Attachments: 2487.txt
>
>
> There is a strange error given when trying to run the example-script.pig.
> java.io.IOException: Type mismatch in key from map: expected org.apache.pig.impl.io.NullableBytesWritable, recieved org.apache.pig.impl.io.NullableText
> 	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:870)
> 	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:573)
> 	at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.collect(PigMapReduce.java:116)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:238)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:231)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:646)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
> Looks like it has to do with PIG-919 and PIG-1277.  For now we can just cast the var as a chararray and it works though.  Will attach a patch.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (CASSANDRA-2487) Pig example script no longer working

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/CASSANDRA-2487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13027163#comment-13027163 ] 

Hudson commented on CASSANDRA-2487:
-----------------------------------

Integrated in Cassandra-0.7 #465 (See [https://builds.apache.org/hudson/job/Cassandra-0.7/465/])
    Update pig example script to work again.
Patch by Jeremy Hanna, reviewed by brandonwilliams for CASSANDRA-2487


> Pig example script no longer working
> ------------------------------------
>
>                 Key: CASSANDRA-2487
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2487
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jeremy Hanna
>            Assignee: Jeremy Hanna
>            Priority: Minor
>              Labels: hadoop, pig
>             Fix For: 0.7.6
>
>         Attachments: 2487.txt
>
>
> There is a strange error given when trying to run the example-script.pig.
> java.io.IOException: Type mismatch in key from map: expected org.apache.pig.impl.io.NullableBytesWritable, recieved org.apache.pig.impl.io.NullableText
> 	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:870)
> 	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:573)
> 	at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.collect(PigMapReduce.java:116)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:238)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:231)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:646)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
> Looks like it has to do with PIG-919 and PIG-1277.  For now we can just cast the var as a chararray and it works though.  Will attach a patch.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (CASSANDRA-2487) Pig example script no longer working

Posted by "Jeremy Hanna (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/CASSANDRA-2487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jeremy Hanna updated CASSANDRA-2487:
------------------------------------

    Attachment: 2487.txt

Did the workaround they use in PIG-919 by casting as a chararray for now.  Also put the schema in the load.  Made the name of the keyspace and column family not like the old 0.6 stuff.  Also updated the readme a bit and included an example of setting env vars for running locally since a FAQ.

> Pig example script no longer working
> ------------------------------------
>
>                 Key: CASSANDRA-2487
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-2487
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Jeremy Hanna
>            Assignee: Jeremy Hanna
>            Priority: Minor
>              Labels: hadoop, pig
>             Fix For: 0.7.5
>
>         Attachments: 2487.txt
>
>
> There is a strange error given when trying to run the example-script.pig.
> java.io.IOException: Type mismatch in key from map: expected org.apache.pig.impl.io.NullableBytesWritable, recieved org.apache.pig.impl.io.NullableText
> 	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.collect(MapTask.java:870)
> 	at org.apache.hadoop.mapred.MapTask$NewOutputCollector.write(MapTask.java:573)
> 	at org.apache.hadoop.mapreduce.TaskInputOutputContext.write(TaskInputOutputContext.java:80)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Map.collect(PigMapReduce.java:116)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:238)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:231)
> 	at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
> 	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> 	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:646)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:322)
> 	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:210)
> Looks like it has to do with PIG-919 and PIG-1277.  For now we can just cast the var as a chararray and it works though.  Will attach a patch.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira