You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Jesse Shieh (JIRA)" <ji...@apache.org> on 2011/01/16 06:00:46 UTC
[jira] Commented: (CASSANDRA-1993) Word count example doesn't
output the words correctly to cassandra. It outputs spurious data past the
length of the byte array.
[ https://issues.apache.org/jira/browse/CASSANDRA-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12982223#action_12982223 ]
Jesse Shieh commented on CASSANDRA-1993:
----------------------------------------
nice improvement =)
you might also be interested to know that the latest version of hadoop adds a method copyBytes to the Text object that should be able to replace getBytes and take care of this automatically for us.
see: http://svn.apache.org/viewvc/hadoop/common/trunk/src/java/org/apache/hadoop/io/Text.java?r1=953881&r2=1050070
> Word count example doesn't output the words correctly to cassandra. It outputs spurious data past the length of the byte array.
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-1993
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1993
> Project: Cassandra
> Issue Type: Bug
> Components: Contrib
> Affects Versions: 0.7.0
> Environment: All
> Reporter: Jesse Shieh
> Assignee: Jonathan Ellis
> Priority: Minor
> Fix For: 0.7.1
>
> Attachments: 1993-v2.txt, trunk-1993.txt
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> To reproduce:
> # start a local cassandra server e.g. sudo bin/cassandra -f
> cd contrib/word_count
> ant
> bin/word_count_setup
> bin/word_count
> # check the data in cassandra, all looks fine because the words are all of the same length.
> # change the data in cassandra to real words, rerun the mapreduce and you'll see some words have spurious characters written past their length
> # this is because the word bytes are not terminated at their length
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.