You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Robert Chansler (JIRA)" <ji...@apache.org> on 2008/10/22 00:36:44 UTC
[jira] Updated: (HADOOP-2302) Streaming should provide an option
for numerical sort of keys
[ https://issues.apache.org/jira/browse/HADOOP-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-2302:
------------------------------------
Release Note: Introduced numerical key comparison for streaming. (was: Provides a way to compare keys using numerical comparison. The key specification of the form -k pos1[,pos2], is supported, where,
* pos is of the form f[.c][opts], where f is the number of the key field to use, and c is the number of the first character from the beginning of the field. Fields and character posns are numbered starting with 1; a character position of zero in pos2 indicates the field's last character. If '.c' is omitted from pos1, it defaults to 1 (the beginning of the field); if omitted from pos2, it defaults to 0 (the end of the field). opts are ordering options. The supported options are:
* -n, (Sort numerically)
* -r, (Reverse the result of comparison)
Multiple key specifications can be provided to sort on multiple key fields (in order). The key fields are assumed to be separated using map.output.key.field.separator. Specifying only -n as an option will make the comparator treat the all key bytes as one field.)
Introduced numerical key comparison for streaming. The key specification of the form -k pos1[,pos2], is supported, where,
* pos is of the form f[.c][opts], where f is the number of the key field to use, and c is the number of the first character from the beginning of the field. Fields and character positions are numbered starting with 1; a character position of zero in pos2 indicates the field's last character. If '.c' is omitted from pos1, it defaults to 1 (the beginning of the field); if omitted from pos2, it defaults to 0 (the end of the field). opts are ordering options. The supported options are:
* -n, (Sort numerically)
* -r, (Reverse the result of comparison)
Multiple key specifications can be provided to sort on multiple key fields (in order). The key fields are assumed to be separated using map.output.key.field.separator. Specifying only -n as an option will make the comparator treat the all key bytes as one field.
[Is this user guide in the streaming user documentation?]
> Streaming should provide an option for numerical sort of keys
> --------------------------------------------------------------
>
> Key: HADOOP-2302
> URL: https://issues.apache.org/jira/browse/HADOOP-2302
> Project: Hadoop Core
> Issue Type: Improvement
> Components: contrib/streaming
> Reporter: Lohit Vijayarenu
> Assignee: Devaraj Das
> Fix For: 0.19.0
>
> Attachments: 2302-new.patch, 2302-new.patch, 2302-new1.patch, 2302-new2.patch, 2302.1.patch, 2302.3.patch
>
>
> It would be good to have an option for numerical sort of keys for streaming.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.