You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Ashutosh Chauhan (JIRA)" <ji...@apache.org> on 2013/08/08 02:10:49 UTC

[jira] [Commented] (HIVE-4913) Put deterministic ordering in the top-K ngrams output of UDF context_ngrams()

    [ https://issues.apache.org/jira/browse/HIVE-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13732982#comment-13732982 ] 

Ashutosh Chauhan commented on HIVE-4913:
----------------------------------------

Patch contains some changes from other diff. Can you clean that up? Patch looks good.
                
> Put deterministic ordering in the top-K ngrams output of UDF context_ngrams()
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-4913
>                 URL: https://issues.apache.org/jira/browse/HIVE-4913
>             Project: Hive
>          Issue Type: Improvement
>          Components: UDF
>    Affects Versions: 0.10.0, 0.11.0
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>            Priority: Minor
>             Fix For: 0.12.0
>
>         Attachments: HIVE-4913.patch
>
>
> Currently UDF context_ngrams() output top-K ngrams in the order of descending frequency. When there are ties, i.e., phrases with same ngram value, the order is indeterministic. Tie breaker is needed to break the ties, so that the output is deterministic.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira