You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Xuefu Zhang (JIRA)" <ji...@apache.org> on 2013/08/08 21:28:48 UTC

[jira] [Updated] (HIVE-4913) Put deterministic ordering in the top-K ngrams output of UDF context_ngrams()

     [ https://issues.apache.org/jira/browse/HIVE-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xuefu Zhang updated HIVE-4913:
------------------------------

    Attachment: HIVE-4913.patch

Patch is updated to address the comments above.
                
> Put deterministic ordering in the top-K ngrams output of UDF context_ngrams()
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-4913
>                 URL: https://issues.apache.org/jira/browse/HIVE-4913
>             Project: Hive
>          Issue Type: Improvement
>          Components: UDF
>    Affects Versions: 0.10.0, 0.11.0
>            Reporter: Xuefu Zhang
>            Assignee: Xuefu Zhang
>            Priority: Minor
>             Fix For: 0.12.0
>
>         Attachments: HIVE-4913.patch, HIVE-4913.patch
>
>
> Currently UDF context_ngrams() output top-K ngrams in the order of descending frequency. When there are ties, i.e., phrases with same ngram value, the order is indeterministic. Tie breaker is needed to break the ties, so that the output is deterministic.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira