You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2014/09/18 20:43:34 UTC
[jira] [Commented] (HIVE-8181) Upgrade JavaEWAH version to allow
for unsorted bitset creation
[ https://issues.apache.org/jira/browse/HIVE-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139317#comment-14139317 ]
Gopal V commented on HIVE-8181:
-------------------------------
This is the JavaEWAH change-set, that fixes the limitation (for like timestamp data with a few off-order bits)
https://github.com/lemire/javaewah/commit/a6a52653b7118169f349b382ad2926608fdd656e
> Upgrade JavaEWAH version to allow for unsorted bitset creation
> --------------------------------------------------------------
>
> Key: HIVE-8181
> URL: https://issues.apache.org/jira/browse/HIVE-8181
> Project: Hive
> Issue Type: Bug
> Components: UDF
> Reporter: Gopal V
>
> JavaEWAH has removed the restriction that bitsets can only be set in order in the latest release.
> Currently the use of {{ewah_bitmap}} UDAF requires a {{SORT BY}}.
> {code}
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException: Can't set bits out of order with EWAHCompressedBitmap
> at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:824)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> at org.apache.hadoop.hive.ql.exec.ExtractOperator.processOp(ExtractOperator.java:45)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.ExecReducer.reduce(ExecReducer.java:249)
> ... 7 more
> Caused by: java.lang.RuntimeException: Can't set bits out of order with EWAHCompressedBitmap
> at
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)