[jira] [Commented] (HAWQ-953) Pushed down filter fails when quering partitioned Hive tables

["Devin Jia (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAWQ-953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395162#comment-15395162 ] 

Devin Jia commented on HAWQ-953:
--------------------------------

Cause of the problem: Hive of JDO filter pushdown only support String PartitionKey. Can modify the file-hive-site.xml, add the following:
<property>
<name>hive.metastore.integral.jdo.pushdown</name>
<value>true</value>
</property>
Or , modify hawq pxf class-HiveDataFragmenter.java, allowing only string filter .

> Pushed down filter fails when quering partitioned Hive tables
> -------------------------------------------------------------
>
>                 Key: HAWQ-953
>                 URL: https://issues.apache.org/jira/browse/HAWQ-953
>             Project: Apache HAWQ
>          Issue Type: Bug
>          Components: PXF
>            Reporter: Oleksandr Diachenko
>            Assignee: Oleksandr Diachenko
>             Fix For: 2.0.1.0-incubating
>
>
> After code changes in HAWQ-779 Hawq started sending filters to Hive, which fails on partitioned tables.
> {code}
> # \d hive_partitions_all_types
> External table "public.hive_partitions_all_types"
>  Column |            Type             | Modifiers 
> --------+-----------------------------+-----------
>  t1     | text                        | 
>  t2     | text                        | 
>  num1   | integer                     | 
>  dub1   | double precision            | 
>  dec1   | numeric                     | 
>  tm     | timestamp without time zone | 
>  r      | real                        | 
>  bg     | bigint                      | 
>  b      | boolean                     | 
>  tn     | smallint                    | 
>  sml    | smallint                    | 
>  dt     | date                        | 
>  vc1    | character varying(5)        | 
>  c1     | character(3)                | 
>  bin    | bytea                       | 
> Type: readable
> Encoding: UTF8
> Format type: custom
> Format options: formatter 'pxfwritable_import' 
> External location: pxf://127.0.0.1:51200/hive_many_partitioned_table?PROFILE=Hive
> pxfautomation=# SELECT t1, t2, bg FROM hive_partitions_all_types where bg = 23456789;
> ERROR:  remote component error (500) from '127.0.0.1:51200':  type  Exception report   message   MetaException(message:Filtering is supported only on partition keys of type string)    description   The server encountered an internal error that prevented it from fulfilling this request.    exception   javax.servlet.ServletException: MetaException(message:Filtering is supported only on partition keys of type string) (libchurl.c:878)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)