[jira] [Commented] (DRILL-792) Joining a hive table with parquet file is returning an empty result set

["Aman Sinha (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099390#comment-14099390 ] 

Aman Sinha commented on DRILL-792:
----------------------------------

This issue seems to have been fixed.  On the latest master branch, commit #: [687b9b0]   I cannot reproduce it.  Since there is no EXPLAIN plan attached with this bug I cannot compare the plans.  I ran the following queries for validation: 

Join Hive table with parquet file :

0: jdbc:drill:zk=local> select count(*) from hive.uservisits uservisits, dfs.`/Users/asinha/data/url-data/rankings.parquet` rankings where uservisits.destinationurl = rankings.pageURL;
+------------+
|   EXPR$0   |
+------------+
| 46         |
+------------+

Validate above results by joining the uservisits and rankings tables within Hive:

0: jdbc:drill:zk=local> select count(*) from hive.uservisits uservisits, hive.rankings rankings where uservisits.destinationurl = rankings.pageurl;
+------------+
|   EXPR$0   |
+------------+
| 46         |
+------------+

Note that the above queries return the same COUNT values.  

Also check the actual pageRank column data from the join: 

0: jdbc:drill:zk=local> select rankings.pageRank from hive.uservisits uservisits, dfs.`/Users/asinha/data/url-data/rankings.parquet` rankings where uservisits.destinationurl = rankings.pageURL order by rankings.pageRank limit 10;
+------------+
|  pageRank  |
+------------+
| 8          |
| 8          |
| 9          |
| 9          |
| 9          |
| 9          |
| 9          |
| 11         |
| 11         |
| 12         |
+------------+

> Joining a hive table with parquet file is returning an empty result set
> -----------------------------------------------------------------------
>
>                 Key: DRILL-792
>                 URL: https://issues.apache.org/jira/browse/DRILL-792
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Storage - Parquet
>            Reporter: Rahul Challapalli
>            Assignee: Aman Sinha
>            Priority: Critical
>             Fix For: 0.5.0
>
>         Attachments: 792.ddl, rankings.parquet, rankings.txt, uservisits.parquet, uservisits.txt
>
>
> git.commit.id.abbrev=70fab8c
> 1. Joining a hive table with parquet results in an empty output. Check below query
> select rankings.pageRank pagerank from `dfs/parquet/rankings/` rankings inner join hive.uservisits uservisits on rankings.pageURL = uservisits.destinationurl
> 2. Joining hive table with hive table seems to work fine
> select rankings.pagerank pagerank from hive.rankings rankings inner join hive.uservisits uservisits on rankings.pageurl = uservisits.destinationurl
> I attached the parquet and text files required along with the required hive ddl. Let me know if you need more information.



--
This message was sent by Atlassian JIRA
(v6.2#6252)