You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Rahul Challapalli (JIRA)" <ji...@apache.org> on 2015/04/21 22:58:59 UTC
[jira] [Closed] (DRILL-2121) Join on complex data with sub-queries
is returning empty maps
[ https://issues.apache.org/jira/browse/DRILL-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rahul Challapalli closed DRILL-2121.
------------------------------------
Verified and added the below test case
Functional/Passing/flatten_operators/2rows/hash-join/join9_DRILL-2121.q
> Join on complex data with sub-queries is returning empty maps
> -------------------------------------------------------------
>
> Key: DRILL-2121
> URL: https://issues.apache.org/jira/browse/DRILL-2121
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Data Types, Execution - Relational Operators
> Reporter: Rahul Challapalli
> Assignee: Hanifi Gunes
> Priority: Blocker
> Fix For: 0.9.0
>
>
> git.commit.id.abbrev=3e33880
> Data Set :
> {code}
> {
> "uid": 1,
> "events" : [
> { "evnt_id":"e1", "campaign_id":"c1", "event_name":"e1_name", "event_time":1000000, "type" : "cmpgn1"},
> { "evnt_id":"e2", "campaign_id":"c1", "event_name":"e2_name", "event_time":2000000, "type" : "cmpgn4"},
> { "evnt_id":"e3", "campaign_id":"c1", "event_name":"e3_name", "event_time":3000000, "type" : "cmpgn1"},
> { "evnt_id":"e4", "campaign_id":"c1", "event_name":"e4_name", "event_time":4000000, "type" : "cmpgn1"},
> { "evnt_id":"e5", "campaign_id":"c2", "event_name":"e5_name", "event_time":5000000, "type" : "cmpgn3"},
> { "evnt_id":"e6", "campaign_id":"c1", "event_name":"e6_name", "event_time":6000000, "type" : "cmpgn9"},
> { "evnt_id":"e7", "campaign_id":"c1", "event_name":"e7_name", "event_time":7000000, "type" : "cmpgn3"},
> { "evnt_id":"e8", "campaign_id":"c2", "event_name":"e8_name", "event_time":8000000, "type" : "cmpgn2"},
> { "evnt_id":"e9", "campaign_id":"c2", "event_name":"e9_name", "event_time":9000000, "type" : "cmpgn4"}
> ],
> "transactions" : [
> { "trans_id":"t1", "amount":100, "trans_time":7777777, "type":"sports"},
> { "trans_id":"t2", "amount":1000, "trans_time":8888888, "type":"groceries"}
> ]
> }
> {code}
> The below query returns empty maps for the 3rd field
> {code}
> 0: jdbc:drill:schema=dfs.drillTestDir> select t1.uid, t1.event, t2.transaction from (select uid, flatten(events) event from `temp4.json`) t1 inner join (select uid, flatten(transactions) transaction from `temp4.json`) t2 on t1.uid = t2.uid;
> +------------+------------+-------------+
> | uid | event | transaction |
> +------------+------------+-------------+
> | 1 | {"evnt_id":"e1","campaign_id":"c1","event_name":"e1_name","event_time":1000000,"type":"cmpgn1"} | {} |
> | 1 | {"evnt_id":"e1","campaign_id":"c1","event_name":"e1_name","event_time":1000000,"type":"cmpgn1"} | {} |
> | 1 | {"evnt_id":"e2","campaign_id":"c1","event_name":"e2_name","event_time":2000000,"type":"cmpgn4"} | {} |
> | 1 | {"evnt_id":"e2","campaign_id":"c1","event_name":"e2_name","event_time":2000000,"type":"cmpgn4"} | {} |
> | 1 | {"evnt_id":"e3","campaign_id":"c1","event_name":"e3_name","event_time":3000000,"type":"cmpgn1"} | {} |
> | 1 | {"evnt_id":"e3","campaign_id":"c1","event_name":"e3_name","event_time":3000000,"type":"cmpgn1"} | {} |
> | 1 | {"evnt_id":"e4","campaign_id":"c1","event_name":"e4_name","event_time":4000000,"type":"cmpgn1"} | {} |
> | 1 | {"evnt_id":"e4","campaign_id":"c1","event_name":"e4_name","event_time":4000000,"type":"cmpgn1"} | {} |
> | 1 | {"evnt_id":"e5","campaign_id":"c2","event_name":"e5_name","event_time":5000000,"type":"cmpgn3"} | {} |
> | 1 | {"evnt_id":"e5","campaign_id":"c2","event_name":"e5_name","event_time":5000000,"type":"cmpgn3"} | {} |
> | 1 | {"evnt_id":"e6","campaign_id":"c1","event_name":"e6_name","event_time":6000000,"type":"cmpgn9"} | {} |
> | 1 | {"evnt_id":"e6","campaign_id":"c1","event_name":"e6_name","event_time":6000000,"type":"cmpgn9"} | {} |
> | 1 | {"evnt_id":"e7","campaign_id":"c1","event_name":"e7_name","event_time":7000000,"type":"cmpgn3"} | {} |
> | 1 | {"evnt_id":"e7","campaign_id":"c1","event_name":"e7_name","event_time":7000000,"type":"cmpgn3"} | {} |
> | 1 | {"evnt_id":"e8","campaign_id":"c2","event_name":"e8_name","event_time":8000000,"type":"cmpgn2"} | {} |
> | 1 | {"evnt_id":"e8","campaign_id":"c2","event_name":"e8_name","event_time":8000000,"type":"cmpgn2"} | {} |
> | 1 | {"evnt_id":"e9","campaign_id":"c2","event_name":"e9_name","event_time":9000000,"type":"cmpgn4"} | {} |
> | 1 | {"evnt_id":"e9","campaign_id":"c2","event_name":"e9_name","event_time":9000000,"type":"cmpgn4"} | {} |
> {code}
> If we interchange the sub-queries, drill returns an empty map for event
> {code}
> 0: jdbc:drill:schema=dfs.drillTestDir> select t1.uid, t2.event, t1.transaction from (select uid, flatten(transactions) transaction from `temp4.json`) t1 inner join (select uid, flatten(events) event from `temp4.json`) t2 on t1.uid = t2.uid;
> +------------+------------+-------------+
> | uid | event | transaction |
> +------------+------------+-------------+
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t1","amount":100,"trans_time":7777777,"type":"sports"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> | 1 | {} | {"trans_id":"t2","amount":1000,"trans_time":8888888,"type":"groceries"} |
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)