You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Chun Chang (JIRA)" <ji...@apache.org> on 2014/10/16 23:18:34 UTC
[jira] [Commented] (DRILL-1435) sqlline hangs when query a text
file with limit
[ https://issues.apache.org/jira/browse/DRILL-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174260#comment-14174260 ]
Chun Chang commented on DRILL-1435:
-----------------------------------
Ok, this could be performance related. For json type, the first line was returned immediately, but the query did not return until after about 5 min:
0: jdbc:drill:schema=dfs.drillTestDir> select * from `tpcds/json/s1/store_sales` limit 1;
...
1 row selected (299.972 seconds)
For parquet, it took about 30 seconds:
0: jdbc:drill:schema=dfs.drillTestDir> select * from `tpcds/parquet/s1/store_sales` limit 1;
...
1 row selected (31.562 seconds)
Because the first row was returned immediately, it creates an perception that sqlline was hanging.
> sqlline hangs when query a text file with limit
> -----------------------------------------------
>
> Key: DRILL-1435
> URL: https://issues.apache.org/jira/browse/DRILL-1435
> Project: Apache Drill
> Issue Type: Bug
> Components: Functions - Drill
> Affects Versions: 0.6.0
> Reporter: Chun Chang
> Assignee: Parth Chandra
> Priority: Critical
> Fix For: 0.7.0
>
>
> code base
> #Fri Sep 12 14:08:02 PDT 2014
> git.commit.id.abbrev=9e16466
> When I query a psv file with limit, sqlline frequently hangs. It sometimes comes back after a while but most of the time, it just hangs. When it hangs, I saw the InterruptedException in drill bit.log.
> 11:43:23.238 [ce3297e2-8238-4f05-968f-e96550d23b10:frag:0:0 - Producer Thread] ERROR o.a.drill.exec.ops.FragmentContext - Fragment Context received failure.
> java.lang.InterruptedException: null
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017) ~[na:1.7.0_45]
> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052) ~[na:1.7.0_45]
> at java.util.concurrent.LinkedBlockingDeque.putLast(LinkedBlockingDeque.java:393) ~[na:1.7.0_45]
> at java.util.concurrent.LinkedBlockingDeque.put(LinkedBlockingDeque.java:647) ~[na:1.7.0_45]
> at org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:140) ~[drill-java-exec-0.6.0-incubating-SNAPSHOT-rebuffed.jar:0.6.0-incubating-SNAPSHOT]
> at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45]
> sqlline just hangs:
> 0: jdbc:drill:schema=dfs> select * from `tpcds/p1/store_sales.parquet` limit 1;
> +-----------------+-----------------+------------+----------------+-------------+-------------+------------+-------------+-------------+------------------+-------------+-------------------+---------------+----------------+---------------------+--------------------+-----------------------+-------------------+------------+---------------+-------------+---------------------+---------------+
> | ss_sold_date_sk | ss_sold_time_sk | ss_item_sk | ss_customer_sk | ss_cdemo_sk | ss_hdemo_sk | ss_addr_sk | ss_store_sk | ss_promo_sk | ss_ticket_number | ss_quantity | ss_wholesale_cost | ss_list_price | ss_sales_price | ss_ext_discount_amt | ss_ext_sales_price | ss_ext_wholesale_cost | ss_ext_list_price | ss_ext_tax | ss_coupon_amt | ss_net_paid | ss_net_paid_inc_tax | ss_net_profit |
> +-----------------+-----------------+------------+----------------+-------------+-------------+------------+-------------+-------------+------------------+-------------+-------------------+---------------+----------------+---------------------+--------------------+-----------------------+-------------------+------------+---------------+-------------+---------------------+---------------+
> | 2452603 | 71996 | 2739 | 59832 | 1659109 | 4339 | 13616 | 2 | 180 | 167289 | 60 | 80.79 | 147.03 | 89.68 | 2206.12 | 5380.8 | 4847.4 | 8821.8 | 222.22 | 2206.12 | 3174.68 | 3396.9 | -1672.72 |
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)