You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Aman Sinha (JIRA)" <ji...@apache.org> on 2015/04/08 22:03:13 UTC

[jira] [Updated] (DRILL-2722) Query profile data not being sent/received (and web UI not updated)

     [ https://issues.apache.org/jira/browse/DRILL-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aman Sinha updated DRILL-2722:
------------------------------
    Attachment: query1_foreman.log

The query I ran is a 3 table join on a large 30TB TPC-DS data: 
 {code}
 0: jdbc:drill:schema=dfs.tpcds> select count(*) from store_sales_dri30000 ss, item_dri30000 i, store_returns_dri30000 sr  where ss.ss_item_sk = i.i_item_sk and sr.sr_item_sk = i.i_item_sk;
 {code}

Attached is the last portion of the drillbit log on the foreman node.  Note that the profile updates were being received by the QueryManager on the foreman node until 07:59 am.  After that no more updates were received but the query was still running until I canceled.  There were no exceptions or failures in the logs on all the nodes.   I also have the jstack dump for all the DrillBit processes in case needed.  

> Query profile data not being sent/received (and web UI not updated)
> -------------------------------------------------------------------
>
>                 Key: DRILL-2722
>                 URL: https://issues.apache.org/jira/browse/DRILL-2722
>             Project: Apache Drill
>          Issue Type: Bug
>          Components: Client - HTTP, Execution - Flow, Execution - RPC
>    Affects Versions: 0.8.0
>            Reporter: Chris Westin
>            Assignee: Sudheesh Katkam
>             Fix For: 0.9.0
>
>         Attachments: query1_foreman.log
>
>
> [~amansinha100] has a test case that shows that profile information is not being received (or not being sent, I'm not sure which) for a long-running query. The query appears to stop, even though cycles are being used, and it looks like work is being done. This is becoming a problem for monitoring query progress. We need to find out why the profile information isn't being updated, and fix that.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)