You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by François Méthot <fm...@gmail.com> on 2016/04/04 19:41:43 UTC

CTAS query stuck

Hi,

Using Drill 1.5, 13 nodes (6 cores each, Max Dir. Mem: 32GB, Max Heap 8 GB).

  Sometime our CTAS queries gets "stuck". It runs for few hours or days and
in the Fragment profiles graph, we see that the query is waiting on a
single fragment ( for what appears to be a  single horizontal line in the
graph ). When this happens, if we hit CTL-C on the console that initiated
the query, everything returns normally and the expected table is created
and valid.

Once when the query seemed stuck after 1 day, we let it go, and after 5
days it returned.

We see this behavior with a query returning 0, 1 or millions of row.

There was a post on this last year, I I can't find how or if the issue was
resolved:
http://mail-archives.apache.org/mod_mbox/drill-user/201505.mbox/%3CAC7542F0-DE0F-42E4-9858-0A1F0983BFEC@maprtech.com%3E


Francois

Re: CTAS query stuck

Posted by François Méthot <fm...@gmail.com>.

We restarted our Drill Cluster and the problem disappeared.

Our queries so far complete successfully without getting stuck.

Francois




On Mon, Apr 4, 2016 at 1:41 PM, François Méthot <fm...@gmail.com> wrote:

> Hi,
>
> Using Drill 1.5, 13 nodes (6 cores each, Max Dir. Mem: 32GB, Max Heap 8
> GB).
>
>   Sometime our CTAS queries gets "stuck". It runs for few hours or days
> and in the Fragment profiles graph, we see that the query is waiting on a
> single fragment ( for what appears to be a  single horizontal line in the
> graph ). When this happens, if we hit CTL-C on the console that initiated
> the query, everything returns normally and the expected table is created
> and valid.
>
> Once when the query seemed stuck after 1 day, we let it go, and after 5
> days it returned.
>
> We see this behavior with a query returning 0, 1 or millions of row.
>
> There was a post on this last year, I I can't find how or if the issue was
> resolved:
>
> http://mail-archives.apache.org/mod_mbox/drill-user/201505.mbox/%3CAC7542F0-DE0F-42E4-9858-0A1F0983BFEC@maprtech.com%3E
>
>
> Francois
>
>
>
>
>
>