You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@drill.apache.org by Michael Spector <sp...@gmail.com> on 2015/10/18 07:28:29 UTC

How to query a whole S3 directory in Apache Drill?

Hello,

I'm trying to query a whole directory in S3 containing parquet files.

The query hangs for a while, then returns an error:0:

jdbc:drill:zk=local> select * from s3.`/data/dt=2015-10-15` limit 10;
Error: CONNECTION ERROR: Connection /13.14.15.254:54549 <--> /
13.14.15.254:31010 (user client) closed unexpectedly.

I can see my data folder when running these commands:

USE s3.`root`;
SHOW FILES;


Thanks!

Re: How to query a whole S3 directory in Apache Drill?

Posted by Jacques Nadeau <ja...@dremio.com>.

Can you enable verbose error messages and then rerun the query and give us
the complete output?

ALTER SESSION SET `exec.errors.verbose` = true

thanks,
Jacques


--
Jacques Nadeau
CTO and Co-Founder, Dremio

On Sat, Oct 17, 2015 at 10:28 PM, Michael Spector <sp...@gmail.com> wrote:

> Hello,
>
> I'm trying to query a whole directory in S3 containing parquet files.
>
> The query hangs for a while, then returns an error:0:
>
> jdbc:drill:zk=local> select * from s3.`/data/dt=2015-10-15` limit 10;
> Error: CONNECTION ERROR: Connection /13.14.15.254:54549 <--> /
> 13.14.15.254:31010 (user client) closed unexpectedly.
>
> I can see my data folder when running these commands:
>
> USE s3.`root`;
> SHOW FILES;
>
>
> Thanks!
>