You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Bruce Turing <br...@gmail.com> on 2016/05/14 20:25:12 UTC

Very slow download rate from S3 while query

Hi,

I am trying to run some basic query S3 (*select count(*) from `/*.json.gz`*
),
the query is very very slow (more then an hour),
I tried to understand it, so I copy the whole S3 to my local env,
this copy took something like 2~3 minutes, then doing the same query
locally - very very fast.
So it's totally very poor download rate while querying and not something
else.

Can you please advice.

Env:

drill-embedded
Apache Drill 1.6
S3
Size: Few Gigs
File type: json.gz

Best Regards!