You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Bruce Turing <br...@gmail.com> on 2016/05/14 20:25:12 UTC
Very slow download rate from S3 while query
Hi,
I am trying to run some basic query S3 (*select count(*) from `/*.json.gz`*
),
the query is very very slow (more then an hour),
I tried to understand it, so I copy the whole S3 to my local env,
this copy took something like 2~3 minutes, then doing the same query
locally - very very fast.
So it's totally very poor download rate while querying and not something
else.
Can you please advice.
Env:
drill-embedded
Apache Drill 1.6
S3
Size: Few Gigs
File type: json.gz
Best Regards!