You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Dan Blondowski <da...@dhigroupinc.com> on 2015/09/30 23:45:56 UTC
Drill to S3 set up and core-site.xml
Hi.
Trying to set up drill to talk to S3 bucket. Following http://drill.apache.org/blog/2014/12/09/running-sql-queries-on-amazon-s3/.
I’ve noticed that in the Web UI I can’t update the storage configuration, if I have a core-site.xml file present in $DRILL_HOME/conf directory. As soon as I remove it the update works.
Any advice?
---------------------------------------------------------------------------------------
This email has been scanned for email related threats and delivered safely by Mimecast.
For more information please visit http://www.mimecast.com
---------------------------------------------------------------------------------------
Re: Drill to S3 set up and core-site.xml
Posted by Christopher Matta <cm...@mapr.com>.
I believe that’s referring to the Hadoop core-site.xml file, if that’s the
case then the documentation should be updated to specify it.
Chris Matta
cmatta@mapr.com
215-701-3146
On Wed, Sep 30, 2015 at 5:45 PM, Dan Blondowski <
dan.blondowski@dhigroupinc.com> wrote:
> Hi.
> Trying to set up drill to talk to S3 bucket. Following
> http://drill.apache.org/blog/2014/12/09/running-sql-queries-on-amazon-s3/.
>
> I’ve noticed that in the Web UI I can’t update the storage configuration,
> if I have a core-site.xml file present in $DRILL_HOME/conf directory. As
> soon as I remove it the update works.
>
> Any advice?
>
> ---------------------------------------------------------------------------------------
> This email has been scanned for email related threats and delivered
> safely by Mimecast.
> For more information please visit http://www.mimecast.com
>
> ---------------------------------------------------------------------------------------
>
Re: Drill to S3 set up and core-site.xml
Posted by Andries Engelbrecht <ae...@maprtech.com>.
Are you running in embedded mode?
I have tested on a single node cluster and not seen the issue with the Web UI not updating the SP. What is in your core-site.xml in the conf directory? I just put the AWS credentials in it vs the complete Hadoop core-site.xml file.
Also checked in embedded mode on OS X and it allows to update the SP with core-site.xml in the conf directory.
Also make sure to use s3n now as per the comments in the blog.
—Andries
> On Sep 30, 2015, at 2:45 PM, Dan Blondowski <da...@dhigroupinc.com> wrote:
>
> Hi.
> Trying to set up drill to talk to S3 bucket. Following http://drill.apache.org/blog/2014/12/09/running-sql-queries-on-amazon-s3/.
>
> I’ve noticed that in the Web UI I can’t update the storage configuration, if I have a core-site.xml file present in $DRILL_HOME/conf directory. As soon as I remove it the update works.
>
> Any advice?
> ---------------------------------------------------------------------------------------
> This email has been scanned for email related threats and delivered safely by Mimecast.
> For more information please visit http://www.mimecast.com
> ---------------------------------------------------------------------------------------