You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Alon Principal <al...@traiana.com> on 2017/04/15 22:42:11 UTC
querying S3 bucket root dir
Hi,
What's the right syntax to query an S3 bucket root directory with Drill?
For example, my bucket:
/a/file1.json
/b/file2.json
/c/file3.json
and I'd like to do something like that: Select * from s3.`root`; and that it'll return the contents of file1.json+file2.json+file3.json.
Thanks!
RE: querying S3 bucket root dir
Posted by Alon Principal <al...@traiana.com>.
https://issues.apache.org/jira/browse/DRILL-5438
-----Original Message-----
From: Kunal Khatua [mailto:kkhatua@mapr.com]
Sent: Monday, April 17, 2017 16:03
To: user@drill.apache.org
Subject: Re: querying S3 bucket root dir
You'll need to log into
https://issues.apache.org/jira/browse/
and click on red 'Create' button on the top to create an issue.
Mark the Project as "Apache Drill" and Issue type as "Bug"
________________________________
From: Alon Principal <al...@traiana.com>
Sent: Monday, April 17, 2017 12:08:46 PM
To: user@drill.apache.org
Subject: RE: querying S3 bucket root dir
Hey,
How can I file a JIRA request?
And I think I'd categorize it more as an issue than a request.
Not being able to query the bucket directly makes drill completely unusable in many situations.
-----Original Message-----
From: Abhishek Girish [mailto:agirish@apache.org]
Sent: Monday, April 17, 2017 11:55
To: user@drill.apache.org
Subject: Re: querying S3 bucket root dir
Hey Alok,
I'm not sure if that's possible with Object stores like S3. I'll let others comment. But you could file a JIRA requesting ability to query buckets directly.
-Abhishek
On Mon, Apr 17, 2017 at 7:10 AM Alon Principal <al...@traiana.com> wrote:
> Hi Abhishek,
>
> Do you think it is going to be solved in the next versions?
>
>
> -----Original Message-----
> From: Abhishek Girish [mailto:agirish@apache.org]
> Sent: Sunday, April 16, 2017 02:21
> To: user@drill.apache.org
> Subject: Re: querying S3 bucket root dir
>
> Looks like this might not be possible. I gave it a try and could only
> query files/folders within the bucket, but not the bucket itself directly.
>
> Also, I couldn't get workspaces to work (like with DFS). I had to
> provide the path to the object (relative to the bucket). We should document this.
>
>
> On Sat, Apr 15, 2017 at 3:42 PM Alon Principal <al...@traiana.com> wrote:
>
> > Hi,
> >
> > What's the right syntax to query an S3 bucket root directory with Drill?
> >
> > For example, my bucket:
> > /a/file1.json
> > /b/file2.json
> > /c/file3.json
> >
> > and I'd like to do something like that: Select * from s3.`root`; and
> > that it'll return the contents of file1.json+file2.json+file3.json.
> >
> > Thanks!
> >
> >
>
Re: querying S3 bucket root dir
Posted by Kunal Khatua <kk...@mapr.com>.
You'll need to log into
https://issues.apache.org/jira/browse/
and click on red 'Create' button on the top to create an issue.
Mark the Project as "Apache Drill" and Issue type as "Bug"
________________________________
From: Alon Principal <al...@traiana.com>
Sent: Monday, April 17, 2017 12:08:46 PM
To: user@drill.apache.org
Subject: RE: querying S3 bucket root dir
Hey,
How can I file a JIRA request?
And I think I'd categorize it more as an issue than a request.
Not being able to query the bucket directly makes drill completely unusable in many situations.
-----Original Message-----
From: Abhishek Girish [mailto:agirish@apache.org]
Sent: Monday, April 17, 2017 11:55
To: user@drill.apache.org
Subject: Re: querying S3 bucket root dir
Hey Alok,
I'm not sure if that's possible with Object stores like S3. I'll let others comment. But you could file a JIRA requesting ability to query buckets directly.
-Abhishek
On Mon, Apr 17, 2017 at 7:10 AM Alon Principal <al...@traiana.com> wrote:
> Hi Abhishek,
>
> Do you think it is going to be solved in the next versions?
>
>
> -----Original Message-----
> From: Abhishek Girish [mailto:agirish@apache.org]
> Sent: Sunday, April 16, 2017 02:21
> To: user@drill.apache.org
> Subject: Re: querying S3 bucket root dir
>
> Looks like this might not be possible. I gave it a try and could only
> query files/folders within the bucket, but not the bucket itself directly.
>
> Also, I couldn't get workspaces to work (like with DFS). I had to
> provide the path to the object (relative to the bucket). We should document this.
>
>
> On Sat, Apr 15, 2017 at 3:42 PM Alon Principal <al...@traiana.com> wrote:
>
> > Hi,
> >
> > What's the right syntax to query an S3 bucket root directory with Drill?
> >
> > For example, my bucket:
> > /a/file1.json
> > /b/file2.json
> > /c/file3.json
> >
> > and I'd like to do something like that: Select * from s3.`root`; and
> > that it'll return the contents of file1.json+file2.json+file3.json.
> >
> > Thanks!
> >
> >
>
RE: querying S3 bucket root dir
Posted by Alon Principal <al...@traiana.com>.
Hey,
How can I file a JIRA request?
And I think I'd categorize it more as an issue than a request.
Not being able to query the bucket directly makes drill completely unusable in many situations.
-----Original Message-----
From: Abhishek Girish [mailto:agirish@apache.org]
Sent: Monday, April 17, 2017 11:55
To: user@drill.apache.org
Subject: Re: querying S3 bucket root dir
Hey Alok,
I'm not sure if that's possible with Object stores like S3. I'll let others comment. But you could file a JIRA requesting ability to query buckets directly.
-Abhishek
On Mon, Apr 17, 2017 at 7:10 AM Alon Principal <al...@traiana.com> wrote:
> Hi Abhishek,
>
> Do you think it is going to be solved in the next versions?
>
>
> -----Original Message-----
> From: Abhishek Girish [mailto:agirish@apache.org]
> Sent: Sunday, April 16, 2017 02:21
> To: user@drill.apache.org
> Subject: Re: querying S3 bucket root dir
>
> Looks like this might not be possible. I gave it a try and could only
> query files/folders within the bucket, but not the bucket itself directly.
>
> Also, I couldn't get workspaces to work (like with DFS). I had to
> provide the path to the object (relative to the bucket). We should document this.
>
>
> On Sat, Apr 15, 2017 at 3:42 PM Alon Principal <al...@traiana.com> wrote:
>
> > Hi,
> >
> > What's the right syntax to query an S3 bucket root directory with Drill?
> >
> > For example, my bucket:
> > /a/file1.json
> > /b/file2.json
> > /c/file3.json
> >
> > and I'd like to do something like that: Select * from s3.`root`; and
> > that it'll return the contents of file1.json+file2.json+file3.json.
> >
> > Thanks!
> >
> >
>
Re: querying S3 bucket root dir
Posted by Abhishek Girish <ag...@apache.org>.
Hey Alok,
I'm not sure if that's possible with Object stores like S3. I'll let others
comment. But you could file a JIRA requesting ability to query buckets
directly.
-Abhishek
On Mon, Apr 17, 2017 at 7:10 AM Alon Principal <al...@traiana.com> wrote:
> Hi Abhishek,
>
> Do you think it is going to be solved in the next versions?
>
>
> -----Original Message-----
> From: Abhishek Girish [mailto:agirish@apache.org]
> Sent: Sunday, April 16, 2017 02:21
> To: user@drill.apache.org
> Subject: Re: querying S3 bucket root dir
>
> Looks like this might not be possible. I gave it a try and could only
> query files/folders within the bucket, but not the bucket itself directly.
>
> Also, I couldn't get workspaces to work (like with DFS). I had to provide
> the path to the object (relative to the bucket). We should document this.
>
>
> On Sat, Apr 15, 2017 at 3:42 PM Alon Principal <al...@traiana.com> wrote:
>
> > Hi,
> >
> > What's the right syntax to query an S3 bucket root directory with Drill?
> >
> > For example, my bucket:
> > /a/file1.json
> > /b/file2.json
> > /c/file3.json
> >
> > and I'd like to do something like that: Select * from s3.`root`; and
> > that it'll return the contents of file1.json+file2.json+file3.json.
> >
> > Thanks!
> >
> >
>
RE: querying S3 bucket root dir
Posted by Alon Principal <al...@traiana.com>.
Hi Abhishek,
Do you think it is going to be solved in the next versions?
-----Original Message-----
From: Abhishek Girish [mailto:agirish@apache.org]
Sent: Sunday, April 16, 2017 02:21
To: user@drill.apache.org
Subject: Re: querying S3 bucket root dir
Looks like this might not be possible. I gave it a try and could only query files/folders within the bucket, but not the bucket itself directly.
Also, I couldn't get workspaces to work (like with DFS). I had to provide the path to the object (relative to the bucket). We should document this.
On Sat, Apr 15, 2017 at 3:42 PM Alon Principal <al...@traiana.com> wrote:
> Hi,
>
> What's the right syntax to query an S3 bucket root directory with Drill?
>
> For example, my bucket:
> /a/file1.json
> /b/file2.json
> /c/file3.json
>
> and I'd like to do something like that: Select * from s3.`root`; and
> that it'll return the contents of file1.json+file2.json+file3.json.
>
> Thanks!
>
>
Re: querying S3 bucket root dir
Posted by Abhishek Girish <ag...@apache.org>.
Looks like this might not be possible. I gave it a try and could only query
files/folders within the bucket, but not the bucket itself directly.
Also, I couldn't get workspaces to work (like with DFS). I had to provide
the path to the object (relative to the bucket). We should document this.
On Sat, Apr 15, 2017 at 3:42 PM Alon Principal <al...@traiana.com> wrote:
> Hi,
>
> What's the right syntax to query an S3 bucket root directory with Drill?
>
> For example, my bucket:
> /a/file1.json
> /b/file2.json
> /c/file3.json
>
> and I'd like to do something like that: Select * from s3.`root`; and that
> it'll return the contents of file1.json+file2.json+file3.json.
>
> Thanks!
>
>