You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@druid.apache.org by Atul Mohan <at...@gmail.com> on 2019/02/11 22:15:22 UTC
Segment files for ITTwitterQueryTest and ITWikipediaQueryTest
Hi,
Presently the druid integration tests: ITTwitterQueryTest and
ITWikipediaQueryTest looks like it is using pre-ingested segments for
datasources *twitterstream* and *wikipedia_editstream* respectively. Is
there a way to access these segment files? I tried accessing it from S3
using the demo account credentials, but it gave me an AllAccessDisabled
exception.
Thanks
--
Atul Mohan
<at...@gmail.com>
Re: Segment files for ITTwitterQueryTest and ITWikipediaQueryTest
Posted by Atul Mohan <at...@gmail.com>.
Oh there it is :-)
Thanks Gian
On Mon, Feb 11, 2019 at 4:37 PM Gian Merlino <gi...@apache.org> wrote:
> Ah. I think they have Get but not List permissions. So you can retrieve
> objects but you need to know what their paths are first. Check out the file
> "integration-tests/docker/sample-data.sql" for the paths that the ITs use.
>
> On Mon, Feb 11, 2019 at 2:33 PM Atul Mohan <at...@gmail.com>
> wrote:
>
> > The keys are valid but the account does not seem to have the required
> > access. Attempting to access /shared/storage with this account gives the
> > error:
> > *An error occurred (AllAccessDisabled) when calling the ListObjectsV2
> > operation: All access to this object has been disabled*
> >
> > Atul
> >
> > On Mon, Feb 11, 2019 at 4:25 PM Gian Merlino <gi...@apache.org> wrote:
> >
> > > The keys should be in the repo. I think the ones in
> > > "integration-tests/docker/historical.conf" will work.
> > >
> > > On Mon, Feb 11, 2019 at 2:19 PM Jihoon Son <gh...@gmail.com> wrote:
> > >
> > > > Good question. I has been always curious about this too.
> > > > Does anyone know about it?
> > > >
> > > > Jihoon
> > > >
> > > > On Mon, Feb 11, 2019 at 2:15 PM Atul Mohan <at...@gmail.com>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > > Presently the druid integration tests: ITTwitterQueryTest and
> > > > > ITWikipediaQueryTest looks like it is using pre-ingested segments
> for
> > > > > datasources *twitterstream* and *wikipedia_editstream*
> respectively.
> > Is
> > > > > there a way to access these segment files? I tried accessing it
> from
> > S3
> > > > > using the demo account credentials, but it gave me an
> > AllAccessDisabled
> > > > > exception.
> > > > >
> > > > > Thanks
> > > > > --
> > > > > Atul Mohan
> > > > > <at...@gmail.com>
> > > > >
> > > >
> > >
> >
> >
> > --
> > Atul Mohan
> > <at...@gmail.com>
> >
>
--
Atul Mohan
<at...@gmail.com>
Re: Segment files for ITTwitterQueryTest and ITWikipediaQueryTest
Posted by Gian Merlino <gi...@apache.org>.
Ah. I think they have Get but not List permissions. So you can retrieve
objects but you need to know what their paths are first. Check out the file
"integration-tests/docker/sample-data.sql" for the paths that the ITs use.
On Mon, Feb 11, 2019 at 2:33 PM Atul Mohan <at...@gmail.com> wrote:
> The keys are valid but the account does not seem to have the required
> access. Attempting to access /shared/storage with this account gives the
> error:
> *An error occurred (AllAccessDisabled) when calling the ListObjectsV2
> operation: All access to this object has been disabled*
>
> Atul
>
> On Mon, Feb 11, 2019 at 4:25 PM Gian Merlino <gi...@apache.org> wrote:
>
> > The keys should be in the repo. I think the ones in
> > "integration-tests/docker/historical.conf" will work.
> >
> > On Mon, Feb 11, 2019 at 2:19 PM Jihoon Son <gh...@gmail.com> wrote:
> >
> > > Good question. I has been always curious about this too.
> > > Does anyone know about it?
> > >
> > > Jihoon
> > >
> > > On Mon, Feb 11, 2019 at 2:15 PM Atul Mohan <at...@gmail.com>
> > > wrote:
> > >
> > > > Hi,
> > > > Presently the druid integration tests: ITTwitterQueryTest and
> > > > ITWikipediaQueryTest looks like it is using pre-ingested segments for
> > > > datasources *twitterstream* and *wikipedia_editstream* respectively.
> Is
> > > > there a way to access these segment files? I tried accessing it from
> S3
> > > > using the demo account credentials, but it gave me an
> AllAccessDisabled
> > > > exception.
> > > >
> > > > Thanks
> > > > --
> > > > Atul Mohan
> > > > <at...@gmail.com>
> > > >
> > >
> >
>
>
> --
> Atul Mohan
> <at...@gmail.com>
>
Re: Segment files for ITTwitterQueryTest and ITWikipediaQueryTest
Posted by Atul Mohan <at...@gmail.com>.
The keys are valid but the account does not seem to have the required
access. Attempting to access /shared/storage with this account gives the
error:
*An error occurred (AllAccessDisabled) when calling the ListObjectsV2
operation: All access to this object has been disabled*
Atul
On Mon, Feb 11, 2019 at 4:25 PM Gian Merlino <gi...@apache.org> wrote:
> The keys should be in the repo. I think the ones in
> "integration-tests/docker/historical.conf" will work.
>
> On Mon, Feb 11, 2019 at 2:19 PM Jihoon Son <gh...@gmail.com> wrote:
>
> > Good question. I has been always curious about this too.
> > Does anyone know about it?
> >
> > Jihoon
> >
> > On Mon, Feb 11, 2019 at 2:15 PM Atul Mohan <at...@gmail.com>
> > wrote:
> >
> > > Hi,
> > > Presently the druid integration tests: ITTwitterQueryTest and
> > > ITWikipediaQueryTest looks like it is using pre-ingested segments for
> > > datasources *twitterstream* and *wikipedia_editstream* respectively. Is
> > > there a way to access these segment files? I tried accessing it from S3
> > > using the demo account credentials, but it gave me an AllAccessDisabled
> > > exception.
> > >
> > > Thanks
> > > --
> > > Atul Mohan
> > > <at...@gmail.com>
> > >
> >
>
--
Atul Mohan
<at...@gmail.com>
Re: Segment files for ITTwitterQueryTest and ITWikipediaQueryTest
Posted by Gian Merlino <gi...@apache.org>.
The keys should be in the repo. I think the ones in
"integration-tests/docker/historical.conf" will work.
On Mon, Feb 11, 2019 at 2:19 PM Jihoon Son <gh...@gmail.com> wrote:
> Good question. I has been always curious about this too.
> Does anyone know about it?
>
> Jihoon
>
> On Mon, Feb 11, 2019 at 2:15 PM Atul Mohan <at...@gmail.com>
> wrote:
>
> > Hi,
> > Presently the druid integration tests: ITTwitterQueryTest and
> > ITWikipediaQueryTest looks like it is using pre-ingested segments for
> > datasources *twitterstream* and *wikipedia_editstream* respectively. Is
> > there a way to access these segment files? I tried accessing it from S3
> > using the demo account credentials, but it gave me an AllAccessDisabled
> > exception.
> >
> > Thanks
> > --
> > Atul Mohan
> > <at...@gmail.com>
> >
>
Re: Segment files for ITTwitterQueryTest and ITWikipediaQueryTest
Posted by Jihoon Son <gh...@gmail.com>.
Good question. I has been always curious about this too.
Does anyone know about it?
Jihoon
On Mon, Feb 11, 2019 at 2:15 PM Atul Mohan <at...@gmail.com> wrote:
> Hi,
> Presently the druid integration tests: ITTwitterQueryTest and
> ITWikipediaQueryTest looks like it is using pre-ingested segments for
> datasources *twitterstream* and *wikipedia_editstream* respectively. Is
> there a way to access these segment files? I tried accessing it from S3
> using the demo account credentials, but it gave me an AllAccessDisabled
> exception.
>
> Thanks
> --
> Atul Mohan
> <at...@gmail.com>
>