You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Jacques Nadeau <ja...@dremio.com> on 2015/10/28 22:47:47 UTC
Drill Test Framework - Data Generation does not work for Advanced/Tpch
When I try to run the extended test framework tests in the tpch folder
(with -d):
Advanced/tpch/tpch_sf100/parquet
I get a message:
Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to either
root schema or current default schema.
Where is this data?
--
Jacques Nadeau
CTO and Co-Founder, Dremio
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by Ramana I N <in...@gmail.com>.
@Jacques,
I doubt these were ever checked in.
And I dont think they were using the s3 method to download as well.
Regards
Ramana
On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> When I try to run the extended test framework tests in the tpch folder
> (with -d):
>
> Advanced/tpch/tpch_sf100/parquet
>
> I get a message:
>
> Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to either
> root schema or current default schema.
>
> Where is this data?
>
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by Chun Chang <cc...@maprtech.com>.
We should make it gzipped. I will follow up on this.
On Sun, Nov 1, 2015 at 2:28 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> For everyone else's reference, the files are named .tgz but they are not
> gzipped.
>
> They are only tarred...
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Sun, Nov 1, 2015 at 11:47 AM, Jacques Nadeau <ja...@dremio.com>
> wrote:
>
> > nevermind.
> >
> > Confusing that it is hidden in a subdirectory. For others, this is the
> > location of this information:
> >
> >
> >
> https://github.com/mapr/drill-test-framework/tree/master/framework/resources/Advanced
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Sun, Nov 1, 2015 at 11:46 AM, Jacques Nadeau <ja...@dremio.com>
> > wrote:
> >
> >> It looks like there is an addition for tpcds but not tpch. Can you
> upload
> >> the tpch data as well?
> >>
> >> --
> >> Jacques Nadeau
> >> CTO and Co-Founder, Dremio
> >>
> >> On Sat, Oct 31, 2015 at 6:57 PM, <cc...@maprtech.com> wrote:
> >>
> >>> Jacques,
> >>>
> >>> I believe the data is on S3 now and Ahbishek provided the link in
> >>> README. He might forgot to send out email. Pull the latest framework. I
> >>> think it's there.
> >>>
> >>> Regards,
> >>>
> >>> Chun
> >>>
> >>> > On Oct 31, 2015, at 5:40 PM, Jacques Nadeau <ja...@dremio.com>
> >>> wrote:
> >>> >
> >>> > Ping, just checking in on this. :)
> >>> >
> >>> >
> >>> >
> >>> > --
> >>> > Jacques Nadeau
> >>> > CTO and Co-Founder, Dremio
> >>> >
> >>> > On Wed, Oct 28, 2015 at 3:23 PM, Abhishek Girish <
> >>> abhishek.girish@gmail.com>
> >>> > wrote:
> >>> >
> >>> >> Data is in a Amazon S3 bucket. I'll create links for all Advanced
> >>> suites
> >>> >> datasets and share them shortly. Will also add a note to README.
> >>> >>
> >>> >> On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <jacques@dremio.com
> >
> >>> >> wrote:
> >>> >>
> >>> >>> When I try to run the extended test framework tests in the tpch
> >>> folder
> >>> >>> (with -d):
> >>> >>>
> >>> >>> Advanced/tpch/tpch_sf100/parquet
> >>> >>>
> >>> >>> I get a message:
> >>> >>>
> >>> >>> Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect
> to
> >>> >> either
> >>> >>> root schema or current default schema.
> >>> >>>
> >>> >>> Where is this data?
> >>> >>>
> >>> >>>
> >>> >>> --
> >>> >>> Jacques Nadeau
> >>> >>> CTO and Co-Founder, Dremio
> >>> >>>
> >>> >>
> >>>
> >>
> >>
> >
>
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by Jacques Nadeau <ja...@dremio.com>.
For everyone else's reference, the files are named .tgz but they are not
gzipped.
They are only tarred...
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Sun, Nov 1, 2015 at 11:47 AM, Jacques Nadeau <ja...@dremio.com> wrote:
> nevermind.
>
> Confusing that it is hidden in a subdirectory. For others, this is the
> location of this information:
>
>
> https://github.com/mapr/drill-test-framework/tree/master/framework/resources/Advanced
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Sun, Nov 1, 2015 at 11:46 AM, Jacques Nadeau <ja...@dremio.com>
> wrote:
>
>> It looks like there is an addition for tpcds but not tpch. Can you upload
>> the tpch data as well?
>>
>> --
>> Jacques Nadeau
>> CTO and Co-Founder, Dremio
>>
>> On Sat, Oct 31, 2015 at 6:57 PM, <cc...@maprtech.com> wrote:
>>
>>> Jacques,
>>>
>>> I believe the data is on S3 now and Ahbishek provided the link in
>>> README. He might forgot to send out email. Pull the latest framework. I
>>> think it's there.
>>>
>>> Regards,
>>>
>>> Chun
>>>
>>> > On Oct 31, 2015, at 5:40 PM, Jacques Nadeau <ja...@dremio.com>
>>> wrote:
>>> >
>>> > Ping, just checking in on this. :)
>>> >
>>> >
>>> >
>>> > --
>>> > Jacques Nadeau
>>> > CTO and Co-Founder, Dremio
>>> >
>>> > On Wed, Oct 28, 2015 at 3:23 PM, Abhishek Girish <
>>> abhishek.girish@gmail.com>
>>> > wrote:
>>> >
>>> >> Data is in a Amazon S3 bucket. I'll create links for all Advanced
>>> suites
>>> >> datasets and share them shortly. Will also add a note to README.
>>> >>
>>> >> On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <ja...@dremio.com>
>>> >> wrote:
>>> >>
>>> >>> When I try to run the extended test framework tests in the tpch
>>> folder
>>> >>> (with -d):
>>> >>>
>>> >>> Advanced/tpch/tpch_sf100/parquet
>>> >>>
>>> >>> I get a message:
>>> >>>
>>> >>> Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to
>>> >> either
>>> >>> root schema or current default schema.
>>> >>>
>>> >>> Where is this data?
>>> >>>
>>> >>>
>>> >>> --
>>> >>> Jacques Nadeau
>>> >>> CTO and Co-Founder, Dremio
>>> >>>
>>> >>
>>>
>>
>>
>
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by Jacques Nadeau <ja...@dremio.com>.
nevermind.
Confusing that it is hidden in a subdirectory. For others, this is the
location of this information:
https://github.com/mapr/drill-test-framework/tree/master/framework/resources/Advanced
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Sun, Nov 1, 2015 at 11:46 AM, Jacques Nadeau <ja...@dremio.com> wrote:
> It looks like there is an addition for tpcds but not tpch. Can you upload
> the tpch data as well?
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Sat, Oct 31, 2015 at 6:57 PM, <cc...@maprtech.com> wrote:
>
>> Jacques,
>>
>> I believe the data is on S3 now and Ahbishek provided the link in README.
>> He might forgot to send out email. Pull the latest framework. I think it's
>> there.
>>
>> Regards,
>>
>> Chun
>>
>> > On Oct 31, 2015, at 5:40 PM, Jacques Nadeau <ja...@dremio.com> wrote:
>> >
>> > Ping, just checking in on this. :)
>> >
>> >
>> >
>> > --
>> > Jacques Nadeau
>> > CTO and Co-Founder, Dremio
>> >
>> > On Wed, Oct 28, 2015 at 3:23 PM, Abhishek Girish <
>> abhishek.girish@gmail.com>
>> > wrote:
>> >
>> >> Data is in a Amazon S3 bucket. I'll create links for all Advanced
>> suites
>> >> datasets and share them shortly. Will also add a note to README.
>> >>
>> >> On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <ja...@dremio.com>
>> >> wrote:
>> >>
>> >>> When I try to run the extended test framework tests in the tpch folder
>> >>> (with -d):
>> >>>
>> >>> Advanced/tpch/tpch_sf100/parquet
>> >>>
>> >>> I get a message:
>> >>>
>> >>> Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to
>> >> either
>> >>> root schema or current default schema.
>> >>>
>> >>> Where is this data?
>> >>>
>> >>>
>> >>> --
>> >>> Jacques Nadeau
>> >>> CTO and Co-Founder, Dremio
>> >>>
>> >>
>>
>
>
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by Jacques Nadeau <ja...@dremio.com>.
It looks like there is an addition for tpcds but not tpch. Can you upload
the tpch data as well?
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Sat, Oct 31, 2015 at 6:57 PM, <cc...@maprtech.com> wrote:
> Jacques,
>
> I believe the data is on S3 now and Ahbishek provided the link in README.
> He might forgot to send out email. Pull the latest framework. I think it's
> there.
>
> Regards,
>
> Chun
>
> > On Oct 31, 2015, at 5:40 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> >
> > Ping, just checking in on this. :)
> >
> >
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
> > On Wed, Oct 28, 2015 at 3:23 PM, Abhishek Girish <
> abhishek.girish@gmail.com>
> > wrote:
> >
> >> Data is in a Amazon S3 bucket. I'll create links for all Advanced suites
> >> datasets and share them shortly. Will also add a note to README.
> >>
> >> On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <ja...@dremio.com>
> >> wrote:
> >>
> >>> When I try to run the extended test framework tests in the tpch folder
> >>> (with -d):
> >>>
> >>> Advanced/tpch/tpch_sf100/parquet
> >>>
> >>> I get a message:
> >>>
> >>> Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to
> >> either
> >>> root schema or current default schema.
> >>>
> >>> Where is this data?
> >>>
> >>>
> >>> --
> >>> Jacques Nadeau
> >>> CTO and Co-Founder, Dremio
> >>>
> >>
>
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by cc...@maprtech.com.
Jacques,
I believe the data is on S3 now and Ahbishek provided the link in README. He might forgot to send out email. Pull the latest framework. I think it's there.
Regards,
Chun
> On Oct 31, 2015, at 5:40 PM, Jacques Nadeau <ja...@dremio.com> wrote:
>
> Ping, just checking in on this. :)
>
>
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Wed, Oct 28, 2015 at 3:23 PM, Abhishek Girish <ab...@gmail.com>
> wrote:
>
>> Data is in a Amazon S3 bucket. I'll create links for all Advanced suites
>> datasets and share them shortly. Will also add a note to README.
>>
>> On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <ja...@dremio.com>
>> wrote:
>>
>>> When I try to run the extended test framework tests in the tpch folder
>>> (with -d):
>>>
>>> Advanced/tpch/tpch_sf100/parquet
>>>
>>> I get a message:
>>>
>>> Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to
>> either
>>> root schema or current default schema.
>>>
>>> Where is this data?
>>>
>>>
>>> --
>>> Jacques Nadeau
>>> CTO and Co-Founder, Dremio
>>>
>>
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by Jacques Nadeau <ja...@dremio.com>.
Ping, just checking in on this. :)
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Wed, Oct 28, 2015 at 3:23 PM, Abhishek Girish <ab...@gmail.com>
wrote:
> Data is in a Amazon S3 bucket. I'll create links for all Advanced suites
> datasets and share them shortly. Will also add a note to README.
>
> On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <ja...@dremio.com>
> wrote:
>
> > When I try to run the extended test framework tests in the tpch folder
> > (with -d):
> >
> > Advanced/tpch/tpch_sf100/parquet
> >
> > I get a message:
> >
> > Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to
> either
> > root schema or current default schema.
> >
> > Where is this data?
> >
> >
> > --
> > Jacques Nadeau
> > CTO and Co-Founder, Dremio
> >
>
Re: Drill Test Framework - Data Generation does not work for Advanced/Tpch
Posted by Abhishek Girish <ab...@gmail.com>.
Data is in a Amazon S3 bucket. I'll create links for all Advanced suites
datasets and share them shortly. Will also add a note to README.
On Wed, Oct 28, 2015 at 2:47 PM, Jacques Nadeau <ja...@dremio.com> wrote:
> When I try to run the extended test framework tests in the tpch folder
> (with -d):
>
> Advanced/tpch/tpch_sf100/parquet
>
> I get a message:
>
> Schema [dfs.drillTestDirTpch100Parquet] is not valid with respect to either
> root schema or current default schema.
>
> Where is this data?
>
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>