You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Rahul Raj <ra...@option3consulting.com> on 2016/12/12 14:08:53 UTC
Implicit file columns
From Drill 1.7, a select star query returns some implicit file columns(like
FQN,fileName,filePath,suffix). I could not find a documentation related to
this. This feature has been added with the commit
https://github.com/apache/drill/pull/491.
Can someone explain why it is required? Is there any ways to disable it?
Rahul
--
**** This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom it is
addressed. If you are not the named addressee then you should not
disseminate, distribute or copy this e-mail. Please notify the sender
immediately and delete this e-mail from your system.****
Re: Implicit file columns
Posted by Arina Yelchiyeva <ar...@gmail.com>.
If you disable jdbc plugin, they won't appear.
Unfortunately when jdbc plugin is enabled, new rule is
added ProjectRemoveRules.class.
This rule removes Project stage but for implicit columns it's crucial as
Project is responsible for making them implicit.
Kind regards
Arina
On Mon, Dec 12, 2016 at 4:43 PM, Rahul Raj <ra...@option3consulting.com>
wrote:
> Hi Arina,
>
> Yes, we do have a jdbc plugin enabled. The extra fields appear on CSVs,
> parquets created from CSV files etc and not just limited to files queries
> through the jdbc plugin.
>
> Regards,
> Rahul
>
> On Mon, Dec 12, 2016 at 7:58 PM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com> wrote:
>
> > Hi Rahul,
> >
> > I guess you are querying data using Jdbc plugin, if yes, then it is a bug
> > (please see https://issues.apache.org/jira/browse/DRILL-4903).
> > Other than that case, as far as I know, Drill doesn't return implicit
> > columns in select star query.
> > I am not sure if there is a way to disable it without changing the code.
> >
> > Kind regards
> > Arina
> >
> > On Mon, Dec 12, 2016 at 4:08 PM, Rahul Raj <rahul.raj@option3consulting.
> > com>
> > wrote:
> >
> > > From Drill 1.7, a select star query returns some implicit file
> > columns(like
> > > FQN,fileName,filePath,suffix). I could not find a documentation related
> > to
> > > this. This feature has been added with the commit
> > > https://github.com/apache/drill/pull/491.
> > >
> > > Can someone explain why it is required? Is there any ways to disable
> it?
> > >
> > > Rahul
> > >
> > > --
> > > **** This email and any files transmitted with it are confidential and
> > > intended solely for the use of the individual or entity to whom it is
> > > addressed. If you are not the named addressee then you should not
> > > disseminate, distribute or copy this e-mail. Please notify the sender
> > > immediately and delete this e-mail from your system.****
> > >
> >
>
> --
> **** This email and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom it is
> addressed. If you are not the named addressee then you should not
> disseminate, distribute or copy this e-mail. Please notify the sender
> immediately and delete this e-mail from your system.****
>
Re: Implicit file columns
Posted by Rahul Raj <ra...@option3consulting.com>.
Hi Arina,
Yes, we do have a jdbc plugin enabled. The extra fields appear on CSVs,
parquets created from CSV files etc and not just limited to files queries
through the jdbc plugin.
Regards,
Rahul
On Mon, Dec 12, 2016 at 7:58 PM, Arina Yelchiyeva <
arina.yelchiyeva@gmail.com> wrote:
> Hi Rahul,
>
> I guess you are querying data using Jdbc plugin, if yes, then it is a bug
> (please see https://issues.apache.org/jira/browse/DRILL-4903).
> Other than that case, as far as I know, Drill doesn't return implicit
> columns in select star query.
> I am not sure if there is a way to disable it without changing the code.
>
> Kind regards
> Arina
>
> On Mon, Dec 12, 2016 at 4:08 PM, Rahul Raj <rahul.raj@option3consulting.
> com>
> wrote:
>
> > From Drill 1.7, a select star query returns some implicit file
> columns(like
> > FQN,fileName,filePath,suffix). I could not find a documentation related
> to
> > this. This feature has been added with the commit
> > https://github.com/apache/drill/pull/491.
> >
> > Can someone explain why it is required? Is there any ways to disable it?
> >
> > Rahul
> >
> > --
> > **** This email and any files transmitted with it are confidential and
> > intended solely for the use of the individual or entity to whom it is
> > addressed. If you are not the named addressee then you should not
> > disseminate, distribute or copy this e-mail. Please notify the sender
> > immediately and delete this e-mail from your system.****
> >
>
--
**** This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom it is
addressed. If you are not the named addressee then you should not
disseminate, distribute or copy this e-mail. Please notify the sender
immediately and delete this e-mail from your system.****
Re: Implicit file columns
Posted by Arina Yelchiyeva <ar...@gmail.com>.
Hi Rahul,
I guess you are querying data using Jdbc plugin, if yes, then it is a bug
(please see https://issues.apache.org/jira/browse/DRILL-4903).
Other than that case, as far as I know, Drill doesn't return implicit
columns in select star query.
I am not sure if there is a way to disable it without changing the code.
Kind regards
Arina
On Mon, Dec 12, 2016 at 4:08 PM, Rahul Raj <ra...@option3consulting.com>
wrote:
> From Drill 1.7, a select star query returns some implicit file columns(like
> FQN,fileName,filePath,suffix). I could not find a documentation related to
> this. This feature has been added with the commit
> https://github.com/apache/drill/pull/491.
>
> Can someone explain why it is required? Is there any ways to disable it?
>
> Rahul
>
> --
> **** This email and any files transmitted with it are confidential and
> intended solely for the use of the individual or entity to whom it is
> addressed. If you are not the named addressee then you should not
> disseminate, distribute or copy this e-mail. Please notify the sender
> immediately and delete this e-mail from your system.****
>