You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by Arina Yelchiyeva <ar...@gmail.com> on 2016/04/01 13:33:47 UTC
adding int96 datatype in Drill
Hi all!
There is business requirement to read parquet files generated by Drill
using Hive.
Hive reads timestamps only if they are int96, while Drill writes timestamps
as binary.
I just wanted to know community opinion on adding int96 datatype.
For example, if there will be session property that will tell Drill to
write timestamps as int96.
Any suggestions?
Kind regards
Arina
Re: adding int96 datatype in Drill
Posted by Ted Dunning <te...@gmail.com>.
Or add a cast on the Hive side.
On Fri, Apr 1, 2016 at 10:22 AM, Jacques Nadeau <ja...@dremio.com> wrote:
> It sounds like Hive doesn't work with the full Parquet spec. Why don't we
> just fix that?
>
> Let's add Hive handling so that an annotated INT64 date works.
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Fri, Apr 1, 2016 at 4:33 AM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com
> > wrote:
>
> > Hi all!
> >
> > There is business requirement to read parquet files generated by Drill
> > using Hive.
> > Hive reads timestamps only if they are int96, while Drill writes
> timestamps
> > as binary.
> >
> > I just wanted to know community opinion on adding int96 datatype.
> > For example, if there will be session property that will tell Drill to
> > write timestamps as int96.
> >
> > Any suggestions?
> >
> > Kind regards
> > Arina
> >
>
Re: adding int96 datatype in Drill
Posted by Ted Dunning <te...@gmail.com>.
Or add a cast on the Hive side.
On Fri, Apr 1, 2016 at 10:22 AM, Jacques Nadeau <ja...@dremio.com> wrote:
> It sounds like Hive doesn't work with the full Parquet spec. Why don't we
> just fix that?
>
> Let's add Hive handling so that an annotated INT64 date works.
>
> --
> Jacques Nadeau
> CTO and Co-Founder, Dremio
>
> On Fri, Apr 1, 2016 at 4:33 AM, Arina Yelchiyeva <
> arina.yelchiyeva@gmail.com
> > wrote:
>
> > Hi all!
> >
> > There is business requirement to read parquet files generated by Drill
> > using Hive.
> > Hive reads timestamps only if they are int96, while Drill writes
> timestamps
> > as binary.
> >
> > I just wanted to know community opinion on adding int96 datatype.
> > For example, if there will be session property that will tell Drill to
> > write timestamps as int96.
> >
> > Any suggestions?
> >
> > Kind regards
> > Arina
> >
>
Re: adding int96 datatype in Drill
Posted by Jacques Nadeau <ja...@dremio.com>.
It sounds like Hive doesn't work with the full Parquet spec. Why don't we
just fix that?
Let's add Hive handling so that an annotated INT64 date works.
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Fri, Apr 1, 2016 at 4:33 AM, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> wrote:
> Hi all!
>
> There is business requirement to read parquet files generated by Drill
> using Hive.
> Hive reads timestamps only if they are int96, while Drill writes timestamps
> as binary.
>
> I just wanted to know community opinion on adding int96 datatype.
> For example, if there will be session property that will tell Drill to
> write timestamps as int96.
>
> Any suggestions?
>
> Kind regards
> Arina
>
Re: adding int96 datatype in Drill
Posted by Jacques Nadeau <ja...@dremio.com>.
It sounds like Hive doesn't work with the full Parquet spec. Why don't we
just fix that?
Let's add Hive handling so that an annotated INT64 date works.
--
Jacques Nadeau
CTO and Co-Founder, Dremio
On Fri, Apr 1, 2016 at 4:33 AM, Arina Yelchiyeva <arina.yelchiyeva@gmail.com
> wrote:
> Hi all!
>
> There is business requirement to read parquet files generated by Drill
> using Hive.
> Hive reads timestamps only if they are int96, while Drill writes timestamps
> as binary.
>
> I just wanted to know community opinion on adding int96 datatype.
> For example, if there will be session property that will tell Drill to
> write timestamps as int96.
>
> Any suggestions?
>
> Kind regards
> Arina
>