You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Nishanth S <ni...@gmail.com> on 2014/10/21 04:08:06 UTC
Using parquet
Hey folks,
I have been reading a bit about parque and how hive and impala works well
on data stored in parque format.Is it even possible to do the same with
hbase to reduce storage etc..
Thanks,
Nishanth
Re: Using parquet
Posted by Nishanth S <ni...@gmail.com>.
Thanks All.I will get back if I take that direction.
-Nishanth
On Tue, Oct 21, 2014 at 8:15 AM, Ted Yu <yu...@gmail.com> wrote:
> The link is about Cassandra, not hbase.
>
> Cheers
>
> On Tue, Oct 21, 2014 at 2:53 AM, Qiang Tian <ti...@gmail.com> wrote:
>
> > Do you want some sql-on-hadoop could access hbase file directly?
> > I did a quick search and find
> > http://www.slideshare.net/Stratio/integrating-sparkandcassandra(P35),
> but
> > not sure if I understand correctly.
> >
> > On Tue, Oct 21, 2014 at 12:15 PM, Nick Dimiduk <nd...@gmail.com>
> wrote:
> >
> > > Not currently. HBase uses it's own file format that makes different
> > > assumptions than parquet. Instead, HBase supports it's own format
> > > optimizations, such as block encodings and compression. I would be
> > > interested in an exercise to see what things are necessary for HBase to
> > > support a columnar format such as parquet or orc; no such investigation
> > has
> > > been undertaken that I am aware of.
> > >
> > > Thanks,
> > > Nick
> > >
> > > On Monday, October 20, 2014, Nishanth S <ni...@gmail.com>
> wrote:
> > >
> > > > Hey folks,
> > > >
> > > > I have been reading a bit about parque and how hive and impala
> works
> > > well
> > > > on data stored in parque format.Is it even possible to do the same
> > with
> > > > hbase to reduce storage etc..
> > > >
> > > >
> > > > Thanks,
> > > > Nishanth
> > > >
> > >
> >
>
Re: Using parquet
Posted by Ted Yu <yu...@gmail.com>.
The link is about Cassandra, not hbase.
Cheers
On Tue, Oct 21, 2014 at 2:53 AM, Qiang Tian <ti...@gmail.com> wrote:
> Do you want some sql-on-hadoop could access hbase file directly?
> I did a quick search and find
> http://www.slideshare.net/Stratio/integrating-sparkandcassandra(P35), but
> not sure if I understand correctly.
>
> On Tue, Oct 21, 2014 at 12:15 PM, Nick Dimiduk <nd...@gmail.com> wrote:
>
> > Not currently. HBase uses it's own file format that makes different
> > assumptions than parquet. Instead, HBase supports it's own format
> > optimizations, such as block encodings and compression. I would be
> > interested in an exercise to see what things are necessary for HBase to
> > support a columnar format such as parquet or orc; no such investigation
> has
> > been undertaken that I am aware of.
> >
> > Thanks,
> > Nick
> >
> > On Monday, October 20, 2014, Nishanth S <ni...@gmail.com> wrote:
> >
> > > Hey folks,
> > >
> > > I have been reading a bit about parque and how hive and impala works
> > well
> > > on data stored in parque format.Is it even possible to do the same
> with
> > > hbase to reduce storage etc..
> > >
> > >
> > > Thanks,
> > > Nishanth
> > >
> >
>
Re: Using parquet
Posted by Qiang Tian <ti...@gmail.com>.
Do you want some sql-on-hadoop could access hbase file directly?
I did a quick search and find
http://www.slideshare.net/Stratio/integrating-sparkandcassandra(P35), but
not sure if I understand correctly.
On Tue, Oct 21, 2014 at 12:15 PM, Nick Dimiduk <nd...@gmail.com> wrote:
> Not currently. HBase uses it's own file format that makes different
> assumptions than parquet. Instead, HBase supports it's own format
> optimizations, such as block encodings and compression. I would be
> interested in an exercise to see what things are necessary for HBase to
> support a columnar format such as parquet or orc; no such investigation has
> been undertaken that I am aware of.
>
> Thanks,
> Nick
>
> On Monday, October 20, 2014, Nishanth S <ni...@gmail.com> wrote:
>
> > Hey folks,
> >
> > I have been reading a bit about parque and how hive and impala works
> well
> > on data stored in parque format.Is it even possible to do the same with
> > hbase to reduce storage etc..
> >
> >
> > Thanks,
> > Nishanth
> >
>
Re: Using parquet
Posted by Nick Dimiduk <nd...@gmail.com>.
Not currently. HBase uses it's own file format that makes different
assumptions than parquet. Instead, HBase supports it's own format
optimizations, such as block encodings and compression. I would be
interested in an exercise to see what things are necessary for HBase to
support a columnar format such as parquet or orc; no such investigation has
been undertaken that I am aware of.
Thanks,
Nick
On Monday, October 20, 2014, Nishanth S <ni...@gmail.com> wrote:
> Hey folks,
>
> I have been reading a bit about parque and how hive and impala works well
> on data stored in parque format.Is it even possible to do the same with
> hbase to reduce storage etc..
>
>
> Thanks,
> Nishanth
>