You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Flavio Pompermaier <po...@okkam.it> on 2014/05/21 10:24:45 UTC
Drill + HBase + JSON/XML
Hi to all,
I'm new to Drill and it sounds amazing! In my use case I have to query XML
data stored in an HBASE table..do I have to convert it first into JSON to
be able to use it in drill?
When inserting data in HBase do I have to pass through Drill in order to be
able to query data real-time (like Phoenix)?
Is there any good example that I can usa as a starting point?
Best,
Flavio
Re: Drill + HBase + JSON/XML
Posted by Flavio Pompermaier <po...@okkam.it>.
That's sounds awesome! Thank you all for the great support.
Best,
Flavio
On Wed, May 21, 2014 at 5:49 PM, Jacques Nadeau <ja...@apache.org> wrote:
> Note, we don't have the CONVERT_FROM(val, JSON) support in mainline yet but
> it should be there soon. That will allow you to work with embedded JSON.
> We don't currently have a plan to build CONVERT_FROM(val, XML) function
> yet but we should have an article posted in the next couple weeks on how
> you can implement one directly if you want to read XML without having to
> convert the data to JSON.
>
>
> On Wed, May 21, 2014 at 8:44 AM, Neeraja Rentachintala <
> nrentachintala@maprtech.com> wrote:
>
> >
> >
> https://cwiki.apache.org/confluence/display/DRILL/Connect+Apache+Drill+to+Data+Sourceshas
> > info to get started.
> >
> >
> > On Wed, May 21, 2014 at 7:13 AM, Flavio Pompermaier <
> pompermaier@okkam.it
> > >wrote:
> >
> > > Great! Thank you all for the support.
> > > Does Drill support both JSON and XML content in HBase cdell or only
> JSON?
> > > Do you have a pointer to the documentation you are talking about?
> > >
> > > Best,
> > > Flavio
> > >
> > >
> > > On Wed, May 21, 2014 at 4:07 PM, Neeraja Rentachintala <
> > > nrentachintala@maprtech.com> wrote:
> > >
> > > > Drill is a low latency distributed query engine on top of data
> sources.
> > > > So yes, you can query the data in HBase. You dont need to create
> data
> > in
> > > > HBase through Drill in order to query it.
> > > > Drill wiki has documentation on how to query various data sources
> (and
> > > this
> > > > include HBase, FIle system and HIve).
> > > >
> > > > thanks
> > > >
> > > >
> > > >
> > > > On Wed, May 21, 2014 at 1:24 AM, Flavio Pompermaier <
> > > pompermaier@okkam.it
> > > > >wrote:
> > > >
> > > > > Hi to all,
> > > > >
> > > > > I'm new to Drill and it sounds amazing! In my use case I have to
> > query
> > > > XML
> > > > > data stored in an HBASE table..do I have to convert it first into
> > JSON
> > > to
> > > > > be able to use it in drill?
> > > > > When inserting data in HBase do I have to pass through Drill in
> order
> > > to
> > > > be
> > > > > able to query data real-time (like Phoenix)?
> > > > >
> > > > > Is there any good example that I can usa as a starting point?
> > > > >
> > > > > Best,
> > > > > Flavio
> > > > >
> > > >
> > >
> >
>
Re: Drill + HBase + JSON/XML
Posted by Jacques Nadeau <ja...@apache.org>.
Note, we don't have the CONVERT_FROM(val, JSON) support in mainline yet but
it should be there soon. That will allow you to work with embedded JSON.
We don't currently have a plan to build CONVERT_FROM(val, XML) function
yet but we should have an article posted in the next couple weeks on how
you can implement one directly if you want to read XML without having to
convert the data to JSON.
On Wed, May 21, 2014 at 8:44 AM, Neeraja Rentachintala <
nrentachintala@maprtech.com> wrote:
>
> https://cwiki.apache.org/confluence/display/DRILL/Connect+Apache+Drill+to+Data+Sourceshas
> info to get started.
>
>
> On Wed, May 21, 2014 at 7:13 AM, Flavio Pompermaier <pompermaier@okkam.it
> >wrote:
>
> > Great! Thank you all for the support.
> > Does Drill support both JSON and XML content in HBase cdell or only JSON?
> > Do you have a pointer to the documentation you are talking about?
> >
> > Best,
> > Flavio
> >
> >
> > On Wed, May 21, 2014 at 4:07 PM, Neeraja Rentachintala <
> > nrentachintala@maprtech.com> wrote:
> >
> > > Drill is a low latency distributed query engine on top of data sources.
> > > So yes, you can query the data in HBase. You dont need to create data
> in
> > > HBase through Drill in order to query it.
> > > Drill wiki has documentation on how to query various data sources (and
> > this
> > > include HBase, FIle system and HIve).
> > >
> > > thanks
> > >
> > >
> > >
> > > On Wed, May 21, 2014 at 1:24 AM, Flavio Pompermaier <
> > pompermaier@okkam.it
> > > >wrote:
> > >
> > > > Hi to all,
> > > >
> > > > I'm new to Drill and it sounds amazing! In my use case I have to
> query
> > > XML
> > > > data stored in an HBASE table..do I have to convert it first into
> JSON
> > to
> > > > be able to use it in drill?
> > > > When inserting data in HBase do I have to pass through Drill in order
> > to
> > > be
> > > > able to query data real-time (like Phoenix)?
> > > >
> > > > Is there any good example that I can usa as a starting point?
> > > >
> > > > Best,
> > > > Flavio
> > > >
> > >
> >
>
Re: Drill + HBase + JSON/XML
Posted by Neeraja Rentachintala <nr...@maprtech.com>.
https://cwiki.apache.org/confluence/display/DRILL/Connect+Apache+Drill+to+Data+Sourceshas
info to get started.
On Wed, May 21, 2014 at 7:13 AM, Flavio Pompermaier <po...@okkam.it>wrote:
> Great! Thank you all for the support.
> Does Drill support both JSON and XML content in HBase cdell or only JSON?
> Do you have a pointer to the documentation you are talking about?
>
> Best,
> Flavio
>
>
> On Wed, May 21, 2014 at 4:07 PM, Neeraja Rentachintala <
> nrentachintala@maprtech.com> wrote:
>
> > Drill is a low latency distributed query engine on top of data sources.
> > So yes, you can query the data in HBase. You dont need to create data in
> > HBase through Drill in order to query it.
> > Drill wiki has documentation on how to query various data sources (and
> this
> > include HBase, FIle system and HIve).
> >
> > thanks
> >
> >
> >
> > On Wed, May 21, 2014 at 1:24 AM, Flavio Pompermaier <
> pompermaier@okkam.it
> > >wrote:
> >
> > > Hi to all,
> > >
> > > I'm new to Drill and it sounds amazing! In my use case I have to query
> > XML
> > > data stored in an HBASE table..do I have to convert it first into JSON
> to
> > > be able to use it in drill?
> > > When inserting data in HBase do I have to pass through Drill in order
> to
> > be
> > > able to query data real-time (like Phoenix)?
> > >
> > > Is there any good example that I can usa as a starting point?
> > >
> > > Best,
> > > Flavio
> > >
> >
>
Re: Drill + HBase + JSON/XML
Posted by Flavio Pompermaier <po...@okkam.it>.
Great! Thank you all for the support.
Does Drill support both JSON and XML content in HBase cdell or only JSON?
Do you have a pointer to the documentation you are talking about?
Best,
Flavio
On Wed, May 21, 2014 at 4:07 PM, Neeraja Rentachintala <
nrentachintala@maprtech.com> wrote:
> Drill is a low latency distributed query engine on top of data sources.
> So yes, you can query the data in HBase. You dont need to create data in
> HBase through Drill in order to query it.
> Drill wiki has documentation on how to query various data sources (and this
> include HBase, FIle system and HIve).
>
> thanks
>
>
>
> On Wed, May 21, 2014 at 1:24 AM, Flavio Pompermaier <pompermaier@okkam.it
> >wrote:
>
> > Hi to all,
> >
> > I'm new to Drill and it sounds amazing! In my use case I have to query
> XML
> > data stored in an HBASE table..do I have to convert it first into JSON to
> > be able to use it in drill?
> > When inserting data in HBase do I have to pass through Drill in order to
> be
> > able to query data real-time (like Phoenix)?
> >
> > Is there any good example that I can usa as a starting point?
> >
> > Best,
> > Flavio
> >
>
Re: Drill + HBase + JSON/XML
Posted by Neeraja Rentachintala <nr...@maprtech.com>.
Drill is a low latency distributed query engine on top of data sources.
So yes, you can query the data in HBase. You dont need to create data in
HBase through Drill in order to query it.
Drill wiki has documentation on how to query various data sources (and this
include HBase, FIle system and HIve).
thanks
On Wed, May 21, 2014 at 1:24 AM, Flavio Pompermaier <po...@okkam.it>wrote:
> Hi to all,
>
> I'm new to Drill and it sounds amazing! In my use case I have to query XML
> data stored in an HBASE table..do I have to convert it first into JSON to
> be able to use it in drill?
> When inserting data in HBase do I have to pass through Drill in order to be
> able to query data real-time (like Phoenix)?
>
> Is there any good example that I can usa as a starting point?
>
> Best,
> Flavio
>
回复：Drill + HBase + JSON/XML
Posted by 南在南方 <i0...@qq.com>.
As I know, you can put json file on HDFS or local filesystem. I'm not sure a json or xml file can storage on HBASE, It's just a database. now Drill supports querying json, csv, parquet file on a specific filesystem ,It also can query data on HBASE database or hive.
thanks.
Bevin
------------------ 原始邮件 ------------------
发件人: "Flavio Pompermaier";<po...@okkam.it>;
发送时间: 2014年5月21日(星期三) 下午4:24
收件人: "drill-user"<dr...@incubator.apache.org>;
主题: Drill + HBase + JSON/XML
Hi to all,
I'm new to Drill and it sounds amazing! In my use case I have to query XML
data stored in an HBASE table..do I have to convert it first into JSON to
be able to use it in drill?
When inserting data in HBase do I have to pass through Drill in order to be
able to query data real-time (like Phoenix)?
Is there any good example that I can usa as a starting point?
Best,
Flavio