Accumulo Integration [SEC=UNOFFICIAL]

["Dickson, Matt MR" <ma...@defence.gov.au>]

UNOFFICIAL
I'm investigate integrating Accumulo as a backed to Impala.  At this point it is simply an idea and I'm interested to know if anything has been done to achieve this in the past/present?

If so, is the code open source?

If not, I'd be very keen to gain some detail on how this could be achieved or issues that prevent it being feasible.

Thanks in advance,
Matt

Re: Accumulo Integration [SEC=UNOFFICIAL]

[Tim Armstrong <ta...@cloudera.com>]

I agree that the HBase integration would be a reasonable starting point to
look at. The Kudu integration is also interesting because there are also
similarities and the integration is generally more optimised and
featureful.

I think the devil is in the details - like Jim mentioned, auth can be
tricky. And I think the amount of effort varies a lot depending on the
required level of performance and polish.

On Fri, Jan 12, 2018 at 10:56 AM, Edward Capriolo <ed...@gmail.com>
wrote:

> https://www.quora.com/How-do-we-compare-Apache-HBase-vs-Apache-Accumulo
>
> HBase and Accumulo are both implementations of BigTable using HDFS as their
> storage mechanism.    They are virtually identical in most regards from
> both an operational and architectual standpoint; they have different APIs,
> and use different nomenclature, but conceptually they do the same thing and
> performance is close enough that there's no significant advantage to using
> one over the other.
>
> I was under the general impression that the above was true. So it should be
> a near 1 to 1 port right? IE fundamentally both are BigTable clones.
>
> On Fri, Jan 12, 2018 at 11:59 AM, Jim Apple <jb...@cloudera.com> wrote:
>
> > I don't know that Impala can scan Accumulo tables. Assuming it can't:
> > Impala can read HBase tables, so that might be a good place for you to
> > start looking on what this could look like.
> >
> > I suspect the most complex piece is going to be the auth integration.
> >
> > On Thu, Jan 11, 2018 at 7:16 PM, Dickson, Matt MR
> > <ma...@defence.gov.au> wrote:
> > > UNOFFICIAL
> > > I'm investigate integrating Accumulo as a backed to Impala.  At this
> > point it is simply an idea and I'm interested to know if anything has
> been
> > done to achieve this in the past/present?
> > >
> > > If so, is the code open source?
> > >
> > > If not, I'd be very keen to gain some detail on how this could be
> > achieved or issues that prevent it being feasible.
> > >
> > > Thanks in advance,
> > > Matt
> > >
> >
>

Re: Accumulo Integration [SEC=UNOFFICIAL]

[Edward Capriolo <ed...@gmail.com>]

https://www.quora.com/How-do-we-compare-Apache-HBase-vs-Apache-Accumulo

HBase and Accumulo are both implementations of BigTable using HDFS as their
storage mechanism.    They are virtually identical in most regards from
both an operational and architectual standpoint; they have different APIs,
and use different nomenclature, but conceptually they do the same thing and
performance is close enough that there's no significant advantage to using
one over the other.

I was under the general impression that the above was true. So it should be
a near 1 to 1 port right? IE fundamentally both are BigTable clones.

On Fri, Jan 12, 2018 at 11:59 AM, Jim Apple <jb...@cloudera.com> wrote:

> I don't know that Impala can scan Accumulo tables. Assuming it can't:
> Impala can read HBase tables, so that might be a good place for you to
> start looking on what this could look like.
>
> I suspect the most complex piece is going to be the auth integration.
>
> On Thu, Jan 11, 2018 at 7:16 PM, Dickson, Matt MR
> <ma...@defence.gov.au> wrote:
> > UNOFFICIAL
> > I'm investigate integrating Accumulo as a backed to Impala.  At this
> point it is simply an idea and I'm interested to know if anything has been
> done to achieve this in the past/present?
> >
> > If so, is the code open source?
> >
> > If not, I'd be very keen to gain some detail on how this could be
> achieved or issues that prevent it being feasible.
> >
> > Thanks in advance,
> > Matt
> >
>

Re: Accumulo Integration [SEC=UNOFFICIAL]

[Jim Apple <jb...@cloudera.com>]

I don't know that Impala can scan Accumulo tables. Assuming it can't:
Impala can read HBase tables, so that might be a good place for you to
start looking on what this could look like.

I suspect the most complex piece is going to be the auth integration.

On Thu, Jan 11, 2018 at 7:16 PM, Dickson, Matt MR
<ma...@defence.gov.au> wrote:
> UNOFFICIAL
> I'm investigate integrating Accumulo as a backed to Impala.  At this point it is simply an idea and I'm interested to know if anything has been done to achieve this in the past/present?
>
> If so, is the code open source?
>
> If not, I'd be very keen to gain some detail on how this could be achieved or issues that prevent it being feasible.
>
> Thanks in advance,
> Matt
>