You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@accumulo.apache.org by "Roberts, Geoffry [USA]" <Ro...@bah.com> on 2019/08/29 14:17:44 UTC
Accumulo 2.0 and the proxy Server
I hope this is a quick question.
I downloaded a copy of Accumulo 2.0 and noticed it does not contain proxy.properties. Has it been removed? Will it work with an older version of the file?
Re: [External] Re: Accumulo 2.0 and the proxy Server
Posted by Christopher <ct...@apache.org>.
On Thu, Aug 29, 2019 at 2:03 PM Josh Elser <el...@apache.org> wrote:
>
> Architectural interest in the feature/product is a very different thing
> than interest in maintaining and testing said product ;)
>
> I read Christopher's reply in a "there isn't interest in contributing
> more to the service by the current, active developers" tone, in the
> spirit of ASF's "do-oracy" approach. We would be very welcome for people
> to come along and do more with it and separating it from the core
> repository helps individuals see the fruits of their labor much more
> quickly.
It's not so much that "there isn't", but an observation that "there
hasn't been", but yes, this is basically it. In a separate repo, it
can live or die on its own. If there is interest, I hope it lives. If
not, I'd hate for it to be a drag for those actively maintaining the
core project components. Modularizing our development by separating
out components into their own repos when they aren't (or don't need to
be) tightly coupled to the core components, means developers can focus
on the components they care most about, without worrying about the
rest. Both the proxy and the maven-plugin fell into this category and
moved to their own repo. We've already done a release of the
maven-plugin from its new repo. If there's interest, we can do the
same for the proxy. In future, we could do the same for the custom
classloader stuff (possibly), and the tracer sink service.
Re: [External] Re: Accumulo 2.0 and the proxy Server
Posted by Jeremy Kepner <ke...@ll.mit.edu>.
Folks interested in Python, Julia, Matlab/Octave bindings to Accumulo
might look into d4m.mit.edu
On Thu, Aug 29, 2019 at 11:50:57AM -0700, Noah Randolph wrote:
> Hi Christopher,
>
> Can you clarify the "multi user aspect?" Is it the ability to login as
> multiple users through one client connection, or is it the ability to have
> multiple users in general (beyond just root), or is it something else?
>
> Thanks,
> Noah Randolph
>
>
>
> On Thu, Aug 29, 2019 at 11:03 AM Josh Elser <el...@apache.org> wrote:
>
> > Architectural interest in the feature/product is a very different thing
> > than interest in maintaining and testing said product ;)
> >
> > I read Christopher's reply in a "there isn't interest in contributing
> > more to the service by the current, active developers" tone, in the
> > spirit of ASF's "do-oracy" approach. We would be very welcome for people
> > to come along and do more with it and separating it from the core
> > repository helps individuals see the fruits of their labor much more
> > quickly.
> >
> > https://www.apache.org/foundation/how-it-works.html
> >
> > On 8/29/19 11:57 AM, Roberts, Geoffry [USA] wrote:
> > > I am surprised to learn that there apparently is scant interest in
> > > proxy. I think it is attractive to support multiple languages. From my
> > > view, the well-being of Accumulo depends on it. Maybe I am wrong.
> > >
> > > *From: *Christopher <ct...@gmail.com>
> > > *Reply-To: *"user@accumulo.apache.org" <us...@accumulo.apache.org>
> > > *Date: *Thursday, August 29, 2019 at 11:31 AM
> > > *To: *accumulo-user <us...@accumulo.apache.org>
> > > *Subject: *[External] Re: Accumulo 2.0 and the proxy Server
> > >
> > > It was separated out so it could live or die on its own, as the case may
> > > be. It hasn't received much development attention in awhile.
> > >
> > > A new version hasn't yet been released from this new repo. If there is
> > > still interest, somebody will need to devote some resources to attend to
> > > it. One thing I'd like to see is for it to drop the multi user aspect,
> > > and to support a single user via the new 2.0 client properties. It could
> > > be simplified greatly that way, and possibly easier to maintain, if
> > > there's still interest.
> > >
> > > On Thu, Aug 29, 2019, 10:25 Mike Miller <mmiller@apache.org
> > > <ma...@apache.org>> wrote:
> > >
> > > Yes it has been pulled from the main Accumulo 2.0 repository. The
> > > proxy is now in its own repo here:
> > > https://github.com/apache/accumulo-proxy
> > > <
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_accumulo-2Dproxy&d=DwMFaQ&c=f4NRRID3zFYDyClb0wZXwA&r=hc5v62HpZrcalgHOsVfthsgLhE5LrDVBm9xDs5ozH5U&m=7Up-S9F2rKbOkzCJgxhBsRFmB0ApKIbZU8v2xtMTBdo&s=aQSkYib3VNqayF7hd2x7X_MIqJhNV3u3LgrvCOacJ5w&e=
> > >
> > >
> > > It should still work the same.
> > >
> > > On Thu, Aug 29, 2019 at 10:17 AM Roberts, Geoffry [USA]
> > > <Roberts_Geoffry@bah.com <ma...@bah.com>> wrote:
> > >
> > > I hope this is a quick question.
> > >
> > > I downloaded a copy of Accumulo 2.0 and noticed it does not
> > > contain proxy.properties. Has it been removed? Will it work
> > > with an older version of the file?
> > >
> >
Re: [External] Re: Accumulo 2.0 and the proxy Server
Posted by Christopher <ct...@apache.org>.
On Thu, Aug 29, 2019 at 2:51 PM Noah Randolph <nr...@kountable.com> wrote:
>
> Hi Christopher,
>
> Can you clarify the "multi user aspect?" Is it the ability to login as multiple users through one client connection, or is it the ability to have multiple users in general (beyond just root), or is it something else?
Sure, I can try.
Currently, you the proxy is stateless with respect to authentication.
Each client of the proxy constructs a serialized form of their
credentials by calling `login()`, and then has to keep passing those
credentials for each subsequent request. In this way, it supports
multiple users (same connection or not).
This isn't really the way the proxy is intended to be run, though. (I
certainly wouldn't recommend it.) It's much better for the proxy to
not sit as a service handling arbitrary client requests... but
actually be run for a specific (presumably non-Java) client, locally
to, and only for the lifetime of, that single client. Basically, one
proxy per client.
If you run it this way, it can be stateful... and it can take
advantage of the new client configuration properties stuff in 2.0.
When it starts, it can read the client.properties file and use those
properties to construct a ready and waiting AccumuloClient object for
that specific user.
This is obviously a very different design than the current proxy, but
doing things this way can dramatically simplify the proxy code, making
it rely more on standard client configuration for Accumulo rather than
doing its own custom stuffs. Any security model we implement to
authenticate the real client to the proxy could be much simpler, if
it's even necessary (could use a unix domain socket instead of IP so
the connection can be secured by POSIX permissions).
In any case, it was just one possible way we could simplify the proxy
and make it more maintainable for future, while also designing it to
work like the way we recommend (one proxy per client).
Re: [External] Re: Accumulo 2.0 and the proxy Server
Posted by Noah Randolph <nr...@kountable.com>.
Hi Christopher,
Can you clarify the "multi user aspect?" Is it the ability to login as
multiple users through one client connection, or is it the ability to have
multiple users in general (beyond just root), or is it something else?
Thanks,
Noah Randolph
On Thu, Aug 29, 2019 at 11:03 AM Josh Elser <el...@apache.org> wrote:
> Architectural interest in the feature/product is a very different thing
> than interest in maintaining and testing said product ;)
>
> I read Christopher's reply in a "there isn't interest in contributing
> more to the service by the current, active developers" tone, in the
> spirit of ASF's "do-oracy" approach. We would be very welcome for people
> to come along and do more with it and separating it from the core
> repository helps individuals see the fruits of their labor much more
> quickly.
>
> https://www.apache.org/foundation/how-it-works.html
>
> On 8/29/19 11:57 AM, Roberts, Geoffry [USA] wrote:
> > I am surprised to learn that there apparently is scant interest in
> > proxy. I think it is attractive to support multiple languages. From my
> > view, the well-being of Accumulo depends on it. Maybe I am wrong.
> >
> > *From: *Christopher <ct...@gmail.com>
> > *Reply-To: *"user@accumulo.apache.org" <us...@accumulo.apache.org>
> > *Date: *Thursday, August 29, 2019 at 11:31 AM
> > *To: *accumulo-user <us...@accumulo.apache.org>
> > *Subject: *[External] Re: Accumulo 2.0 and the proxy Server
> >
> > It was separated out so it could live or die on its own, as the case may
> > be. It hasn't received much development attention in awhile.
> >
> > A new version hasn't yet been released from this new repo. If there is
> > still interest, somebody will need to devote some resources to attend to
> > it. One thing I'd like to see is for it to drop the multi user aspect,
> > and to support a single user via the new 2.0 client properties. It could
> > be simplified greatly that way, and possibly easier to maintain, if
> > there's still interest.
> >
> > On Thu, Aug 29, 2019, 10:25 Mike Miller <mmiller@apache.org
> > <ma...@apache.org>> wrote:
> >
> > Yes it has been pulled from the main Accumulo 2.0 repository. The
> > proxy is now in its own repo here:
> > https://github.com/apache/accumulo-proxy
> > <
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_accumulo-2Dproxy&d=DwMFaQ&c=f4NRRID3zFYDyClb0wZXwA&r=hc5v62HpZrcalgHOsVfthsgLhE5LrDVBm9xDs5ozH5U&m=7Up-S9F2rKbOkzCJgxhBsRFmB0ApKIbZU8v2xtMTBdo&s=aQSkYib3VNqayF7hd2x7X_MIqJhNV3u3LgrvCOacJ5w&e=
> >
> >
> > It should still work the same.
> >
> > On Thu, Aug 29, 2019 at 10:17 AM Roberts, Geoffry [USA]
> > <Roberts_Geoffry@bah.com <ma...@bah.com>> wrote:
> >
> > I hope this is a quick question.
> >
> > I downloaded a copy of Accumulo 2.0 and noticed it does not
> > contain proxy.properties. Has it been removed? Will it work
> > with an older version of the file?
> >
>
Re: [External] Re: Accumulo 2.0 and the proxy Server
Posted by Josh Elser <el...@apache.org>.
Architectural interest in the feature/product is a very different thing
than interest in maintaining and testing said product ;)
I read Christopher's reply in a "there isn't interest in contributing
more to the service by the current, active developers" tone, in the
spirit of ASF's "do-oracy" approach. We would be very welcome for people
to come along and do more with it and separating it from the core
repository helps individuals see the fruits of their labor much more
quickly.
https://www.apache.org/foundation/how-it-works.html
On 8/29/19 11:57 AM, Roberts, Geoffry [USA] wrote:
> I am surprised to learn that there apparently is scant interest in
> proxy. I think it is attractive to support multiple languages. From my
> view, the well-being of Accumulo depends on it. Maybe I am wrong.
>
> *From: *Christopher <ct...@gmail.com>
> *Reply-To: *"user@accumulo.apache.org" <us...@accumulo.apache.org>
> *Date: *Thursday, August 29, 2019 at 11:31 AM
> *To: *accumulo-user <us...@accumulo.apache.org>
> *Subject: *[External] Re: Accumulo 2.0 and the proxy Server
>
> It was separated out so it could live or die on its own, as the case may
> be. It hasn't received much development attention in awhile.
>
> A new version hasn't yet been released from this new repo. If there is
> still interest, somebody will need to devote some resources to attend to
> it. One thing I'd like to see is for it to drop the multi user aspect,
> and to support a single user via the new 2.0 client properties. It could
> be simplified greatly that way, and possibly easier to maintain, if
> there's still interest.
>
> On Thu, Aug 29, 2019, 10:25 Mike Miller <mmiller@apache.org
> <ma...@apache.org>> wrote:
>
> Yes it has been pulled from the main Accumulo 2.0 repository. The
> proxy is now in its own repo here:
> https://github.com/apache/accumulo-proxy
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_accumulo-2Dproxy&d=DwMFaQ&c=f4NRRID3zFYDyClb0wZXwA&r=hc5v62HpZrcalgHOsVfthsgLhE5LrDVBm9xDs5ozH5U&m=7Up-S9F2rKbOkzCJgxhBsRFmB0ApKIbZU8v2xtMTBdo&s=aQSkYib3VNqayF7hd2x7X_MIqJhNV3u3LgrvCOacJ5w&e=>
>
> It should still work the same.
>
> On Thu, Aug 29, 2019 at 10:17 AM Roberts, Geoffry [USA]
> <Roberts_Geoffry@bah.com <ma...@bah.com>> wrote:
>
> I hope this is a quick question.
>
> I downloaded a copy of Accumulo 2.0 and noticed it does not
> contain proxy.properties. Has it been removed? Will it work
> with an older version of the file?
>
Re: [External] Re: Accumulo 2.0 and the proxy Server
Posted by "Roberts, Geoffry [USA]" <Ro...@bah.com>.
I am surprised to learn that there apparently is scant interest in proxy. I think it is attractive to support multiple languages. From my view, the well-being of Accumulo depends on it. Maybe I am wrong.
From: Christopher <ct...@gmail.com>
Reply-To: "user@accumulo.apache.org" <us...@accumulo.apache.org>
Date: Thursday, August 29, 2019 at 11:31 AM
To: accumulo-user <us...@accumulo.apache.org>
Subject: [External] Re: Accumulo 2.0 and the proxy Server
It was separated out so it could live or die on its own, as the case may be. It hasn't received much development attention in awhile.
A new version hasn't yet been released from this new repo. If there is still interest, somebody will need to devote some resources to attend to it. One thing I'd like to see is for it to drop the multi user aspect, and to support a single user via the new 2.0 client properties. It could be simplified greatly that way, and possibly easier to maintain, if there's still interest.
On Thu, Aug 29, 2019, 10:25 Mike Miller <mm...@apache.org>> wrote:
Yes it has been pulled from the main Accumulo 2.0 repository. The proxy is now in its own repo here: https://github.com/apache/accumulo-proxy<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_accumulo-2Dproxy&d=DwMFaQ&c=f4NRRID3zFYDyClb0wZXwA&r=hc5v62HpZrcalgHOsVfthsgLhE5LrDVBm9xDs5ozH5U&m=7Up-S9F2rKbOkzCJgxhBsRFmB0ApKIbZU8v2xtMTBdo&s=aQSkYib3VNqayF7hd2x7X_MIqJhNV3u3LgrvCOacJ5w&e=>
It should still work the same.
On Thu, Aug 29, 2019 at 10:17 AM Roberts, Geoffry [USA] <Ro...@bah.com>> wrote:
I hope this is a quick question.
I downloaded a copy of Accumulo 2.0 and noticed it does not contain proxy.properties. Has it been removed? Will it work with an older version of the file?
Re: Accumulo 2.0 and the proxy Server
Posted by Christopher <ct...@gmail.com>.
It was separated out so it could live or die on its own, as the case may
be. It hasn't received much development attention in awhile.
A new version hasn't yet been released from this new repo. If there is
still interest, somebody will need to devote some resources to attend to
it. One thing I'd like to see is for it to drop the multi user aspect, and
to support a single user via the new 2.0 client properties. It could be
simplified greatly that way, and possibly easier to maintain, if there's
still interest.
On Thu, Aug 29, 2019, 10:25 Mike Miller <mm...@apache.org> wrote:
> Yes it has been pulled from the main Accumulo 2.0 repository. The proxy
> is now in its own repo here: https://github.com/apache/accumulo-proxy
> It should still work the same.
>
> On Thu, Aug 29, 2019 at 10:17 AM Roberts, Geoffry [USA] <
> Roberts_Geoffry@bah.com> wrote:
>
>> I hope this is a quick question.
>>
>>
>>
>> I downloaded a copy of Accumulo 2.0 and noticed it does not contain
>> proxy.properties. Has it been removed? Will it work with an older version
>> of the file?
>>
>
Re: Accumulo 2.0 and the proxy Server
Posted by Mike Miller <mm...@apache.org>.
Yes it has been pulled from the main Accumulo 2.0 repository. The proxy is
now in its own repo here: https://github.com/apache/accumulo-proxy
It should still work the same.
On Thu, Aug 29, 2019 at 10:17 AM Roberts, Geoffry [USA] <
Roberts_Geoffry@bah.com> wrote:
> I hope this is a quick question.
>
>
>
> I downloaded a copy of Accumulo 2.0 and noticed it does not contain
> proxy.properties. Has it been removed? Will it work with an older version
> of the file?
>