You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@polaris.apache.org by Jean-Baptiste Onofré <jb...@nanthrax.net> on 2025/07/09 18:00:02 UTC

[Community Meeting] NoSQL Support in Apache Polaris

Hi folks,

Several contributors asked an update about NoSQL support in Apache Polaris.

Now that Polaris 1.0 is almost there :) I propose to have a meeting to
resume the discussion.

I scheduled a community meeting for July 17th 9am PST:

https://calendar.app.google/8gBEGDxq2vqoQePz5

If you are in the Polaris group, you should have received the invite already.

Thoughts ?

Thanks !
Regards
JB

Re: [Community Meeting] NoSQL Support in Apache Polaris

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Hi

Thanks everyone who joined the NoSQL Community meeting yesterday.

Here's the record:
https://drive.google.com/file/d/1XN1ng8ORB3-jCAeWmCt0vOn3zyZmvRWh/view?usp=sharing

In terms of next steps:
1. Adam will start a thread on the dev mailing list to gather feedback
and share the main updates on the PR
2. After time for everyone to review/comment, I propose to have a new
community meeting to answer questions and have discussion in August.

Thanks !

Regards
JB

On Thu, Jul 10, 2025 at 12:59 AM Dmitri Bourlatchkov <di...@apache.org> wrote:
>
> Re: Spanner: The NoSQL proposal can certainly be extended to Spanner.
>
> However, if the question is about Byron's Spanner Persistence
> implementation as discussed in the last Community sync, I believe that work
> is not related to the NoSQL proposal (and we do not even have a PR for it
> yet).
>
> Cheers,
> Dmitri.
>
>
> On Wed, Jul 9, 2025 at 4:07 PM Adam Christian
> <ad...@dremio.com.invalid> wrote:
>
> > This meeting is to:
> > 1. Walkthrough this proposal
> >
> > https://docs.google.com/document/d/1POUWe0xMZOBoaJ6Rgiw35ziEoc6OEYCiW7Zk6bR9H6M/edit?tab=t.0#heading=h.nx9vzhg2x8v2
> > 2. Maybe, look at some of the high-level modules in the draft PR
> > https://github.com/apache/polaris/pull/1189
> >
> > In regards to Spanner, this proposal handles most databases that can:
> > 1. Do single-row compare-and-swap
> > 2. Do optimized point queries
> >
> > So, I would expect that Spanner could be covered under this, but right now,
> > it's not an explicit goal.
> >
> > Go team,
> >
> > Adam Christian
> > Principal Software Engineer
> > adam.christian@dremio.com
> > LinkedIn Profile <https://www.linkedin.com/in/adam-christian-40309824/>
> >
> > <https://hello.dremio.com/email-signature-url>
> >
> >
> >
> > On Wed, Jul 9, 2025 at 11:37 AM Eric Maynard <er...@gmail.com>
> > wrote:
> >
> > > I know that there was a spanner implementation mentioned in a recent
> > > community sync, is that also part of the same discussion?
> > >
> > > On Wed, Jul 9, 2025 at 11:12 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> > > wrote:
> > >
> > > > Actually the invite was not correct: the meeting is on 7/17 as
> > > > originally in my first email.
> > > >
> > > > Sorry for the confusion.
> > > >
> > > > Regards
> > > > JB
> > > >
> > > > On Wed, Jul 9, 2025 at 2:06 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
> > > > wrote:
> > > > >
> > > > > My bad, yes, it's 7/16.
> > > > >
> > > > > Regards
> > > > > JB
> > > > >
> > > > > On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp <sn...@snazy.de> wrote:
> > > > > >
> > > > > > The invite says July 16th?
> > > > > >
> > > > > > On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré <
> > jb@nanthrax.net
> > > >
> > > > wrote:
> > > > > > >
> > > > > > > Hi folks,
> > > > > > >
> > > > > > > Several contributors asked an update about NoSQL support in
> > Apache
> > > > Polaris.
> > > > > > >
> > > > > > > Now that Polaris 1.0 is almost there :) I propose to have a
> > meeting
> > > > to
> > > > > > > resume the discussion.
> > > > > > >
> > > > > > > I scheduled a community meeting for July 17th 9am PST:
> > > > > > >
> > > > > > > https://calendar.app.google/8gBEGDxq2vqoQePz5
> > > > > > >
> > > > > > > If you are in the Polaris group, you should have received the
> > > invite
> > > > already.
> > > > > > >
> > > > > > > Thoughts ?
> > > > > > >
> > > > > > > Thanks !
> > > > > > > Regards
> > > > > > > JB
> > > >
> > >
> >

Re: [Community Meeting] NoSQL Support in Apache Polaris

Posted by Dmitri Bourlatchkov <di...@apache.org>.
Re: Spanner: The NoSQL proposal can certainly be extended to Spanner.

However, if the question is about Byron's Spanner Persistence
implementation as discussed in the last Community sync, I believe that work
is not related to the NoSQL proposal (and we do not even have a PR for it
yet).

Cheers,
Dmitri.


On Wed, Jul 9, 2025 at 4:07 PM Adam Christian
<ad...@dremio.com.invalid> wrote:

> This meeting is to:
> 1. Walkthrough this proposal
>
> https://docs.google.com/document/d/1POUWe0xMZOBoaJ6Rgiw35ziEoc6OEYCiW7Zk6bR9H6M/edit?tab=t.0#heading=h.nx9vzhg2x8v2
> 2. Maybe, look at some of the high-level modules in the draft PR
> https://github.com/apache/polaris/pull/1189
>
> In regards to Spanner, this proposal handles most databases that can:
> 1. Do single-row compare-and-swap
> 2. Do optimized point queries
>
> So, I would expect that Spanner could be covered under this, but right now,
> it's not an explicit goal.
>
> Go team,
>
> Adam Christian
> Principal Software Engineer
> adam.christian@dremio.com
> LinkedIn Profile <https://www.linkedin.com/in/adam-christian-40309824/>
>
> <https://hello.dremio.com/email-signature-url>
>
>
>
> On Wed, Jul 9, 2025 at 11:37 AM Eric Maynard <er...@gmail.com>
> wrote:
>
> > I know that there was a spanner implementation mentioned in a recent
> > community sync, is that also part of the same discussion?
> >
> > On Wed, Jul 9, 2025 at 11:12 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> > wrote:
> >
> > > Actually the invite was not correct: the meeting is on 7/17 as
> > > originally in my first email.
> > >
> > > Sorry for the confusion.
> > >
> > > Regards
> > > JB
> > >
> > > On Wed, Jul 9, 2025 at 2:06 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
> > > wrote:
> > > >
> > > > My bad, yes, it's 7/16.
> > > >
> > > > Regards
> > > > JB
> > > >
> > > > On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp <sn...@snazy.de> wrote:
> > > > >
> > > > > The invite says July 16th?
> > > > >
> > > > > On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré <
> jb@nanthrax.net
> > >
> > > wrote:
> > > > > >
> > > > > > Hi folks,
> > > > > >
> > > > > > Several contributors asked an update about NoSQL support in
> Apache
> > > Polaris.
> > > > > >
> > > > > > Now that Polaris 1.0 is almost there :) I propose to have a
> meeting
> > > to
> > > > > > resume the discussion.
> > > > > >
> > > > > > I scheduled a community meeting for July 17th 9am PST:
> > > > > >
> > > > > > https://calendar.app.google/8gBEGDxq2vqoQePz5
> > > > > >
> > > > > > If you are in the Polaris group, you should have received the
> > invite
> > > already.
> > > > > >
> > > > > > Thoughts ?
> > > > > >
> > > > > > Thanks !
> > > > > > Regards
> > > > > > JB
> > >
> >
>

Re: [Community Meeting] NoSQL Support in Apache Polaris

Posted by Adam Christian <ad...@dremio.com.INVALID>.
This meeting is to:
1. Walkthrough this proposal
https://docs.google.com/document/d/1POUWe0xMZOBoaJ6Rgiw35ziEoc6OEYCiW7Zk6bR9H6M/edit?tab=t.0#heading=h.nx9vzhg2x8v2
2. Maybe, look at some of the high-level modules in the draft PR
https://github.com/apache/polaris/pull/1189

In regards to Spanner, this proposal handles most databases that can:
1. Do single-row compare-and-swap
2. Do optimized point queries

So, I would expect that Spanner could be covered under this, but right now,
it's not an explicit goal.

Go team,

Adam Christian
Principal Software Engineer
adam.christian@dremio.com
LinkedIn Profile <https://www.linkedin.com/in/adam-christian-40309824/>

<https://hello.dremio.com/email-signature-url>



On Wed, Jul 9, 2025 at 11:37 AM Eric Maynard <er...@gmail.com>
wrote:

> I know that there was a spanner implementation mentioned in a recent
> community sync, is that also part of the same discussion?
>
> On Wed, Jul 9, 2025 at 11:12 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
>
> > Actually the invite was not correct: the meeting is on 7/17 as
> > originally in my first email.
> >
> > Sorry for the confusion.
> >
> > Regards
> > JB
> >
> > On Wed, Jul 9, 2025 at 2:06 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
> > wrote:
> > >
> > > My bad, yes, it's 7/16.
> > >
> > > Regards
> > > JB
> > >
> > > On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp <sn...@snazy.de> wrote:
> > > >
> > > > The invite says July 16th?
> > > >
> > > > On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré <jb@nanthrax.net
> >
> > wrote:
> > > > >
> > > > > Hi folks,
> > > > >
> > > > > Several contributors asked an update about NoSQL support in Apache
> > Polaris.
> > > > >
> > > > > Now that Polaris 1.0 is almost there :) I propose to have a meeting
> > to
> > > > > resume the discussion.
> > > > >
> > > > > I scheduled a community meeting for July 17th 9am PST:
> > > > >
> > > > > https://calendar.app.google/8gBEGDxq2vqoQePz5
> > > > >
> > > > > If you are in the Polaris group, you should have received the
> invite
> > already.
> > > > >
> > > > > Thoughts ?
> > > > >
> > > > > Thanks !
> > > > > Regards
> > > > > JB
> >
>

Re: [Community Meeting] NoSQL Support in Apache Polaris

Posted by Eric Maynard <er...@gmail.com>.
I know that there was a spanner implementation mentioned in a recent
community sync, is that also part of the same discussion?

On Wed, Jul 9, 2025 at 11:12 AM Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:

> Actually the invite was not correct: the meeting is on 7/17 as
> originally in my first email.
>
> Sorry for the confusion.
>
> Regards
> JB
>
> On Wed, Jul 9, 2025 at 2:06 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> >
> > My bad, yes, it's 7/16.
> >
> > Regards
> > JB
> >
> > On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp <sn...@snazy.de> wrote:
> > >
> > > The invite says July 16th?
> > >
> > > On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> > > >
> > > > Hi folks,
> > > >
> > > > Several contributors asked an update about NoSQL support in Apache
> Polaris.
> > > >
> > > > Now that Polaris 1.0 is almost there :) I propose to have a meeting
> to
> > > > resume the discussion.
> > > >
> > > > I scheduled a community meeting for July 17th 9am PST:
> > > >
> > > > https://calendar.app.google/8gBEGDxq2vqoQePz5
> > > >
> > > > If you are in the Polaris group, you should have received the invite
> already.
> > > >
> > > > Thoughts ?
> > > >
> > > > Thanks !
> > > > Regards
> > > > JB
>

Re: [Community Meeting] NoSQL Support in Apache Polaris

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Actually the invite was not correct: the meeting is on 7/17 as
originally in my first email.

Sorry for the confusion.

Regards
JB

On Wed, Jul 9, 2025 at 2:06 PM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
> My bad, yes, it's 7/16.
>
> Regards
> JB
>
> On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp <sn...@snazy.de> wrote:
> >
> > The invite says July 16th?
> >
> > On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> > >
> > > Hi folks,
> > >
> > > Several contributors asked an update about NoSQL support in Apache Polaris.
> > >
> > > Now that Polaris 1.0 is almost there :) I propose to have a meeting to
> > > resume the discussion.
> > >
> > > I scheduled a community meeting for July 17th 9am PST:
> > >
> > > https://calendar.app.google/8gBEGDxq2vqoQePz5
> > >
> > > If you are in the Polaris group, you should have received the invite already.
> > >
> > > Thoughts ?
> > >
> > > Thanks !
> > > Regards
> > > JB

Re: [Community Meeting] NoSQL Support in Apache Polaris

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
My bad, yes, it's 7/16.

Regards
JB

On Wed, Jul 9, 2025 at 2:04 PM Robert Stupp <sn...@snazy.de> wrote:
>
> The invite says July 16th?
>
> On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
> >
> > Hi folks,
> >
> > Several contributors asked an update about NoSQL support in Apache Polaris.
> >
> > Now that Polaris 1.0 is almost there :) I propose to have a meeting to
> > resume the discussion.
> >
> > I scheduled a community meeting for July 17th 9am PST:
> >
> > https://calendar.app.google/8gBEGDxq2vqoQePz5
> >
> > If you are in the Polaris group, you should have received the invite already.
> >
> > Thoughts ?
> >
> > Thanks !
> > Regards
> > JB

Re: [Community Meeting] NoSQL Support in Apache Polaris

Posted by Robert Stupp <sn...@snazy.de>.
The invite says July 16th?

On Wed, Jul 9, 2025 at 8:02 PM Jean-Baptiste Onofré <jb...@nanthrax.net> wrote:
>
> Hi folks,
>
> Several contributors asked an update about NoSQL support in Apache Polaris.
>
> Now that Polaris 1.0 is almost there :) I propose to have a meeting to
> resume the discussion.
>
> I scheduled a community meeting for July 17th 9am PST:
>
> https://calendar.app.google/8gBEGDxq2vqoQePz5
>
> If you are in the Polaris group, you should have received the invite already.
>
> Thoughts ?
>
> Thanks !
> Regards
> JB