You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Weston Pace <we...@gmail.com> on 2022/11/10 01:15:36 UTC
[RFC] Schema Evolution
I've created a document[1] that both describes the general idea of
schema evolution as well as my best guess at how it should work. This
is written from an Acero / datasets perspective but the information
should be generally applicable / accessible.
I am doing some work in the scanner to enable an extension point for
schema evolution but I am probably not going to be implementing this
in the next few months. However, I would like to get to it at some
point in the next year or possibly guide some others on
implementation. So I'd appreciate any feedback or opinions on the doc
before too much work gets done.
[1] https://docs.google.com/document/d/1iWPm8wf6CwJzX6MIFPNzwaaVIjPr1sKRXw1qNr4Jq6c/edit#heading=h.94f33whmotx5
Re: [RFC] Schema Evolution
Posted by Weston Pace <we...@gmail.com>.
Sorry about that. I've enabled it now.
On Wed, Nov 9, 2022, 9:34 PM Micah Kornfield <em...@gmail.com> wrote:
> It doesn't look like comment access is enabled?
>
> On Wed, Nov 9, 2022 at 5:16 PM Weston Pace <we...@gmail.com> wrote:
>
> > I've created a document[1] that both describes the general idea of
> > schema evolution as well as my best guess at how it should work. This
> > is written from an Acero / datasets perspective but the information
> > should be generally applicable / accessible.
> >
> > I am doing some work in the scanner to enable an extension point for
> > schema evolution but I am probably not going to be implementing this
> > in the next few months. However, I would like to get to it at some
> > point in the next year or possibly guide some others on
> > implementation. So I'd appreciate any feedback or opinions on the doc
> > before too much work gets done.
> >
> > [1]
> >
> https://docs.google.com/document/d/1iWPm8wf6CwJzX6MIFPNzwaaVIjPr1sKRXw1qNr4Jq6c/edit#heading=h.94f33whmotx5
> >
>
Re: [RFC] Schema Evolution
Posted by Micah Kornfield <em...@gmail.com>.
It doesn't look like comment access is enabled?
On Wed, Nov 9, 2022 at 5:16 PM Weston Pace <we...@gmail.com> wrote:
> I've created a document[1] that both describes the general idea of
> schema evolution as well as my best guess at how it should work. This
> is written from an Acero / datasets perspective but the information
> should be generally applicable / accessible.
>
> I am doing some work in the scanner to enable an extension point for
> schema evolution but I am probably not going to be implementing this
> in the next few months. However, I would like to get to it at some
> point in the next year or possibly guide some others on
> implementation. So I'd appreciate any feedback or opinions on the doc
> before too much work gets done.
>
> [1]
> https://docs.google.com/document/d/1iWPm8wf6CwJzX6MIFPNzwaaVIjPr1sKRXw1qNr4Jq6c/edit#heading=h.94f33whmotx5
>