You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Wes McKinney <we...@gmail.com> on 2020/02/05 17:37:16 UTC

[DISCUSS] Volunteers needed to complete work necessary for Arrow 1.0.0 milestone

hi folks,

Unfortunately, we have stalled a bit on making progress toward a 1.0.0 release.

There are a few keys areas in the columnar format that need to be
reconciled in Java and C++

* Null type
* Union types
* Large binary, unicode, and list types
* Dictionary deltas and replacements

(for the record, I do not think any other tasks should be "blocking"
for 1.0.0 aside from these items, including code / API cleanups, etc.)

On the last item, I am concerned that our current JSON format is not
adequate to describe deltas and replacements. The problem is that
there is no relative ordering specified for the dictionary and record
batch messages. Ideas for solutions about this would be welcome.

In past e-mail discussions, we agreed that we want to have
feature/integration test completeness at least in Java and C++ to make
the 1.0.0 release. Given that C++ has more regular contributors and PR
reviewers, I'm less concerned about the C++ work getting done than the
Java work. Should we set some kind of time horizon (e.g. somewhere
around June 2020?) that if we are still too far away in the Java
library that we re-evaluate criteria for being able to declare the
1.0.0 release?

Thanks,
Wes