You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Antoine Pitrou <an...@python.org> on 2021/02/17 14:48:31 UTC
Cross-endianness IPC support in Arrow C++
Hello,
I would like to announce that we have just merged
https://github.com/apache/arrow/pull/7507, which implements - on the C++
side - endianness conversion when reading IPC data with non-native
endianness.
This means that IPC and Flight communication using Arrow C++ should be
possible between systems with different native endiannesses. This
feature is experimental for now: there are basic integration tests, but
it should be exercised a bit more before we declare it stable.
We've also added an entry in the feature compatibility matrix:
https://github.com/apache/arrow/blob/master/docs/source/status.rst#ipc-format
Regards
Antoine.
Re: Cross-endianness IPC support in Arrow C++
Posted by Micah Kornfield <em...@gmail.com>.
Congrats!
On Wed, Feb 17, 2021 at 4:12 PM Wes McKinney <we...@gmail.com> wrote:
> This is great news! Congrats to everyone who worked on this to make it
> possible. I know that the cross-endianness question was something that
> came up periodically (even though BE systems are increasingly exotic
> nowadays) so it's great that we now have a robust answer
>
> On Wed, Feb 17, 2021 at 8:48 AM Antoine Pitrou <an...@python.org> wrote:
> >
> >
> > Hello,
> >
> > I would like to announce that we have just merged
> > https://github.com/apache/arrow/pull/7507, which implements - on the C++
> > side - endianness conversion when reading IPC data with non-native
> > endianness.
> >
> > This means that IPC and Flight communication using Arrow C++ should be
> > possible between systems with different native endiannesses. This
> > feature is experimental for now: there are basic integration tests, but
> > it should be exercised a bit more before we declare it stable.
> >
> > We've also added an entry in the feature compatibility matrix:
> >
> https://github.com/apache/arrow/blob/master/docs/source/status.rst#ipc-format
> >
> > Regards
> >
> > Antoine.
>
Re: Cross-endianness IPC support in Arrow C++
Posted by Wes McKinney <we...@gmail.com>.
This is great news! Congrats to everyone who worked on this to make it
possible. I know that the cross-endianness question was something that
came up periodically (even though BE systems are increasingly exotic
nowadays) so it's great that we now have a robust answer
On Wed, Feb 17, 2021 at 8:48 AM Antoine Pitrou <an...@python.org> wrote:
>
>
> Hello,
>
> I would like to announce that we have just merged
> https://github.com/apache/arrow/pull/7507, which implements - on the C++
> side - endianness conversion when reading IPC data with non-native
> endianness.
>
> This means that IPC and Flight communication using Arrow C++ should be
> possible between systems with different native endiannesses. This
> feature is experimental for now: there are basic integration tests, but
> it should be exercised a bit more before we declare it stable.
>
> We've also added an entry in the feature compatibility matrix:
> https://github.com/apache/arrow/blob/master/docs/source/status.rst#ipc-format
>
> Regards
>
> Antoine.