You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Julien Le Dem <ju...@dremio.com> on 2016/08/08 22:49:35 UTC
Re: Arrow client C++ Samples with Arrow APIs for Research work
Hi Sanjay,
Arrow is focusing on the format and vectorized access.
For now there is no higher level algorithm in Arrow itself.
On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com> wrote:
> Hi,
> I am looking for some C++ Samples which I can get started with, with Arrow
> APIs.
> Any samples like
> Top N AlgorithmComplex Key-Value Pair search.
> Thanks,Sanjay
--
Julien
Re: Arrow client C++ Samples with Arrow APIs for Research work
Posted by Wes McKinney <we...@gmail.com>.
Critically, the data structures offer APIs to access to the internal
contiguous memory buffers in each array:
e.g.
https://github.com/apache/arrow/blob/master/cpp/src/arrow/types/primitive.h#L89
That the library operates with contiguous arrays as primitive unit of data
is what makes the access paths "vectorized" / "array-oriented" versus
"scalar" (one value at a time).
- Wes
On Tue, Aug 9, 2016 at 8:44 AM, Philip <br...@gmail.com> wrote:
> Hi Sanjay,
>
> Vectorized access is in many places. Just poke around the source and have
> a look!
>
> You can see examples of the use of std::vector, if that's what you mean,
> in the implementation of Column in https://github.com/apache/
> arrow/blob/master/cpp/src/arrow/column.cc
>
> Another answer is that hardware acceleration ("vectorization") is active
> when the ARROW_SSE3 option (x86) or ARROW_ALTIVEC option (power) is on.
> Those are turned on here: https://github.com/apache/arrow/blob/master/cpp/
> CMakeLists.txt#L83-L89
>
> Philip
>
> On Tue, Aug 9, 2016 at 1:46 AM, Sanjay Rao <ge...@live.com> wrote:
>
>> Thanks Julien,
>> Can you please point me in source code(or name of CPP file) where can I
>> see what Vectorized access is currently in place for Arrow ?
>> Thanks,Sanjay
>>
>> > From: julien@dremio.com
>> > Date: Mon, 8 Aug 2016 15:49:35 -0700
>> > Subject: Re: Arrow client C++ Samples with Arrow APIs for Research work
>> > To: dev@arrow.apache.org
>> >
>> > Hi Sanjay,
>> > Arrow is focusing on the format and vectorized access.
>> > For now there is no higher level algorithm in Arrow itself.
>> >
>> >
>> > On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com>
>> wrote:
>> >
>> > > Hi,
>> > > I am looking for some C++ Samples which I can get started with, with
>> Arrow
>> > > APIs.
>> > > Any samples like
>> > > Top N AlgorithmComplex Key-Value Pair search.
>> > > Thanks,Sanjay
>> >
>> >
>> >
>> >
>> > --
>> > Julien
>>
>>
>
>
Re: Arrow client C++ Samples with Arrow APIs for Research work
Posted by Philip <br...@gmail.com>.
Hi Sanjay,
Vectorized access is in many places. Just poke around the source and have a
look!
You can see examples of the use of std::vector, if that's what you mean, in
the implementation of Column in
https://github.com/apache/arrow/blob/master/cpp/src/arrow/column.cc
Another answer is that hardware acceleration ("vectorization") is active
when the ARROW_SSE3 option (x86) or ARROW_ALTIVEC option (power) is on.
Those are turned on here:
https://github.com/apache/arrow/blob/master/cpp/CMakeLists.txt#L83-L89
Philip
On Tue, Aug 9, 2016 at 1:46 AM, Sanjay Rao <ge...@live.com> wrote:
> Thanks Julien,
> Can you please point me in source code(or name of CPP file) where can I
> see what Vectorized access is currently in place for Arrow ?
> Thanks,Sanjay
>
> > From: julien@dremio.com
> > Date: Mon, 8 Aug 2016 15:49:35 -0700
> > Subject: Re: Arrow client C++ Samples with Arrow APIs for Research work
> > To: dev@arrow.apache.org
> >
> > Hi Sanjay,
> > Arrow is focusing on the format and vectorized access.
> > For now there is no higher level algorithm in Arrow itself.
> >
> >
> > On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com>
> wrote:
> >
> > > Hi,
> > > I am looking for some C++ Samples which I can get started with, with
> Arrow
> > > APIs.
> > > Any samples like
> > > Top N AlgorithmComplex Key-Value Pair search.
> > > Thanks,Sanjay
> >
> >
> >
> >
> > --
> > Julien
>
>
RE: Arrow client C++ Samples with Arrow APIs for Research work
Posted by Sanjay Rao <ge...@live.com>.
Thanks Julien,
Can you please point me in source code(or name of CPP file) where can I see what Vectorized access is currently in place for Arrow ?
Thanks,Sanjay
> From: julien@dremio.com
> Date: Mon, 8 Aug 2016 15:49:35 -0700
> Subject: Re: Arrow client C++ Samples with Arrow APIs for Research work
> To: dev@arrow.apache.org
>
> Hi Sanjay,
> Arrow is focusing on the format and vectorized access.
> For now there is no higher level algorithm in Arrow itself.
>
>
> On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com> wrote:
>
> > Hi,
> > I am looking for some C++ Samples which I can get started with, with Arrow
> > APIs.
> > Any samples like
> > Top N AlgorithmComplex Key-Value Pair search.
> > Thanks,Sanjay
>
>
>
>
> --
> Julien