You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Sanjay Rao <ge...@live.com> on 2016/08/08 06:13:01 UTC
Arrow client C++ Samples with Arrow APIs for Research work
Hi,
I am looking for some C++ Samples which I can get started with, with Arrow APIs.
Any samples like
Top N AlgorithmComplex Key-Value Pair search.
Thanks,Sanjay
Re: Arrow client C++ Samples with Arrow APIs for Research work
Posted by Wes McKinney <we...@gmail.com>.
Critically, the data structures offer APIs to access to the internal
contiguous memory buffers in each array:
e.g.
https://github.com/apache/arrow/blob/master/cpp/src/arrow/types/primitive.h#L89
That the library operates with contiguous arrays as primitive unit of data
is what makes the access paths "vectorized" / "array-oriented" versus
"scalar" (one value at a time).
- Wes
On Tue, Aug 9, 2016 at 8:44 AM, Philip <br...@gmail.com> wrote:
> Hi Sanjay,
>
> Vectorized access is in many places. Just poke around the source and have
> a look!
>
> You can see examples of the use of std::vector, if that's what you mean,
> in the implementation of Column in https://github.com/apache/
> arrow/blob/master/cpp/src/arrow/column.cc
>
> Another answer is that hardware acceleration ("vectorization") is active
> when the ARROW_SSE3 option (x86) or ARROW_ALTIVEC option (power) is on.
> Those are turned on here: https://github.com/apache/arrow/blob/master/cpp/
> CMakeLists.txt#L83-L89
>
> Philip
>
> On Tue, Aug 9, 2016 at 1:46 AM, Sanjay Rao <ge...@live.com> wrote:
>
>> Thanks Julien,
>> Can you please point me in source code(or name of CPP file) where can I
>> see what Vectorized access is currently in place for Arrow ?
>> Thanks,Sanjay
>>
>> > From: julien@dremio.com
>> > Date: Mon, 8 Aug 2016 15:49:35 -0700
>> > Subject: Re: Arrow client C++ Samples with Arrow APIs for Research work
>> > To: dev@arrow.apache.org
>> >
>> > Hi Sanjay,
>> > Arrow is focusing on the format and vectorized access.
>> > For now there is no higher level algorithm in Arrow itself.
>> >
>> >
>> > On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com>
>> wrote:
>> >
>> > > Hi,
>> > > I am looking for some C++ Samples which I can get started with, with
>> Arrow
>> > > APIs.
>> > > Any samples like
>> > > Top N AlgorithmComplex Key-Value Pair search.
>> > > Thanks,Sanjay
>> >
>> >
>> >
>> >
>> > --
>> > Julien
>>
>>
>
>
Re: Arrow client C++ Samples with Arrow APIs for Research work
Posted by Philip <br...@gmail.com>.
Hi Sanjay,
Vectorized access is in many places. Just poke around the source and have a
look!
You can see examples of the use of std::vector, if that's what you mean, in
the implementation of Column in
https://github.com/apache/arrow/blob/master/cpp/src/arrow/column.cc
Another answer is that hardware acceleration ("vectorization") is active
when the ARROW_SSE3 option (x86) or ARROW_ALTIVEC option (power) is on.
Those are turned on here:
https://github.com/apache/arrow/blob/master/cpp/CMakeLists.txt#L83-L89
Philip
On Tue, Aug 9, 2016 at 1:46 AM, Sanjay Rao <ge...@live.com> wrote:
> Thanks Julien,
> Can you please point me in source code(or name of CPP file) where can I
> see what Vectorized access is currently in place for Arrow ?
> Thanks,Sanjay
>
> > From: julien@dremio.com
> > Date: Mon, 8 Aug 2016 15:49:35 -0700
> > Subject: Re: Arrow client C++ Samples with Arrow APIs for Research work
> > To: dev@arrow.apache.org
> >
> > Hi Sanjay,
> > Arrow is focusing on the format and vectorized access.
> > For now there is no higher level algorithm in Arrow itself.
> >
> >
> > On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com>
> wrote:
> >
> > > Hi,
> > > I am looking for some C++ Samples which I can get started with, with
> Arrow
> > > APIs.
> > > Any samples like
> > > Top N AlgorithmComplex Key-Value Pair search.
> > > Thanks,Sanjay
> >
> >
> >
> >
> > --
> > Julien
>
>
RE: Arrow client C++ Samples with Arrow APIs for Research work
Posted by Sanjay Rao <ge...@live.com>.
Thanks Julien,
Can you please point me in source code(or name of CPP file) where can I see what Vectorized access is currently in place for Arrow ?
Thanks,Sanjay
> From: julien@dremio.com
> Date: Mon, 8 Aug 2016 15:49:35 -0700
> Subject: Re: Arrow client C++ Samples with Arrow APIs for Research work
> To: dev@arrow.apache.org
>
> Hi Sanjay,
> Arrow is focusing on the format and vectorized access.
> For now there is no higher level algorithm in Arrow itself.
>
>
> On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com> wrote:
>
> > Hi,
> > I am looking for some C++ Samples which I can get started with, with Arrow
> > APIs.
> > Any samples like
> > Top N AlgorithmComplex Key-Value Pair search.
> > Thanks,Sanjay
>
>
>
>
> --
> Julien
Re: Arrow client C++ Samples with Arrow APIs for Research work
Posted by Julien Le Dem <ju...@dremio.com>.
Hi Sanjay,
Arrow is focusing on the format and vectorized access.
For now there is no higher level algorithm in Arrow itself.
On Sun, Aug 7, 2016 at 11:13 PM, Sanjay Rao <ge...@live.com> wrote:
> Hi,
> I am looking for some C++ Samples which I can get started with, with Arrow
> APIs.
> Any samples like
> Top N AlgorithmComplex Key-Value Pair search.
> Thanks,Sanjay
--
Julien