You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@accumulo.apache.org by Jamie Johnson <je...@gmail.com> on 2016/02/09 13:01:05 UTC
Searching d4m based table
Is there documentation describing what types of searches perform well on a
d4m based table? Any examples?
Re: Searching d4m based table
Posted by Dylan Hutchison <dh...@uw.edu>.
Hi Jamie,
Take a look at the examples under directories 3Scaling and 2Apps in the D4M
distribution <https://github.com/Accla/d4m>, or at a demo on baseball data
here <https://github.com/dhutchis/d4mBB>. Whether you use Matlab/Octave or
not, these examples demonstrate the d4m schema and queries on the d4m
schema that you can use when talking to Accumulo.
Regards, Dylan
On Tue, Feb 9, 2016 at 2:10 PM, Jamie Johnson <je...@gmail.com> wrote:
> Thanks Jeremy, I will give this a read. Are there any sample projects
> that demonstrate these types of queries?
>
> On Tue, Feb 9, 2016 at 9:59 AM, Jeremy Kepner <ke...@ll.mit.edu> wrote:
>
>> Graphs and graph traversals.
>> Exact match and range queries.
>>
>> If the data set is large and you are concerned about a particular
>> query returning a lot of data then it is important to create a degree
>> table
>> that maintains the count of each unique entry in the d4m table.
>> You can then query the degree table first to get an estimate of how
>> big the results will be prior to actually performing the query.
>>
>> Here are some papers that might be helpful:
>>
>> http://arxiv.org/abs/1407.3859
>> http://arxiv.org/abs/1507.01066
>> http://arxiv.org/abs/1407.6923
>> http://arxiv.org/abs/1406.4923
>>
>>
>> On Tue, Feb 09, 2016 at 07:01:05AM -0500, Jamie Johnson wrote:
>> > Is there documentation describing what types of searches perform well
>> on a
>> > d4m based table? Any examples?
>>
>
>
Re: Searching d4m based table
Posted by Jamie Johnson <je...@gmail.com>.
Thanks Jeremy, I will give this a read. Are there any sample projects that
demonstrate these types of queries?
On Tue, Feb 9, 2016 at 9:59 AM, Jeremy Kepner <ke...@ll.mit.edu> wrote:
> Graphs and graph traversals.
> Exact match and range queries.
>
> If the data set is large and you are concerned about a particular
> query returning a lot of data then it is important to create a degree table
> that maintains the count of each unique entry in the d4m table.
> You can then query the degree table first to get an estimate of how
> big the results will be prior to actually performing the query.
>
> Here are some papers that might be helpful:
>
> http://arxiv.org/abs/1407.3859
> http://arxiv.org/abs/1507.01066
> http://arxiv.org/abs/1407.6923
> http://arxiv.org/abs/1406.4923
>
>
> On Tue, Feb 09, 2016 at 07:01:05AM -0500, Jamie Johnson wrote:
> > Is there documentation describing what types of searches perform well on
> a
> > d4m based table? Any examples?
>
Re: Searching d4m based table
Posted by Jeremy Kepner <ke...@ll.mit.edu>.
Graphs and graph traversals.
Exact match and range queries.
If the data set is large and you are concerned about a particular
query returning a lot of data then it is important to create a degree table
that maintains the count of each unique entry in the d4m table.
You can then query the degree table first to get an estimate of how
big the results will be prior to actually performing the query.
Here are some papers that might be helpful:
http://arxiv.org/abs/1407.3859
http://arxiv.org/abs/1507.01066
http://arxiv.org/abs/1407.6923
http://arxiv.org/abs/1406.4923
On Tue, Feb 09, 2016 at 07:01:05AM -0500, Jamie Johnson wrote:
> Is there documentation describing what types of searches perform well on a
> d4m based table? Any examples?