Thoughts on Indexing

["Ross, Alan D" <al...@intel.com>]

So we have a few different options being talked about for indexing our data to make searches faster.

Do we have any environments set up that we can test with?  I'm willing to echo some queries somewhere else alongside impala if anything is up and running and come back with some comparisons on time along with usability.

RE: Thoughts on Indexing

["Ross, Alan D" <al...@intel.com>]

Hey Mark,

We are getting SOLR up and running at the moment but are evaluating some other options including Elasticsearch and reading on things like Druid but that would take an architecture change I'm not sure we're ready to take on.  Also want to investigate pyspark, looking for volunteers :)

Once we have SOLR going we'll provide some data back in the form of a report that highlights our findings.  

Alan

-----Original Message-----
From: grover.markgrover@gmail.com [mailto:grover.markgrover@gmail.com] On Behalf Of Mark Grover
Sent: Monday, October 10, 2016 3:11 PM
To: dev@spot.incubator.apache.org
Subject: Re: Thoughts on Indexing

Yeah, I think we haven't really thought much about infra for Spot, so I don't have much to offer.

Although I am curious as to what options for indexing are being considered.
I'd love to hear.

Mark

On Mon, Oct 10, 2016 at 10:55 AM, Ross, Alan D <al...@intel.com>
wrote:

> So we have a few different options being talked about for indexing our 
> data to make searches faster.
>
> Do we have any environments set up that we can test with?  I'm willing 
> to echo some queries somewhere else alongside impala if anything is up 
> and running and come back with some comparisons on time along with usability.
>
>
>

Re: Thoughts on Indexing

[Mark Grover <ma...@apache.org>]

Yeah, I think we haven't really thought much about infra for Spot, so I
don't have much to offer.

Although I am curious as to what options for indexing are being considered.
I'd love to hear.

Mark

On Mon, Oct 10, 2016 at 10:55 AM, Ross, Alan D <al...@intel.com>
wrote:

> So we have a few different options being talked about for indexing our
> data to make searches faster.
>
> Do we have any environments set up that we can test with?  I'm willing to
> echo some queries somewhere else alongside impala if anything is up and
> running and come back with some comparisons on time along with usability.
>
>
>