You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by Utkarsh Sengar <ut...@gmail.com> on 2013/04/02 00:34:30 UTC

Getting started with solr 4.2 and cassandra

Hello,

I am evaluating solr 4.2 and ElasticSearch (I am new to both) for a search
API, where data sits in cassandra.

Getting started with elasticsearch is pretty straight forward and I was
able to write an ES
"river<http://www.elasticsearch.org/guide/reference/river/>"
which pulls data from cassandra and indexes it in ES within a day.

Now, I trying to implement something similar with solr and compare both of
them.

Getting started with
solr/example<http://lucene.apache.org/solr/4_2_0/tutorial.html>was
pretty easy and an example solr instance works. But the example folder
contains whole bunch of stuff which I am not sure if I need:
http://pastebin.com/Gv660mRT . I am sure I don't need 53 directories and
527 files

So my questions are:
1. How can I create a bare bone solr app up and running with minimum set of
configuration? (I will build over it when needed by taking reference from
/example)
2. What is a best practice to run solr in production? Am approach like this
jetty+nginx recommended:
http://sacharya.com/nginx-proxy-to-jetty-for-java-apps/ ?

Once I am done setting up a simple solr instance:
3. What is the general practice to import data to solr? For now, I am
writing a python script which will read data in bulk from cassandra and
throw it to solr.

-- 
Thanks,
-Utkarsh

Re: Getting started with solr 4.2 and cassandra

Posted by Otis Gospodnetic <ot...@gmail.com>.

Hi,

Solr doesn't have anything like ES River.  DIH (DataImportHandler)
feels like the closest thing in Solr, though it's not quite the same
thing.  DIH pulls in data like a typical River does, but most people
have external indexers that push data into Solr using one of its
client libraries to talk to Solr, such as SolrJ.

Otis
--
Solr & ElasticSearch Support
http://sematext.com/





On Mon, Apr 1, 2013 at 6:34 PM, Utkarsh Sengar <ut...@gmail.com> wrote:
> Hello,
>
> I am evaluating solr 4.2 and ElasticSearch (I am new to both) for a search
> API, where data sits in cassandra.
>
> Getting started with elasticsearch is pretty straight forward and I was
> able to write an ES
> "river<http://www.elasticsearch.org/guide/reference/river/>"
> which pulls data from cassandra and indexes it in ES within a day.
>
> Now, I trying to implement something similar with solr and compare both of
> them.
>
> Getting started with
> solr/example<http://lucene.apache.org/solr/4_2_0/tutorial.html>was
> pretty easy and an example solr instance works. But the example folder
> contains whole bunch of stuff which I am not sure if I need:
> http://pastebin.com/Gv660mRT . I am sure I don't need 53 directories and
> 527 files
>
> So my questions are:
> 1. How can I create a bare bone solr app up and running with minimum set of
> configuration? (I will build over it when needed by taking reference from
> /example)
> 2. What is a best practice to run solr in production? Am approach like this
> jetty+nginx recommended:
> http://sacharya.com/nginx-proxy-to-jetty-for-java-apps/ ?
>
> Once I am done setting up a simple solr instance:
> 3. What is the general practice to import data to solr? For now, I am
> writing a python script which will read data in bulk from cassandra and
> throw it to solr.
>
> --
> Thanks,
> -Utkarsh

Re: Getting started with solr 4.2 and cassandra

Posted by Jack Krupansky <ja...@basetechnology.com>.

The Solr example really is rather simple. Download, unzip, run, add data, 
query. It's really that simple. Make sure you are looking at the Solr 
tutorial:

http://lucene.apache.org/solr/4_2_0/tutorial.html

Download from here:
http://lucene.apache.org/solr/tutorial.html

-- Jack Krupansky

-----Original Message----- 
From: Utkarsh Sengar
Sent: Monday, April 01, 2013 7:41 PM
To: solr-user@lucene.apache.org
Subject: Re: Getting started with solr 4.2 and cassandra

Thanks for the reply. So DSE is one of the options and I am looking into
that too.
Although, before diving into solr+cassandra integration (which comes out of
the box with DSE).

I am just trying to setup a solr instance on my local machine without the
bloat the "example" solr instance has to offer. Any suggestions about that?

Thanks,
-Utkarsh


On Mon, Apr 1, 2013 at 4:00 PM, Jack Krupansky 
<ja...@basetechnology.com>wrote:

> You might want to check out DataStax Enterprise, which actually integrates
> Cassandra and Solr. You keep the data in Cassandra, but as data is added
> and updated and deleted, the Solr index is automatically updated in
> parallel. You can add and update data and query using either the Cassandra
> API or the Solr API.
>
> See:
> http://www.datastax.com/what-**we-offer/products-services/**
> datastax-enterprise<http://www.datastax.com/what-we-offer/products-services/datastax-enterprise>
>
> -- Jack Krupansky
>
> -----Original Message----- From: Utkarsh Sengar
> Sent: Monday, April 01, 2013 6:34 PM
> To: solr-user@lucene.apache.org
> Subject: Getting started with solr 4.2 and cassandra
>
>
> Hello,
>
> I am evaluating solr 4.2 and ElasticSearch (I am new to both) for a search
> API, where data sits in cassandra.
>
> Getting started with elasticsearch is pretty straight forward and I was
> able to write an ES
> "river<http://www.**elasticsearch.org/guide/**reference/river/<http://www.elasticsearch.org/guide/reference/river/>
> >"
>
> which pulls data from cassandra and indexes it in ES within a day.
>
> Now, I trying to implement something similar with solr and compare both of
> them.
>
> Getting started with
> solr/example<http://lucene.**apache.org/solr/4_2_0/**tutorial.html<http://lucene.apache.org/solr/4_2_0/tutorial.html>
> >was
>
> pretty easy and an example solr instance works. But the example folder
> contains whole bunch of stuff which I am not sure if I need:
> http://pastebin.com/Gv660mRT . I am sure I don't need 53 directories and
> 527 files
>
> So my questions are:
> 1. How can I create a bare bone solr app up and running with minimum set 
> of
> configuration? (I will build over it when needed by taking reference from
> /example)
> 2. What is a best practice to run solr in production? Am approach like 
> this
> jetty+nginx recommended:
> http://sacharya.com/nginx-**proxy-to-jetty-for-java-apps/<http://sacharya.com/nginx-proxy-to-jetty-for-java-apps/>?
>
> Once I am done setting up a simple solr instance:
> 3. What is the general practice to import data to solr? For now, I am
> writing a python script which will read data in bulk from cassandra and
> throw it to solr.
>
> --
> Thanks,
> -Utkarsh
>



-- 
Thanks,
-Utkarsh

Re: Getting started with solr 4.2 and cassandra

Posted by Utkarsh Sengar <ut...@gmail.com>.

Thanks for the reply. So DSE is one of the options and I am looking into
that too.
Although, before diving into solr+cassandra integration (which comes out of
the box with DSE).

I am just trying to setup a solr instance on my local machine without the
bloat the "example" solr instance has to offer. Any suggestions about that?

Thanks,
-Utkarsh


On Mon, Apr 1, 2013 at 4:00 PM, Jack Krupansky <ja...@basetechnology.com>wrote:

> You might want to check out DataStax Enterprise, which actually integrates
> Cassandra and Solr. You keep the data in Cassandra, but as data is added
> and updated and deleted, the Solr index is automatically updated in
> parallel. You can add and update data and query using either the Cassandra
> API or the Solr API.
>
> See:
> http://www.datastax.com/what-**we-offer/products-services/**
> datastax-enterprise<http://www.datastax.com/what-we-offer/products-services/datastax-enterprise>
>
> -- Jack Krupansky
>
> -----Original Message----- From: Utkarsh Sengar
> Sent: Monday, April 01, 2013 6:34 PM
> To: solr-user@lucene.apache.org
> Subject: Getting started with solr 4.2 and cassandra
>
>
> Hello,
>
> I am evaluating solr 4.2 and ElasticSearch (I am new to both) for a search
> API, where data sits in cassandra.
>
> Getting started with elasticsearch is pretty straight forward and I was
> able to write an ES
> "river<http://www.**elasticsearch.org/guide/**reference/river/<http://www.elasticsearch.org/guide/reference/river/>
> >"
>
> which pulls data from cassandra and indexes it in ES within a day.
>
> Now, I trying to implement something similar with solr and compare both of
> them.
>
> Getting started with
> solr/example<http://lucene.**apache.org/solr/4_2_0/**tutorial.html<http://lucene.apache.org/solr/4_2_0/tutorial.html>
> >was
>
> pretty easy and an example solr instance works. But the example folder
> contains whole bunch of stuff which I am not sure if I need:
> http://pastebin.com/Gv660mRT . I am sure I don't need 53 directories and
> 527 files
>
> So my questions are:
> 1. How can I create a bare bone solr app up and running with minimum set of
> configuration? (I will build over it when needed by taking reference from
> /example)
> 2. What is a best practice to run solr in production? Am approach like this
> jetty+nginx recommended:
> http://sacharya.com/nginx-**proxy-to-jetty-for-java-apps/<http://sacharya.com/nginx-proxy-to-jetty-for-java-apps/>?
>
> Once I am done setting up a simple solr instance:
> 3. What is the general practice to import data to solr? For now, I am
> writing a python script which will read data in bulk from cassandra and
> throw it to solr.
>
> --
> Thanks,
> -Utkarsh
>



-- 
Thanks,
-Utkarsh

Re: Getting started with solr 4.2 and cassandra

Posted by Jack Krupansky <ja...@basetechnology.com>.

You might want to check out DataStax Enterprise, which actually integrates 
Cassandra and Solr. You keep the data in Cassandra, but as data is added and 
updated and deleted, the Solr index is automatically updated in parallel. 
You can add and update data and query using either the Cassandra API or the 
Solr API.

See:
http://www.datastax.com/what-we-offer/products-services/datastax-enterprise

-- Jack Krupansky

-----Original Message----- 
From: Utkarsh Sengar
Sent: Monday, April 01, 2013 6:34 PM
To: solr-user@lucene.apache.org
Subject: Getting started with solr 4.2 and cassandra

Hello,

I am evaluating solr 4.2 and ElasticSearch (I am new to both) for a search
API, where data sits in cassandra.

Getting started with elasticsearch is pretty straight forward and I was
able to write an ES
"river<http://www.elasticsearch.org/guide/reference/river/>"
which pulls data from cassandra and indexes it in ES within a day.

Now, I trying to implement something similar with solr and compare both of
them.

Getting started with
solr/example<http://lucene.apache.org/solr/4_2_0/tutorial.html>was
pretty easy and an example solr instance works. But the example folder
contains whole bunch of stuff which I am not sure if I need:
http://pastebin.com/Gv660mRT . I am sure I don't need 53 directories and
527 files

So my questions are:
1. How can I create a bare bone solr app up and running with minimum set of
configuration? (I will build over it when needed by taking reference from
/example)
2. What is a best practice to run solr in production? Am approach like this
jetty+nginx recommended:
http://sacharya.com/nginx-proxy-to-jetty-for-java-apps/ ?

Once I am done setting up a simple solr instance:
3. What is the general practice to import data to solr? For now, I am
writing a python script which will read data in bulk from cassandra and
throw it to solr.

-- 
Thanks,
-Utkarsh