You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Vineet Mishra <cl...@gmail.com> on 2014/04/15 12:20:01 UTC
Indexing Big Data With or Without Solr
Hi All,
I have worked with Solr 3.5 to implement real time search on some 100GB
data, that worked fine but was little slow on complex queries(Multiple
group/joined queries).
But now I want to index some real Big Data(around 4 TB or even more), can
SolrCloud be solution for it if not what could be the best possible
solution in this case.
*Stats for the previous Implementation:*
It was Master Slave Architecture with normal Standalone multiple instance
of Solr 3.5. There were around 12 Solr instance running on different
machines.
*Things to consider for the next implementation:*
Since all the data is sensor data hence it is the factor of duplicity and
uniqueness.
*Really urgent, please take the call on priority with set of feasible
solution.*
Regards
Re: Indexing Big Data With or Without Solr
Posted by rulinma <ru...@gmail.com>.
mark.
--
View this message in context: http://lucene.472066.n3.nabble.com/Indexing-Big-Data-With-or-Without-Solr-tp4131215p4133831.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Indexing Big Data With or Without Solr
Posted by Aman Tandon <am...@gmail.com>.
Thanks vineet
With Regards
Aman Tandon
On Wed, Apr 23, 2014 at 7:21 PM, Vineet Mishra <cl...@gmail.com>wrote:
> I did it with Tomcat and Zookeeper Ensemble, will mail you the steps
> shortly.
>
> Cheers
>
>
> On Sat, Apr 19, 2014 at 9:09 AM, Aman Tandon <amantandon.10@gmail.com
> >wrote:
>
> > Vineet please share after you setup for solr cloud
> > Are you using jetty or tomcat.?
> >
> > On Saturday, April 19, 2014, Vineet Mishra <cl...@gmail.com>
> wrote:
> > > Thanks Furkan, I will definitely give it a try then.
> > >
> > > Thanks again!
> > >
> > >
> > >
> > >
> > > On Tue, Apr 15, 2014 at 7:53 PM, Furkan KAMACI <furkankamaci@gmail.com
> > >wrote:
> > >
> > >> Hi Vineet;
> > >>
> > >> I've been using SolrCloud for such kind of Big Data and I think that
> you
> > >> should consider to use it. If you have any problems you can ask it
> here.
> > >>
> > >> Thanks;
> > >> Furkan KAMACI
> > >>
> > >>
> > >> 2014-04-15 13:20 GMT+03:00 Vineet Mishra <cl...@gmail.com>:
> > >>
> > >> > Hi All,
> > >> >
> > >> > I have worked with Solr 3.5 to implement real time search on some
> > 100GB
> > >> > data, that worked fine but was little slow on complex
> queries(Multiple
> > >> > group/joined queries).
> > >> > But now I want to index some real Big Data(around 4 TB or even
> more),
> > can
> > >> > SolrCloud be solution for it if not what could be the best possible
> > >> > solution in this case.
> > >> >
> > >> > *Stats for the previous Implementation:*
> > >> > It was Master Slave Architecture with normal Standalone multiple
> > instance
> > >> > of Solr 3.5. There were around 12 Solr instance running on different
> > >> > machines.
> > >> >
> > >> > *Things to consider for the next implementation:*
> > >> > Since all the data is sensor data hence it is the factor of
> duplicity
> > and
> > >> > uniqueness.
> > >> >
> > >> > *Really urgent, please take the call on priority with set of
> feasible
> > >> > solution.*
> > >> >
> > >> > Regards
> > >> >
> > >>
> > >
> >
> > --
> > Sent from Gmail Mobile
> >
>
Re: Indexing Big Data With or Without Solr
Posted by Vineet Mishra <cl...@gmail.com>.
I did it with Tomcat and Zookeeper Ensemble, will mail you the steps
shortly.
Cheers
On Sat, Apr 19, 2014 at 9:09 AM, Aman Tandon <am...@gmail.com>wrote:
> Vineet please share after you setup for solr cloud
> Are you using jetty or tomcat.?
>
> On Saturday, April 19, 2014, Vineet Mishra <cl...@gmail.com> wrote:
> > Thanks Furkan, I will definitely give it a try then.
> >
> > Thanks again!
> >
> >
> >
> >
> > On Tue, Apr 15, 2014 at 7:53 PM, Furkan KAMACI <furkankamaci@gmail.com
> >wrote:
> >
> >> Hi Vineet;
> >>
> >> I've been using SolrCloud for such kind of Big Data and I think that you
> >> should consider to use it. If you have any problems you can ask it here.
> >>
> >> Thanks;
> >> Furkan KAMACI
> >>
> >>
> >> 2014-04-15 13:20 GMT+03:00 Vineet Mishra <cl...@gmail.com>:
> >>
> >> > Hi All,
> >> >
> >> > I have worked with Solr 3.5 to implement real time search on some
> 100GB
> >> > data, that worked fine but was little slow on complex queries(Multiple
> >> > group/joined queries).
> >> > But now I want to index some real Big Data(around 4 TB or even more),
> can
> >> > SolrCloud be solution for it if not what could be the best possible
> >> > solution in this case.
> >> >
> >> > *Stats for the previous Implementation:*
> >> > It was Master Slave Architecture with normal Standalone multiple
> instance
> >> > of Solr 3.5. There were around 12 Solr instance running on different
> >> > machines.
> >> >
> >> > *Things to consider for the next implementation:*
> >> > Since all the data is sensor data hence it is the factor of duplicity
> and
> >> > uniqueness.
> >> >
> >> > *Really urgent, please take the call on priority with set of feasible
> >> > solution.*
> >> >
> >> > Regards
> >> >
> >>
> >
>
> --
> Sent from Gmail Mobile
>
Re: Indexing Big Data With or Without Solr
Posted by Aman Tandon <am...@gmail.com>.
Vineet please share after you setup for solr cloud
Are you using jetty or tomcat.?
On Saturday, April 19, 2014, Vineet Mishra <cl...@gmail.com> wrote:
> Thanks Furkan, I will definitely give it a try then.
>
> Thanks again!
>
>
>
>
> On Tue, Apr 15, 2014 at 7:53 PM, Furkan KAMACI <furkankamaci@gmail.com
>wrote:
>
>> Hi Vineet;
>>
>> I've been using SolrCloud for such kind of Big Data and I think that you
>> should consider to use it. If you have any problems you can ask it here.
>>
>> Thanks;
>> Furkan KAMACI
>>
>>
>> 2014-04-15 13:20 GMT+03:00 Vineet Mishra <cl...@gmail.com>:
>>
>> > Hi All,
>> >
>> > I have worked with Solr 3.5 to implement real time search on some 100GB
>> > data, that worked fine but was little slow on complex queries(Multiple
>> > group/joined queries).
>> > But now I want to index some real Big Data(around 4 TB or even more),
can
>> > SolrCloud be solution for it if not what could be the best possible
>> > solution in this case.
>> >
>> > *Stats for the previous Implementation:*
>> > It was Master Slave Architecture with normal Standalone multiple
instance
>> > of Solr 3.5. There were around 12 Solr instance running on different
>> > machines.
>> >
>> > *Things to consider for the next implementation:*
>> > Since all the data is sensor data hence it is the factor of duplicity
and
>> > uniqueness.
>> >
>> > *Really urgent, please take the call on priority with set of feasible
>> > solution.*
>> >
>> > Regards
>> >
>>
>
--
Sent from Gmail Mobile
Re: Indexing Big Data With or Without Solr
Posted by Vineet Mishra <cl...@gmail.com>.
Thanks Furkan, I will definitely give it a try then.
Thanks again!
On Tue, Apr 15, 2014 at 7:53 PM, Furkan KAMACI <fu...@gmail.com>wrote:
> Hi Vineet;
>
> I've been using SolrCloud for such kind of Big Data and I think that you
> should consider to use it. If you have any problems you can ask it here.
>
> Thanks;
> Furkan KAMACI
>
>
> 2014-04-15 13:20 GMT+03:00 Vineet Mishra <cl...@gmail.com>:
>
> > Hi All,
> >
> > I have worked with Solr 3.5 to implement real time search on some 100GB
> > data, that worked fine but was little slow on complex queries(Multiple
> > group/joined queries).
> > But now I want to index some real Big Data(around 4 TB or even more), can
> > SolrCloud be solution for it if not what could be the best possible
> > solution in this case.
> >
> > *Stats for the previous Implementation:*
> > It was Master Slave Architecture with normal Standalone multiple instance
> > of Solr 3.5. There were around 12 Solr instance running on different
> > machines.
> >
> > *Things to consider for the next implementation:*
> > Since all the data is sensor data hence it is the factor of duplicity and
> > uniqueness.
> >
> > *Really urgent, please take the call on priority with set of feasible
> > solution.*
> >
> > Regards
> >
>
Re: Indexing Big Data With or Without Solr
Posted by Furkan KAMACI <fu...@gmail.com>.
Hi Vineet;
I've been using SolrCloud for such kind of Big Data and I think that you
should consider to use it. If you have any problems you can ask it here.
Thanks;
Furkan KAMACI
2014-04-15 13:20 GMT+03:00 Vineet Mishra <cl...@gmail.com>:
> Hi All,
>
> I have worked with Solr 3.5 to implement real time search on some 100GB
> data, that worked fine but was little slow on complex queries(Multiple
> group/joined queries).
> But now I want to index some real Big Data(around 4 TB or even more), can
> SolrCloud be solution for it if not what could be the best possible
> solution in this case.
>
> *Stats for the previous Implementation:*
> It was Master Slave Architecture with normal Standalone multiple instance
> of Solr 3.5. There were around 12 Solr instance running on different
> machines.
>
> *Things to consider for the next implementation:*
> Since all the data is sensor data hence it is the factor of duplicity and
> uniqueness.
>
> *Really urgent, please take the call on priority with set of feasible
> solution.*
>
> Regards
>