Howto Make Big Data Drupal Search | Big Data Drupal

[Nicholas Roberts <ni...@gmail.com>]

http://www.bigdatadrupal.com/howto-big-data-drupal-search

I just wrote a high level and rather vague (but hopefully correct) howto on
building a search-driven site with cdh4, nutch 1.6, solr 3.6, aegir and
drupal openoutreach distro

Demo at www.bigdatadrupal.org

Re: Howto Make Big Data Drupal Search | Big Data Drupal

[Nicholas Roberts <ni...@gmail.com>]

Hi

I used chd4 because of the Cloudera Manager and its installer. Easy to use

I wanted a commercial open source big data stack

I used nutch 1.6 cause I knew it would work

I'll add that also to the doc

Thanks for feedback
On Oct 23, 2013 7:01 AM, "A Laxmi" <a....@gmail.com> wrote:

> Hey Nicholas!
>
> I skimmed through the article for just a few seconds as I am at work now,
> I will read more tonight. If you don't mind me asking, I don't understand
> why would you need Cloudera CDH for Nutch *1.6*? My understanding is
> Nutch *1.6* does not support storing data in a data store like
> HBase/Hadoop what CDH offers but only 2.x does. I am sorry if my knowledge
> of using Nutch 1.x version is falling short, but I kind of played with CDH
> and Nutch 1.6 to an certain extent so have a basic idea.
>
>
>
>
> On Wed, Oct 23, 2013 at 1:48 AM, Nicholas Roberts <
> niccolo.roberts@gmail.com> wrote:
>
>> http://www.bigdatadrupal.com/howto-big-data-drupal-search
>>
>> I just wrote a high level and rather vague (but hopefully correct) howto
>> on
>> building a search-driven site with cdh4, nutch 1.6, solr 3.6, aegir and
>> drupal openoutreach distro
>>
>> Demo at www.bigdatadrupal.org
>>
>
>

Re: Howto Make Big Data Drupal Search | Big Data Drupal

[A Laxmi <a....@gmail.com>]

Hey Nicholas!

I skimmed through the article for just a few seconds as I am at work now, I
will read more tonight. If you don't mind me asking, I don't understand why
would you need Cloudera CDH for Nutch *1.6*? My understanding is Nutch
*1.6*does not support storing data in a data store like HBase/Hadoop
what CDH
offers but only 2.x does. I am sorry if my knowledge of using Nutch 1.x
version is falling short, but I kind of played with CDH and Nutch 1.6 to an
certain extent so have a basic idea.




On Wed, Oct 23, 2013 at 1:48 AM, Nicholas Roberts <niccolo.roberts@gmail.com
> wrote:

> http://www.bigdatadrupal.com/howto-big-data-drupal-search
>
> I just wrote a high level and rather vague (but hopefully correct) howto on
> building a search-driven site with cdh4, nutch 1.6, solr 3.6, aegir and
> drupal openoutreach distro
>
> Demo at www.bigdatadrupal.org
>

Re: Howto Make Big Data Drupal Search | Big Data Drupal

[Nicholas Roberts <ni...@gmail.com>]

Ok great. Did that page get updated recently? Looks much longer than last
time ....

Thanks for correction. Wording of that section needs more work

Plesse let me know if any other errors spotted
On Oct 23, 2013 1:25 AM, "Julien Nioche" <li...@gmail.com>
wrote:

> Hi Niccolo
>
> I haven't looked in great details but
>
> *The Apache Nutch Hadoop tutorial is written by Doug Cutting who is the
> inventor of Hadoop, Chairman of the Apache Foundation and a team
> Cloudera.com star player. [...]*
> not sure what tutorial you are referring to, please add a link. If you mean
> this one [http://wiki.apache.org/nutch/NutchHadoopTutorial] then it hasn't
> been written by Doug but by numerous contributors (
> http://wiki.apache.org/nutch/NutchHadoopTutorial?action=info) and it would
> be more accurate to refer to it as written by the Nutch community or not
> mention any specific author.
>
> If you mean this one (
> http://wiki.apache.org/nutch/NutchHadoopSingleNodeTutorial) which is a bit
> more concise and just as accurate then Carmen Klaussner should get the
> credits, but again it's the Nutch community as a whole which contributes to
> the Wiki.
>
> Will try to have a look at your article later, it's great when people share
> their uses of Nutch!
>
> Thanks
>
> Julien
>
>
>
>
>
>
>
> On 23 October 2013 06:48, Nicholas Roberts <niccolo.roberts@gmail.com
> >wrote:
>
> > http://www.bigdatadrupal.com/howto-big-data-drupal-search
> >
> > I just wrote a high level and rather vague (but hopefully correct) howto
> on
> > building a search-driven site with cdh4, nutch 1.6, solr 3.6, aegir and
> > drupal openoutreach distro
> >
> > Demo at www.bigdatadrupal.org
> >
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>

Re: Howto Make Big Data Drupal Search | Big Data Drupal

[Julien Nioche <li...@gmail.com>]

Hi Niccolo

I haven't looked in great details but

*The Apache Nutch Hadoop tutorial is written by Doug Cutting who is the
inventor of Hadoop, Chairman of the Apache Foundation and a team
Cloudera.com star player. [...]*
not sure what tutorial you are referring to, please add a link. If you mean
this one [http://wiki.apache.org/nutch/NutchHadoopTutorial] then it hasn't
been written by Doug but by numerous contributors (
http://wiki.apache.org/nutch/NutchHadoopTutorial?action=info) and it would
be more accurate to refer to it as written by the Nutch community or not
mention any specific author.

If you mean this one (
http://wiki.apache.org/nutch/NutchHadoopSingleNodeTutorial) which is a bit
more concise and just as accurate then Carmen Klaussner should get the
credits, but again it's the Nutch community as a whole which contributes to
the Wiki.

Will try to have a look at your article later, it's great when people share
their uses of Nutch!

Thanks

Julien







On 23 October 2013 06:48, Nicholas Roberts <ni...@gmail.com>wrote:

> http://www.bigdatadrupal.com/howto-big-data-drupal-search
>
> I just wrote a high level and rather vague (but hopefully correct) howto on
> building a search-driven site with cdh4, nutch 1.6, solr 3.6, aegir and
> drupal openoutreach distro
>
> Demo at www.bigdatadrupal.org
>



-- 
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble