You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Bai Shen <ba...@gmail.com> on 2011/10/25 18:43:38 UTC
Re: Fwd: Understanding Nutch workflow
BTW, found a typo in the tutorial. It has the following.
bin/nutch parse $1
And it should be this.
bin/nutch parse $s1
On Tue, Sep 27, 2011 at 2:35 PM, lewis john mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> OK I understand. I think the main task with the documentation was that the
> fundamental architecture changed between Nutch 1.2 & 1.3. Generally
> speaking
> the community appears to understand this, but I fully recognise that there
> is still a good deal of work to do. Thanks for pointing this out.
>
> Lewis
>
> On Tue, Sep 27, 2011 at 7:32 PM, Bai Shen <ba...@gmail.com> wrote:
>
> > I'm not looking for anything to be created. It's just that a lot of the
> > documentation seems to be marked as needing updates for 1.3 and I was
> > wondering what the timeline for completing it was.
> >
> > On Tue, Sep 27, 2011 at 2:28 PM, lewis john mcgibbney <
> > lewis.mcgibbney@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > What documentation apart from what we have marked as in construction or
> > > TODO
> > > on the wiki would you like to see created?
> > >
> > > It has been a pretty long process getting these resources up-to-date,
> > > however we are getting there!
> > >
> > > >
> > > > >
> > > > > BTW, do you know what the timeline is to have the documentation
> > updated
> > > > for
> > > > > 1.3?
> > > >
> > > > It is as we speak. Lewis did quite a good job for the wiki docs on
> 1.3.
> > > >
> > >
> > >
> > >
> > > --
> > > *Lewis*
> > >
> >
>
>
>
> --
> *Lewis*
>
Re: Fwd: Understanding Nutch workflow
Posted by Bai Shen <ba...@gmail.com>.
I'll see, but we're not at the point to deploy to a hadoop cluster yet.
On Wed, Oct 26, 2011 at 10:39 AM, lewis john mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> 1.3 will cover 1.4. The main point was regarding the change in architecture
> when taking into consideration the new runtime directory structure which
> was
> introduced in Nutch 1.3.
>
> Feel free to join me on getting a Hadoop tutorial for 1.4. I'ts been on the
> agenda but somewhat shelved.
>
> On Wed, Oct 26, 2011 at 4:25 PM, Bai Shen <ba...@gmail.com> wrote:
>
> > Gotcha. Maybe I'll see about starting a 1.4 version of the tutorial.
> Not
> > sure if I'll have time, though.
> >
> > On Tue, Oct 25, 2011 at 2:14 PM, lewis john mcgibbney <
> > lewis.mcgibbney@gmail.com> wrote:
> >
> > > Thanks, this is now sorted out.
> > >
> > > For refernce, you can sign up and commit your own changes to the Nutch
> > > wiki.
> > >
> > >
> > > Thanks for pointing this out.
> > >
> > > lewis
> > >
> > > On Tue, Oct 25, 2011 at 6:43 PM, Bai Shen <ba...@gmail.com>
> > wrote:
> > >
> > > > BTW, found a typo in the tutorial. It has the following.
> > > >
> > > > bin/nutch parse $1
> > > >
> > > >
> > > > And it should be this.
> > > >
> > > > bin/nutch parse $s1
> > > >
> > > >
> > > >
> > > > On Tue, Sep 27, 2011 at 2:35 PM, lewis john mcgibbney <
> > > > lewis.mcgibbney@gmail.com> wrote:
> > > >
> > > > > OK I understand. I think the main task with the documentation was
> > that
> > > > the
> > > > > fundamental architecture changed between Nutch 1.2 & 1.3. Generally
> > > > > speaking
> > > > > the community appears to understand this, but I fully recognise
> that
> > > > there
> > > > > is still a good deal of work to do. Thanks for pointing this out.
> > > > >
> > > > > Lewis
> > > > >
> > > > > On Tue, Sep 27, 2011 at 7:32 PM, Bai Shen <baishen.lists@gmail.com
> >
> > > > wrote:
> > > > >
> > > > > > I'm not looking for anything to be created. It's just that a lot
> > of
> > > > the
> > > > > > documentation seems to be marked as needing updates for 1.3 and I
> > was
> > > > > > wondering what the timeline for completing it was.
> > > > > >
> > > > > > On Tue, Sep 27, 2011 at 2:28 PM, lewis john mcgibbney <
> > > > > > lewis.mcgibbney@gmail.com> wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > What documentation apart from what we have marked as in
> > > construction
> > > > or
> > > > > > > TODO
> > > > > > > on the wiki would you like to see created?
> > > > > > >
> > > > > > > It has been a pretty long process getting these resources
> > > up-to-date,
> > > > > > > however we are getting there!
> > > > > > >
> > > > > > > >
> > > > > > > > >
> > > > > > > > > BTW, do you know what the timeline is to have the
> > documentation
> > > > > > updated
> > > > > > > > for
> > > > > > > > > 1.3?
> > > > > > > >
> > > > > > > > It is as we speak. Lewis did quite a good job for the wiki
> docs
> > > on
> > > > > 1.3.
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > *Lewis*
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > *Lewis*
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > *Lewis*
> > >
> >
>
>
>
> --
> *Lewis*
>
Re: Fwd: Understanding Nutch workflow
Posted by lewis john mcgibbney <le...@gmail.com>.
1.3 will cover 1.4. The main point was regarding the change in architecture
when taking into consideration the new runtime directory structure which was
introduced in Nutch 1.3.
Feel free to join me on getting a Hadoop tutorial for 1.4. I'ts been on the
agenda but somewhat shelved.
On Wed, Oct 26, 2011 at 4:25 PM, Bai Shen <ba...@gmail.com> wrote:
> Gotcha. Maybe I'll see about starting a 1.4 version of the tutorial. Not
> sure if I'll have time, though.
>
> On Tue, Oct 25, 2011 at 2:14 PM, lewis john mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
>
> > Thanks, this is now sorted out.
> >
> > For refernce, you can sign up and commit your own changes to the Nutch
> > wiki.
> >
> >
> > Thanks for pointing this out.
> >
> > lewis
> >
> > On Tue, Oct 25, 2011 at 6:43 PM, Bai Shen <ba...@gmail.com>
> wrote:
> >
> > > BTW, found a typo in the tutorial. It has the following.
> > >
> > > bin/nutch parse $1
> > >
> > >
> > > And it should be this.
> > >
> > > bin/nutch parse $s1
> > >
> > >
> > >
> > > On Tue, Sep 27, 2011 at 2:35 PM, lewis john mcgibbney <
> > > lewis.mcgibbney@gmail.com> wrote:
> > >
> > > > OK I understand. I think the main task with the documentation was
> that
> > > the
> > > > fundamental architecture changed between Nutch 1.2 & 1.3. Generally
> > > > speaking
> > > > the community appears to understand this, but I fully recognise that
> > > there
> > > > is still a good deal of work to do. Thanks for pointing this out.
> > > >
> > > > Lewis
> > > >
> > > > On Tue, Sep 27, 2011 at 7:32 PM, Bai Shen <ba...@gmail.com>
> > > wrote:
> > > >
> > > > > I'm not looking for anything to be created. It's just that a lot
> of
> > > the
> > > > > documentation seems to be marked as needing updates for 1.3 and I
> was
> > > > > wondering what the timeline for completing it was.
> > > > >
> > > > > On Tue, Sep 27, 2011 at 2:28 PM, lewis john mcgibbney <
> > > > > lewis.mcgibbney@gmail.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > What documentation apart from what we have marked as in
> > construction
> > > or
> > > > > > TODO
> > > > > > on the wiki would you like to see created?
> > > > > >
> > > > > > It has been a pretty long process getting these resources
> > up-to-date,
> > > > > > however we are getting there!
> > > > > >
> > > > > > >
> > > > > > > >
> > > > > > > > BTW, do you know what the timeline is to have the
> documentation
> > > > > updated
> > > > > > > for
> > > > > > > > 1.3?
> > > > > > >
> > > > > > > It is as we speak. Lewis did quite a good job for the wiki docs
> > on
> > > > 1.3.
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > *Lewis*
> > > > > >
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > *Lewis*
> > > >
> > >
> >
> >
> >
> > --
> > *Lewis*
> >
>
--
*Lewis*
Re: Fwd: Understanding Nutch workflow
Posted by Bai Shen <ba...@gmail.com>.
Gotcha. Maybe I'll see about starting a 1.4 version of the tutorial. Not
sure if I'll have time, though.
On Tue, Oct 25, 2011 at 2:14 PM, lewis john mcgibbney <
lewis.mcgibbney@gmail.com> wrote:
> Thanks, this is now sorted out.
>
> For refernce, you can sign up and commit your own changes to the Nutch
> wiki.
>
>
> Thanks for pointing this out.
>
> lewis
>
> On Tue, Oct 25, 2011 at 6:43 PM, Bai Shen <ba...@gmail.com> wrote:
>
> > BTW, found a typo in the tutorial. It has the following.
> >
> > bin/nutch parse $1
> >
> >
> > And it should be this.
> >
> > bin/nutch parse $s1
> >
> >
> >
> > On Tue, Sep 27, 2011 at 2:35 PM, lewis john mcgibbney <
> > lewis.mcgibbney@gmail.com> wrote:
> >
> > > OK I understand. I think the main task with the documentation was that
> > the
> > > fundamental architecture changed between Nutch 1.2 & 1.3. Generally
> > > speaking
> > > the community appears to understand this, but I fully recognise that
> > there
> > > is still a good deal of work to do. Thanks for pointing this out.
> > >
> > > Lewis
> > >
> > > On Tue, Sep 27, 2011 at 7:32 PM, Bai Shen <ba...@gmail.com>
> > wrote:
> > >
> > > > I'm not looking for anything to be created. It's just that a lot of
> > the
> > > > documentation seems to be marked as needing updates for 1.3 and I was
> > > > wondering what the timeline for completing it was.
> > > >
> > > > On Tue, Sep 27, 2011 at 2:28 PM, lewis john mcgibbney <
> > > > lewis.mcgibbney@gmail.com> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > What documentation apart from what we have marked as in
> construction
> > or
> > > > > TODO
> > > > > on the wiki would you like to see created?
> > > > >
> > > > > It has been a pretty long process getting these resources
> up-to-date,
> > > > > however we are getting there!
> > > > >
> > > > > >
> > > > > > >
> > > > > > > BTW, do you know what the timeline is to have the documentation
> > > > updated
> > > > > > for
> > > > > > > 1.3?
> > > > > >
> > > > > > It is as we speak. Lewis did quite a good job for the wiki docs
> on
> > > 1.3.
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > *Lewis*
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > *Lewis*
> > >
> >
>
>
>
> --
> *Lewis*
>
Re: Fwd: Understanding Nutch workflow
Posted by lewis john mcgibbney <le...@gmail.com>.
Thanks, this is now sorted out.
For refernce, you can sign up and commit your own changes to the Nutch wiki.
Thanks for pointing this out.
lewis
On Tue, Oct 25, 2011 at 6:43 PM, Bai Shen <ba...@gmail.com> wrote:
> BTW, found a typo in the tutorial. It has the following.
>
> bin/nutch parse $1
>
>
> And it should be this.
>
> bin/nutch parse $s1
>
>
>
> On Tue, Sep 27, 2011 at 2:35 PM, lewis john mcgibbney <
> lewis.mcgibbney@gmail.com> wrote:
>
> > OK I understand. I think the main task with the documentation was that
> the
> > fundamental architecture changed between Nutch 1.2 & 1.3. Generally
> > speaking
> > the community appears to understand this, but I fully recognise that
> there
> > is still a good deal of work to do. Thanks for pointing this out.
> >
> > Lewis
> >
> > On Tue, Sep 27, 2011 at 7:32 PM, Bai Shen <ba...@gmail.com>
> wrote:
> >
> > > I'm not looking for anything to be created. It's just that a lot of
> the
> > > documentation seems to be marked as needing updates for 1.3 and I was
> > > wondering what the timeline for completing it was.
> > >
> > > On Tue, Sep 27, 2011 at 2:28 PM, lewis john mcgibbney <
> > > lewis.mcgibbney@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > What documentation apart from what we have marked as in construction
> or
> > > > TODO
> > > > on the wiki would you like to see created?
> > > >
> > > > It has been a pretty long process getting these resources up-to-date,
> > > > however we are getting there!
> > > >
> > > > >
> > > > > >
> > > > > > BTW, do you know what the timeline is to have the documentation
> > > updated
> > > > > for
> > > > > > 1.3?
> > > > >
> > > > > It is as we speak. Lewis did quite a good job for the wiki docs on
> > 1.3.
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > *Lewis*
> > > >
> > >
> >
> >
> >
> > --
> > *Lewis*
> >
>
--
*Lewis*