You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Sourajit Basak <so...@gmail.com> on 2012/12/28 12:22:56 UTC
apache-nutch-*.jar packed inside job file (v1.5.1)
Why does the job file include apache-nutch-*.jar in jobfile's 'lib' as well
as the individual classes ?
I think this is a defect.
Re: apache-nutch-*.jar packed inside job file (v1.5.1)
Posted by Sourajit Basak <so...@gmail.com>.
Understood Julien.
I meant if anyone wishes to verify, you can analyse the contents of the
.job file.
no need to run on cluster.
On Wed, Jan 9, 2013 at 4:05 PM, Julien Nioche <lists.digitalpebble@gmail.com
> wrote:
> That's not what I was suggesting
>
> On 9 January 2013 10:12, Sourajit Basak <so...@gmail.com> wrote:
>
> > No need to run against any hadoop cluster. Do a ant clean build and
> > generate a job file. See if you find the apache-nutch-jar under /lib.
> >
> > On Tue, Jan 8, 2013 at 7:15 PM, Julien Nioche <
> > lists.digitalpebble@gmail.com
> > > wrote:
> >
> > > I remember we had an issue some time ago with Nutch not working on
> > > non-Apache distribs of Hadoop because of where the classes were put
> but I
> > > don't think this is a result of it. AFAIK the mapreduce code must NOT
> be
> > in
> > > a jar in order to work so if something has to go it has to be the jar
> and
> > > not the unpacked classes.
> > >
> > > On 7 January 2013 23:56, Lewis John Mcgibbney <
> lewis.mcgibbney@gmail.com
> > > >wrote:
> > >
> > > > Hi Sourajit,
> > > >
> > > > You're suggesting that there is a clear case of compiled code
> > > duplication?
> > > >
> > > > If this is the case I have no idea and further if this actually is
> the
> > > case
> > > > then we could address it... however I would be surprised if this were
> > the
> > > > case.
> > > >
> > > > Any ideas anyone?
> > > >
> > > > Lewis
> > > >
> > > > On Fri, Dec 28, 2012 at 3:22 AM, Sourajit Basak <
> > > sourajit.basac@gmail.com
> > > > >wrote:
> > > >
> > > > > Why does the job file include apache-nutch-*.jar in jobfile's 'lib'
> > as
> > > > well
> > > > > as the individual classes ?
> > > > > I think this is a defect.
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > *Lewis*
> > > >
> > >
> > >
> > >
> > > --
> > > *
> > > *Open Source Solutions for Text Engineering
> > >
> > > http://digitalpebble.blogspot.com/
> > > http://www.digitalpebble.com
> > > http://twitter.com/digitalpebble
> > >
> >
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>
Re: apache-nutch-*.jar packed inside job file (v1.5.1)
Posted by Julien Nioche <li...@gmail.com>.
That's not what I was suggesting
On 9 January 2013 10:12, Sourajit Basak <so...@gmail.com> wrote:
> No need to run against any hadoop cluster. Do a ant clean build and
> generate a job file. See if you find the apache-nutch-jar under /lib.
>
> On Tue, Jan 8, 2013 at 7:15 PM, Julien Nioche <
> lists.digitalpebble@gmail.com
> > wrote:
>
> > I remember we had an issue some time ago with Nutch not working on
> > non-Apache distribs of Hadoop because of where the classes were put but I
> > don't think this is a result of it. AFAIK the mapreduce code must NOT be
> in
> > a jar in order to work so if something has to go it has to be the jar and
> > not the unpacked classes.
> >
> > On 7 January 2013 23:56, Lewis John Mcgibbney <lewis.mcgibbney@gmail.com
> > >wrote:
> >
> > > Hi Sourajit,
> > >
> > > You're suggesting that there is a clear case of compiled code
> > duplication?
> > >
> > > If this is the case I have no idea and further if this actually is the
> > case
> > > then we could address it... however I would be surprised if this were
> the
> > > case.
> > >
> > > Any ideas anyone?
> > >
> > > Lewis
> > >
> > > On Fri, Dec 28, 2012 at 3:22 AM, Sourajit Basak <
> > sourajit.basac@gmail.com
> > > >wrote:
> > >
> > > > Why does the job file include apache-nutch-*.jar in jobfile's 'lib'
> as
> > > well
> > > > as the individual classes ?
> > > > I think this is a defect.
> > > >
> > >
> > >
> > >
> > > --
> > > *Lewis*
> > >
> >
> >
> >
> > --
> > *
> > *Open Source Solutions for Text Engineering
> >
> > http://digitalpebble.blogspot.com/
> > http://www.digitalpebble.com
> > http://twitter.com/digitalpebble
> >
>
--
*
*Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble
Re: apache-nutch-*.jar packed inside job file (v1.5.1)
Posted by Sourajit Basak <so...@gmail.com>.
No need to run against any hadoop cluster. Do a ant clean build and
generate a job file. See if you find the apache-nutch-jar under /lib.
On Tue, Jan 8, 2013 at 7:15 PM, Julien Nioche <lists.digitalpebble@gmail.com
> wrote:
> I remember we had an issue some time ago with Nutch not working on
> non-Apache distribs of Hadoop because of where the classes were put but I
> don't think this is a result of it. AFAIK the mapreduce code must NOT be in
> a jar in order to work so if something has to go it has to be the jar and
> not the unpacked classes.
>
> On 7 January 2013 23:56, Lewis John Mcgibbney <lewis.mcgibbney@gmail.com
> >wrote:
>
> > Hi Sourajit,
> >
> > You're suggesting that there is a clear case of compiled code
> duplication?
> >
> > If this is the case I have no idea and further if this actually is the
> case
> > then we could address it... however I would be surprised if this were the
> > case.
> >
> > Any ideas anyone?
> >
> > Lewis
> >
> > On Fri, Dec 28, 2012 at 3:22 AM, Sourajit Basak <
> sourajit.basac@gmail.com
> > >wrote:
> >
> > > Why does the job file include apache-nutch-*.jar in jobfile's 'lib' as
> > well
> > > as the individual classes ?
> > > I think this is a defect.
> > >
> >
> >
> >
> > --
> > *Lewis*
> >
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
> http://twitter.com/digitalpebble
>
Re: apache-nutch-*.jar packed inside job file (v1.5.1)
Posted by Julien Nioche <li...@gmail.com>.
I remember we had an issue some time ago with Nutch not working on
non-Apache distribs of Hadoop because of where the classes were put but I
don't think this is a result of it. AFAIK the mapreduce code must NOT be in
a jar in order to work so if something has to go it has to be the jar and
not the unpacked classes.
On 7 January 2013 23:56, Lewis John Mcgibbney <le...@gmail.com>wrote:
> Hi Sourajit,
>
> You're suggesting that there is a clear case of compiled code duplication?
>
> If this is the case I have no idea and further if this actually is the case
> then we could address it... however I would be surprised if this were the
> case.
>
> Any ideas anyone?
>
> Lewis
>
> On Fri, Dec 28, 2012 at 3:22 AM, Sourajit Basak <sourajit.basac@gmail.com
> >wrote:
>
> > Why does the job file include apache-nutch-*.jar in jobfile's 'lib' as
> well
> > as the individual classes ?
> > I think this is a defect.
> >
>
>
>
> --
> *Lewis*
>
--
*
*Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/
http://www.digitalpebble.com
http://twitter.com/digitalpebble
Re: apache-nutch-*.jar packed inside job file (v1.5.1)
Posted by Lewis John Mcgibbney <le...@gmail.com>.
Hi Sourajit,
You're suggesting that there is a clear case of compiled code duplication?
If this is the case I have no idea and further if this actually is the case
then we could address it... however I would be surprised if this were the
case.
Any ideas anyone?
Lewis
On Fri, Dec 28, 2012 at 3:22 AM, Sourajit Basak <so...@gmail.com>wrote:
> Why does the job file include apache-nutch-*.jar in jobfile's 'lib' as well
> as the individual classes ?
> I think this is a defect.
>
--
*Lewis*