You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Nicholas Murphy <ha...@gmail.com> on 2013/11/20 21:15:09 UTC
help with hadoop 1.2.1 aggregate framework (non-streaming)
I'm trying to use the aggregate framework but in a non-streaming fashion. I detailed what I'm doing pretty well here:
http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
I have a feeling there's a simple solution (involving setting the appropriate classpath somewhere) but I don't know what it is. Any help appreciated. There's remarkably little information available on non-streaming use of aggregates that I can find.
Thanks,
Nick
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Where is your ScifsStandard.jar? does that locate in the same path with
your command line?
if not, plaese specify the full path in your command line, such as :
hadoop jar ../test/test.jar XXXXX
On Thu, Nov 21, 2013 at 2:42 PM, Nicholas Murphy <ha...@gmail.com>wrote:
> Thanks, but as per the StackOverflow site, it is there (see the second
> code block where I list the contents of ScifsStandard.jar).
>
> Nick
>
> On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> > Hi Nicholas,
> >
> > This is not hadoop releated.
> >
> > edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> > you need to include this class in your ScifsStandard.jar
> >
> >
> > On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>
> wrote:
> > I'm trying to use the aggregate framework but in a non-streaming
> fashion. I detailed what I'm doing pretty well here:
> >
> >
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
> >
> > I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
> >
> > Thanks,
> > Nick
> >
>
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Where is your ScifsStandard.jar? does that locate in the same path with
your command line?
if not, plaese specify the full path in your command line, such as :
hadoop jar ../test/test.jar XXXXX
On Thu, Nov 21, 2013 at 2:42 PM, Nicholas Murphy <ha...@gmail.com>wrote:
> Thanks, but as per the StackOverflow site, it is there (see the second
> code block where I list the contents of ScifsStandard.jar).
>
> Nick
>
> On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> > Hi Nicholas,
> >
> > This is not hadoop releated.
> >
> > edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> > you need to include this class in your ScifsStandard.jar
> >
> >
> > On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>
> wrote:
> > I'm trying to use the aggregate framework but in a non-streaming
> fashion. I detailed what I'm doing pretty well here:
> >
> >
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
> >
> > I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
> >
> > Thanks,
> > Nick
> >
>
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Where is your ScifsStandard.jar? does that locate in the same path with
your command line?
if not, plaese specify the full path in your command line, such as :
hadoop jar ../test/test.jar XXXXX
On Thu, Nov 21, 2013 at 2:42 PM, Nicholas Murphy <ha...@gmail.com>wrote:
> Thanks, but as per the StackOverflow site, it is there (see the second
> code block where I list the contents of ScifsStandard.jar).
>
> Nick
>
> On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> > Hi Nicholas,
> >
> > This is not hadoop releated.
> >
> > edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> > you need to include this class in your ScifsStandard.jar
> >
> >
> > On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>
> wrote:
> > I'm trying to use the aggregate framework but in a non-streaming
> fashion. I detailed what I'm doing pretty well here:
> >
> >
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
> >
> > I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
> >
> > Thanks,
> > Nick
> >
>
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Where is your ScifsStandard.jar? does that locate in the same path with
your command line?
if not, plaese specify the full path in your command line, such as :
hadoop jar ../test/test.jar XXXXX
On Thu, Nov 21, 2013 at 2:42 PM, Nicholas Murphy <ha...@gmail.com>wrote:
> Thanks, but as per the StackOverflow site, it is there (see the second
> code block where I list the contents of ScifsStandard.jar).
>
> Nick
>
> On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> > Hi Nicholas,
> >
> > This is not hadoop releated.
> >
> > edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> > you need to include this class in your ScifsStandard.jar
> >
> >
> > On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>
> wrote:
> > I'm trying to use the aggregate framework but in a non-streaming
> fashion. I detailed what I'm doing pretty well here:
> >
> >
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
> >
> > I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
> >
> > Thanks,
> > Nick
> >
>
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Nicholas Murphy <ha...@gmail.com>.
Thanks, but as per the StackOverflow site, it is there (see the second code block where I list the contents of ScifsStandard.jar).
Nick
On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Nicholas,
>
> This is not hadoop releated.
>
> edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> you need to include this class in your ScifsStandard.jar
>
>
> On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com> wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion. I detailed what I'm doing pretty well here:
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the appropriate classpath somewhere) but I don't know what it is. Any help appreciated. There's remarkably little information available on non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Nicholas Murphy <ha...@gmail.com>.
Thanks, but as per the StackOverflow site, it is there (see the second code block where I list the contents of ScifsStandard.jar).
Nick
On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Nicholas,
>
> This is not hadoop releated.
>
> edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> you need to include this class in your ScifsStandard.jar
>
>
> On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com> wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion. I detailed what I'm doing pretty well here:
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the appropriate classpath somewhere) but I don't know what it is. Any help appreciated. There's remarkably little information available on non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Nicholas Murphy <ha...@gmail.com>.
Thanks, but as per the StackOverflow site, it is there (see the second code block where I list the contents of ScifsStandard.jar).
Nick
On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Nicholas,
>
> This is not hadoop releated.
>
> edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> you need to include this class in your ScifsStandard.jar
>
>
> On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com> wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion. I detailed what I'm doing pretty well here:
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the appropriate classpath somewhere) but I don't know what it is. Any help appreciated. There's remarkably little information available on non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Nicholas Murphy <ha...@gmail.com>.
Thanks, but as per the StackOverflow site, it is there (see the second code block where I list the contents of ScifsStandard.jar).
Nick
On Nov 21, 2013, at 1:37 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Nicholas,
>
> This is not hadoop releated.
>
> edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
> you need to include this class in your ScifsStandard.jar
>
>
> On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com> wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion. I detailed what I'm doing pretty well here:
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the appropriate classpath somewhere) but I don't know what it is. Any help appreciated. There's remarkably little information available on non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick
>
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Hi Nicholas,
This is not hadoop releated.
edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
you need to include this class in your ScifsStandard.jar
On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion.
> I detailed what I'm doing pretty well here:
>
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Hi Nicholas,
This is not hadoop releated.
edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
you need to include this class in your ScifsStandard.jar
On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion.
> I detailed what I'm doing pretty well here:
>
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Hi Nicholas,
This is not hadoop releated.
edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
you need to include this class in your ScifsStandard.jar
On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion.
> I detailed what I'm doing pretty well here:
>
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick
Re: help with hadoop 1.2.1 aggregate framework (non-streaming)
Posted by Azuryy Yu <az...@gmail.com>.
Hi Nicholas,
This is not hadoop releated.
edu.harvard.seas.scifs.ScifsStandard, which is your cutomized class, so:
you need to include this class in your ScifsStandard.jar
On Thu, Nov 21, 2013 at 4:15 AM, Nicholas Murphy <ha...@gmail.com>wrote:
> I'm trying to use the aggregate framework but in a non-streaming fashion.
> I detailed what I'm doing pretty well here:
>
>
> http://stackoverflow.com/questions/20085532/trying-to-make-hadoop-1-2-1-aggregate-framework-work-non-streaming
>
> I have a feeling there's a simple solution (involving setting the
> appropriate classpath somewhere) but I don't know what it is. Any help
> appreciated. There's remarkably little information available on
> non-streaming use of aggregates that I can find.
>
> Thanks,
> Nick