You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by 孙小超 <se...@qq.com> on 2014/12/16 07:04:56 UTC
回复： How can I include mahout 0.9 with hadoop 2.3 in my project?
Hi,you should do git clone first,and use maven command "mvn -DskipTests=true clean package". Then maven will download hadoop 2.2.0 jars and package the right mahout jar files which can run on hadoop 2.x .
------------------ 原始邮件 ------------------
发件人: "Marko Dinic";<ma...@nissatech.com>;
发送时间: 2014年12月15日(星期一) 下午5:45
收件人: "user"<us...@mahout.apache.org>;
抄送: "jyotiranjan panda"<te...@gmail.com>;
主题: Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
Hello,
Sorry for bumping like this, but I have a very similar question, can I
use Mahout 0.9 with Hadoop 0.20.2?
Thanks
On Mon 15 Dec 2014 10:09:56 AM CET, jyotiranjan panda wrote:
> Hi,
> mahout-0.9 is compatible with hadoop-1.2.1
>
> Regards
> Jyoti Ranjan Panda
>
> On Mon, Dec 15, 2014 at 2:33 PM, Lee S <sl...@gmail.com> wrote:
>>
>> Hi all:
>> I use gradle to management dependencies in my project.
>>
>> dependencies {
>> compile 'org.apache.mahout:mahout-core:0.9'
>> }
>>
>> When gradle build , mahout with hadoop 1.2.1 will be downloaded.
>>
>> Do I need to compile mahout with hadoop 2.3.0 and then include it into my
>> project locally?
>>
>
Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
Posted by Lee S <sl...@gmail.com>.
yep, I just read the pom.xml carefully, you are right, -Dhadoop2 is
redundant.
2014-12-16 21:24 GMT+08:00 Gokhan Capan <gk...@gmail.com>:
>
> I believe -Dhadoop2 is also redundant.
>
> mvn clean install -Dhadoop.version=2.3.0 should be sufficient
>
> Sent from my iPhone
>
> > On Dec 16, 2014, at 12:29, Lee S <sl...@gmail.com> wrote:
> >
> > Hi all , I have figured this out.
> > The command should be (mvn clean install -Dhadoop2 -Dhadoop.version=2.3.0
> > -DskipTests=true ).
> > Because (<hadoop.version>2.2.0</hadoop.version>) is in the pom.xml, not
> > hadoop2.version.
> > Hope this can help somebody who meets the same problem.
> >
> > 2014-12-16 15:49 GMT+08:00 Lee S <sl...@gmail.com>:
> >>
> >> I compiled mahout with hadop 2.3.0 as following:
> >> 1. get the trunck code
> >>
> >> git clone https://github.com/apache/mahout.git
> >>
> >> 2. mvn clean install -Dhadoop2 -Dhadoop2.version=2.3.0 -DskipTests=true
> >> and all build is successful.
> >>
> >> 3. find hadoop in code base
> >> but no hadoop-2.3.0 comes out, only hadoop-2.2.0 things could be
> >> found, why?
> >>
> >> ps. I also tried (-Dhadoop2 -Dhadoop.2.version=2.3.0 -DskipTest=ture),
> but
> >> without effects too.
> >>
> >>
> >> 2014-12-16 14:04 GMT+08:00 孙小超 <se...@qq.com>:
> >>>
> >>> Hi,you should do git clone first,and use maven command "mvn
> >>> -DskipTests=true clean package". Then maven will download hadoop 2.2.0
> >>> jars and package the right mahout jar files which can run on hadoop
> 2.x .
> >>>
> >>>
> >>>
> >>>
> >>> ------------------ 原始邮件 ------------------
> >>> 发件人: "Marko Dinic";<ma...@nissatech.com>;
> >>> 发送时间: 2014年12月15日(星期一) 下午5:45
> >>> 收件人: "user"<us...@mahout.apache.org>;
> >>> 抄送: "jyotiranjan panda"<te...@gmail.com>;
> >>> 主题: Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
> >>>
> >>>
> >>>
> >>> Hello,
> >>>
> >>> Sorry for bumping like this, but I have a very similar question, can I
> >>> use Mahout 0.9 with Hadoop 0.20.2?
> >>>
> >>> Thanks
> >>>
> >>>> On Mon 15 Dec 2014 10:09:56 AM CET, jyotiranjan panda wrote:
> >>>> Hi,
> >>>> mahout-0.9 is compatible with hadoop-1.2.1
> >>>>
> >>>> Regards
> >>>> Jyoti Ranjan Panda
> >>>>
> >>>>> On Mon, Dec 15, 2014 at 2:33 PM, Lee S <sl...@gmail.com> wrote:
> >>>>>
> >>>>> Hi all:
> >>>>> I use gradle to management dependencies in my project.
> >>>>>
> >>>>> dependencies {
> >>>>> compile 'org.apache.mahout:mahout-core:0.9'
> >>>>> }
> >>>>>
> >>>>> When gradle build , mahout with hadoop 1.2.1 will be downloaded.
> >>>>>
> >>>>> Do I need to compile mahout with hadoop 2.3.0 and then include it
> >>> into my
> >>>>> project locally?
> >>
>
Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
Posted by Gokhan Capan <gk...@gmail.com>.
I believe -Dhadoop2 is also redundant.
mvn clean install -Dhadoop.version=2.3.0 should be sufficient
Sent from my iPhone
> On Dec 16, 2014, at 12:29, Lee S <sl...@gmail.com> wrote:
>
> Hi all , I have figured this out.
> The command should be (mvn clean install -Dhadoop2 -Dhadoop.version=2.3.0
> -DskipTests=true ).
> Because (<hadoop.version>2.2.0</hadoop.version>) is in the pom.xml, not
> hadoop2.version.
> Hope this can help somebody who meets the same problem.
>
> 2014-12-16 15:49 GMT+08:00 Lee S <sl...@gmail.com>:
>>
>> I compiled mahout with hadop 2.3.0 as following:
>> 1. get the trunck code
>>
>> git clone https://github.com/apache/mahout.git
>>
>> 2. mvn clean install -Dhadoop2 -Dhadoop2.version=2.3.0 -DskipTests=true
>> and all build is successful.
>>
>> 3. find hadoop in code base
>> but no hadoop-2.3.0 comes out, only hadoop-2.2.0 things could be
>> found, why?
>>
>> ps. I also tried (-Dhadoop2 -Dhadoop.2.version=2.3.0 -DskipTest=ture), but
>> without effects too.
>>
>>
>> 2014-12-16 14:04 GMT+08:00 孙小超 <se...@qq.com>:
>>>
>>> Hi,you should do git clone first,and use maven command "mvn
>>> -DskipTests=true clean package". Then maven will download hadoop 2.2.0
>>> jars and package the right mahout jar files which can run on hadoop 2.x .
>>>
>>>
>>>
>>>
>>> ------------------ 原始邮件 ------------------
>>> 发件人: "Marko Dinic";<ma...@nissatech.com>;
>>> 发送时间: 2014年12月15日(星期一) 下午5:45
>>> 收件人: "user"<us...@mahout.apache.org>;
>>> 抄送: "jyotiranjan panda"<te...@gmail.com>;
>>> 主题: Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
>>>
>>>
>>>
>>> Hello,
>>>
>>> Sorry for bumping like this, but I have a very similar question, can I
>>> use Mahout 0.9 with Hadoop 0.20.2?
>>>
>>> Thanks
>>>
>>>> On Mon 15 Dec 2014 10:09:56 AM CET, jyotiranjan panda wrote:
>>>> Hi,
>>>> mahout-0.9 is compatible with hadoop-1.2.1
>>>>
>>>> Regards
>>>> Jyoti Ranjan Panda
>>>>
>>>>> On Mon, Dec 15, 2014 at 2:33 PM, Lee S <sl...@gmail.com> wrote:
>>>>>
>>>>> Hi all:
>>>>> I use gradle to management dependencies in my project.
>>>>>
>>>>> dependencies {
>>>>> compile 'org.apache.mahout:mahout-core:0.9'
>>>>> }
>>>>>
>>>>> When gradle build , mahout with hadoop 1.2.1 will be downloaded.
>>>>>
>>>>> Do I need to compile mahout with hadoop 2.3.0 and then include it
>>> into my
>>>>> project locally?
>>
Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
Posted by Lee S <sl...@gmail.com>.
Hi all , I have figured this out.
The command should be (mvn clean install -Dhadoop2 -Dhadoop.version=2.3.0
-DskipTests=true ).
Because (<hadoop.version>2.2.0</hadoop.version>) is in the pom.xml, not
hadoop2.version.
Hope this can help somebody who meets the same problem.
2014-12-16 15:49 GMT+08:00 Lee S <sl...@gmail.com>:
>
> I compiled mahout with hadop 2.3.0 as following:
> 1. get the trunck code
>
> git clone https://github.com/apache/mahout.git
>
> 2. mvn clean install -Dhadoop2 -Dhadoop2.version=2.3.0 -DskipTests=true
> and all build is successful.
>
> 3. find hadoop in code base
> but no hadoop-2.3.0 comes out, only hadoop-2.2.0 things could be
> found, why?
>
> ps. I also tried (-Dhadoop2 -Dhadoop.2.version=2.3.0 -DskipTest=ture), but
> without effects too.
>
>
> 2014-12-16 14:04 GMT+08:00 孙小超 <se...@qq.com>:
>>
>> Hi,you should do git clone first,and use maven command "mvn
>> -DskipTests=true clean package". Then maven will download hadoop 2.2.0
>> jars and package the right mahout jar files which can run on hadoop 2.x .
>>
>>
>>
>>
>> ------------------ 原始邮件 ------------------
>> 发件人: "Marko Dinic";<ma...@nissatech.com>;
>> 发送时间: 2014年12月15日(星期一) 下午5:45
>> 收件人: "user"<us...@mahout.apache.org>;
>> 抄送: "jyotiranjan panda"<te...@gmail.com>;
>> 主题: Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
>>
>>
>>
>> Hello,
>>
>> Sorry for bumping like this, but I have a very similar question, can I
>> use Mahout 0.9 with Hadoop 0.20.2?
>>
>> Thanks
>>
>> On Mon 15 Dec 2014 10:09:56 AM CET, jyotiranjan panda wrote:
>> > Hi,
>> > mahout-0.9 is compatible with hadoop-1.2.1
>> >
>> > Regards
>> > Jyoti Ranjan Panda
>> >
>> > On Mon, Dec 15, 2014 at 2:33 PM, Lee S <sl...@gmail.com> wrote:
>> >>
>> >> Hi all:
>> >> I use gradle to management dependencies in my project.
>> >>
>> >> dependencies {
>> >> compile 'org.apache.mahout:mahout-core:0.9'
>> >> }
>> >>
>> >> When gradle build , mahout with hadoop 1.2.1 will be downloaded.
>> >>
>> >> Do I need to compile mahout with hadoop 2.3.0 and then include it
>> into my
>> >> project locally?
>> >>
>> >
>>
>
Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
Posted by Lee S <sl...@gmail.com>.
I compiled mahout with hadop 2.3.0 as following:
1. get the trunck code
git clone https://github.com/apache/mahout.git
2. mvn clean install -Dhadoop2 -Dhadoop2.version=2.3.0 -DskipTests=true
and all build is successful.
3. find hadoop in code base
but no hadoop-2.3.0 comes out, only hadoop-2.2.0 things could be found,
why?
ps. I also tried (-Dhadoop2 -Dhadoop.2.version=2.3.0 -DskipTest=ture), but
without effects too.
2014-12-16 14:04 GMT+08:00 孙小超 <se...@qq.com>:
>
> Hi,you should do git clone first,and use maven command "mvn
> -DskipTests=true clean package". Then maven will download hadoop 2.2.0
> jars and package the right mahout jar files which can run on hadoop 2.x .
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Marko Dinic";<ma...@nissatech.com>;
> 发送时间: 2014年12月15日(星期一) 下午5:45
> 收件人: "user"<us...@mahout.apache.org>;
> 抄送: "jyotiranjan panda"<te...@gmail.com>;
> 主题: Re: How can I include mahout 0.9 with hadoop 2.3 in my project?
>
>
>
> Hello,
>
> Sorry for bumping like this, but I have a very similar question, can I
> use Mahout 0.9 with Hadoop 0.20.2?
>
> Thanks
>
> On Mon 15 Dec 2014 10:09:56 AM CET, jyotiranjan panda wrote:
> > Hi,
> > mahout-0.9 is compatible with hadoop-1.2.1
> >
> > Regards
> > Jyoti Ranjan Panda
> >
> > On Mon, Dec 15, 2014 at 2:33 PM, Lee S <sl...@gmail.com> wrote:
> >>
> >> Hi all:
> >> I use gradle to management dependencies in my project.
> >>
> >> dependencies {
> >> compile 'org.apache.mahout:mahout-core:0.9'
> >> }
> >>
> >> When gradle build , mahout with hadoop 1.2.1 will be downloaded.
> >>
> >> Do I need to compile mahout with hadoop 2.3.0 and then include it into
> my
> >> project locally?
> >>
> >
>