You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by Stanley Xu <we...@gmail.com> on 2011/04/18 11:23:10 UTC
How to create a distribution from the snapshot codebase?
Dear all,
It might be a stupid question, but I am not that familiar with Maven. How
could I run a simple Maven script to create a distribution I could un-tar
the build on a hadoop cluster and just set the MAHOUT_HOME to run the mahout
script?
It I run "mvn install", the built jars would be put in different sub-project
paths, it's really a little confusion to package the different required
libs, jars and scripts.
Thanks in advance.
Best wishes,
Stanley Xu
Re: How to create a distribution from the snapshot codebase?
Posted by Stanley Xu <we...@gmail.com>.
Thanks Eric, yes, it works!
Best wishes,
Stanley Xu
On Tue, Apr 19, 2011 at 7:04 PM, Eric Charles <er...@u-mangate.com>wrote:
> Hi,
>
> I had a quick look at mahout's pom.xml, and realized the distribution
> module already contains the maven-assembly-plugin.
>
> I you 'cd distribution' and type 'mvn install', you will see
>
> [INFO] Assemblies have been skipped per configuration of the skipAssembly
> parameter.
>
> This is because of the mahout's defined mahout.skip.distribution parameter
> in pom.xml.
>
> Type 'mvn install -Dmahout.skip.distribution=false', and you will get the
> zip/tar.gz/bz2 with mahout's jar and its dependencies + a shell script to
> invoke org.apache.mahout.driver.MahoutDriver.
>
> I searched around on website and forum, but didn't find a description for
> this (I found the related JIRA on
> https://issues.apache.org/jira/browse/MAHOUT-538), but maybe I missed the
> page?
>
> In terms of contribution, I think everything is already there, maybe more
> documentation/link...
>
> Tks,
> - Eric
>
>
> org.apache.mahout.driver.MahoutDriver
>
>
> On 19/04/2011 10:01, Stanley Xu wrote:
>
>> Thanks all. Yes, what I want is a top-level tar everything together job. I
>> would go with the release way. If I could get some time to go through
>> maven
>> and the plugins you guys suggested, I would love to try it as well.
>>
>> Best wishes,
>> Stanley Xu
>>
>>
>>
>> On Tue, Apr 19, 2011 at 12:14 PM, Eric Charles
>> <er...@u-mangate.com>wrote:
>>
>> Time is the most volatile thing...
>>>
>>> I add this on my todo and one day, if not already done by someone else, I
>>> will give it a try :)
>>>
>>> Tks,
>>> - Eric
>>>
>>>
>>> On 18/04/2011 19:04, Ted Dunning wrote:
>>>
>>> Yes. It really isn't that hard to do. Getting time is the trick.
>>>>
>>>> All patches welcome!
>>>>
>>>> On Mon, Apr 18, 2011 at 9:18 AM, Eric Charles<
>>>> eric.charles@u-mangate.com
>>>>
>>>>> wrote:
>>>>>
>>>>
>>>> appassembler-maven-plugin and maven-assembly-plugin are really good to
>>>>
>>>>> create zip/tar.gz with daemon/service startup scripts.
>>>>>
>>>>> We happily use it at Apache James project.
>>>>> You have to add a bunch of lines in your pom.xml (see [1]), but you
>>>>> will
>>>>> get return for it :)
>>>>>
>>>>>
>>>>>
>>>>
>>
Re: How to create a distribution from the snapshot codebase?
Posted by Eric Charles <er...@u-mangate.com>.
Hi,
I had a quick look at mahout's pom.xml, and realized the distribution
module already contains the maven-assembly-plugin.
I you 'cd distribution' and type 'mvn install', you will see
[INFO] Assemblies have been skipped per configuration of the
skipAssembly parameter.
This is because of the mahout's defined mahout.skip.distribution
parameter in pom.xml.
Type 'mvn install -Dmahout.skip.distribution=false', and you will get
the zip/tar.gz/bz2 with mahout's jar and its dependencies + a shell
script to invoke org.apache.mahout.driver.MahoutDriver.
I searched around on website and forum, but didn't find a description
for this (I found the related JIRA on
https://issues.apache.org/jira/browse/MAHOUT-538), but maybe I missed
the page?
In terms of contribution, I think everything is already there, maybe
more documentation/link...
Tks,
- Eric
org.apache.mahout.driver.MahoutDriver
On 19/04/2011 10:01, Stanley Xu wrote:
> Thanks all. Yes, what I want is a top-level tar everything together job. I
> would go with the release way. If I could get some time to go through maven
> and the plugins you guys suggested, I would love to try it as well.
>
> Best wishes,
> Stanley Xu
>
>
>
> On Tue, Apr 19, 2011 at 12:14 PM, Eric Charles
> <er...@u-mangate.com>wrote:
>
>> Time is the most volatile thing...
>>
>> I add this on my todo and one day, if not already done by someone else, I
>> will give it a try :)
>>
>> Tks,
>> - Eric
>>
>>
>> On 18/04/2011 19:04, Ted Dunning wrote:
>>
>>> Yes. It really isn't that hard to do. Getting time is the trick.
>>>
>>> All patches welcome!
>>>
>>> On Mon, Apr 18, 2011 at 9:18 AM, Eric Charles<eric.charles@u-mangate.com
>>>> wrote:
>>>
>>> appassembler-maven-plugin and maven-assembly-plugin are really good to
>>>> create zip/tar.gz with daemon/service startup scripts.
>>>>
>>>> We happily use it at Apache James project.
>>>> You have to add a bunch of lines in your pom.xml (see [1]), but you will
>>>> get return for it :)
>>>>
>>>>
>>>
>
Re: How to create a distribution from the snapshot codebase?
Posted by Stanley Xu <we...@gmail.com>.
Thanks all. Yes, what I want is a top-level tar everything together job. I
would go with the release way. If I could get some time to go through maven
and the plugins you guys suggested, I would love to try it as well.
Best wishes,
Stanley Xu
On Tue, Apr 19, 2011 at 12:14 PM, Eric Charles
<er...@u-mangate.com>wrote:
> Time is the most volatile thing...
>
> I add this on my todo and one day, if not already done by someone else, I
> will give it a try :)
>
> Tks,
> - Eric
>
>
> On 18/04/2011 19:04, Ted Dunning wrote:
>
>> Yes. It really isn't that hard to do. Getting time is the trick.
>>
>> All patches welcome!
>>
>> On Mon, Apr 18, 2011 at 9:18 AM, Eric Charles<eric.charles@u-mangate.com
>> >wrote:
>>
>> appassembler-maven-plugin and maven-assembly-plugin are really good to
>>> create zip/tar.gz with daemon/service startup scripts.
>>>
>>> We happily use it at Apache James project.
>>> You have to add a bunch of lines in your pom.xml (see [1]), but you will
>>> get return for it :)
>>>
>>>
>>
Re: How to create a distribution from the snapshot codebase?
Posted by Eric Charles <er...@u-mangate.com>.
Time is the most volatile thing...
I add this on my todo and one day, if not already done by someone else,
I will give it a try :)
Tks,
- Eric
On 18/04/2011 19:04, Ted Dunning wrote:
> Yes. It really isn't that hard to do. Getting time is the trick.
>
> All patches welcome!
>
> On Mon, Apr 18, 2011 at 9:18 AM, Eric Charles<er...@u-mangate.com>wrote:
>
>> appassembler-maven-plugin and maven-assembly-plugin are really good to
>> create zip/tar.gz with daemon/service startup scripts.
>>
>> We happily use it at Apache James project.
>> You have to add a bunch of lines in your pom.xml (see [1]), but you will
>> get return for it :)
>>
>
Re: How to create a distribution from the snapshot codebase?
Posted by Ted Dunning <te...@gmail.com>.
Yes. It really isn't that hard to do. Getting time is the trick.
All patches welcome!
On Mon, Apr 18, 2011 at 9:18 AM, Eric Charles <er...@u-mangate.com>wrote:
> appassembler-maven-plugin and maven-assembly-plugin are really good to
> create zip/tar.gz with daemon/service startup scripts.
>
> We happily use it at Apache James project.
> You have to add a bunch of lines in your pom.xml (see [1]), but you will
> get return for it :)
>
Re: How to create a distribution from the snapshot codebase?
Posted by Eric Charles <er...@u-mangate.com>.
Hi,
appassembler-maven-plugin and maven-assembly-plugin are really good to
create zip/tar.gz with daemon/service startup scripts.
We happily use it at Apache James project.
You have to add a bunch of lines in your pom.xml (see [1]), but you will
get return for it :)
Tks,
- Eric
[1]
https://svn.apache.org/repos/asf/james/server/trunk/container-spring/pom.xml
On 18/04/2011 18:10, Ted Dunning wrote:
> That would create a release, but I think that the desire here is to just
> create a packaged version of the code.
>
> That should probably be
>
> mvn package
>
> I don't think that we have a top-level life-cycle that does the necessary
> tar-ing of things together.
>
> The good news is that we finally are getting to where a user would like to
> do this! That means that the project is maturing.
>
> On Mon, Apr 18, 2011 at 2:58 AM, Sean Owen<sr...@gmail.com> wrote:
>
>> It's basically 'mvn -Prelease release' but see here:
>> https://cwiki.apache.org/confluence/display/MAHOUT/How+To+Release
>>
>> On Mon, Apr 18, 2011 at 10:23 AM, Stanley Xu<we...@gmail.com> wrote:
>>
>>> Dear all,
>>>
>>> It might be a stupid question, but I am not that familiar with Maven. How
>>> could I run a simple Maven script to create a distribution I could un-tar
>>> the build on a hadoop cluster and just set the MAHOUT_HOME to run the
>>> mahout
>>> script?
>>>
>>> It I run "mvn install", the built jars would be put in different
>>> sub-project
>>> paths, it's really a little confusion to package the different required
>>> libs, jars and scripts.
>>>
>>> Thanks in advance.
>>>
>>> Best wishes,
>>> Stanley Xu
>>>
>>
>
Re: How to create a distribution from the snapshot codebase?
Posted by Ted Dunning <te...@gmail.com>.
That would create a release, but I think that the desire here is to just
create a packaged version of the code.
That should probably be
mvn package
I don't think that we have a top-level life-cycle that does the necessary
tar-ing of things together.
The good news is that we finally are getting to where a user would like to
do this! That means that the project is maturing.
On Mon, Apr 18, 2011 at 2:58 AM, Sean Owen <sr...@gmail.com> wrote:
> It's basically 'mvn -Prelease release' but see here:
> https://cwiki.apache.org/confluence/display/MAHOUT/How+To+Release
>
> On Mon, Apr 18, 2011 at 10:23 AM, Stanley Xu <we...@gmail.com> wrote:
>
> > Dear all,
> >
> > It might be a stupid question, but I am not that familiar with Maven. How
> > could I run a simple Maven script to create a distribution I could un-tar
> > the build on a hadoop cluster and just set the MAHOUT_HOME to run the
> > mahout
> > script?
> >
> > It I run "mvn install", the built jars would be put in different
> > sub-project
> > paths, it's really a little confusion to package the different required
> > libs, jars and scripts.
> >
> > Thanks in advance.
> >
> > Best wishes,
> > Stanley Xu
> >
>
Re: How to create a distribution from the snapshot codebase?
Posted by Sean Owen <sr...@gmail.com>.
It's basically 'mvn -Prelease release' but see here:
https://cwiki.apache.org/confluence/display/MAHOUT/How+To+Release
On Mon, Apr 18, 2011 at 10:23 AM, Stanley Xu <we...@gmail.com> wrote:
> Dear all,
>
> It might be a stupid question, but I am not that familiar with Maven. How
> could I run a simple Maven script to create a distribution I could un-tar
> the build on a hadoop cluster and just set the MAHOUT_HOME to run the
> mahout
> script?
>
> It I run "mvn install", the built jars would be put in different
> sub-project
> paths, it's really a little confusion to package the different required
> libs, jars and scripts.
>
> Thanks in advance.
>
> Best wishes,
> Stanley Xu
>
Re: How to create a distribution from the snapshot codebase?
Posted by Ankit Lakum <an...@gmail.com>.
the all docs is there in site you just have to follow the steps as per OS
and Version....
dont use your extra mind that's it .. .. .. .
http://maven.apache.org/guides/mini/guide-configuring-maven.html
On Mon, Apr 18, 2011 at 2:53 PM, Stanley Xu <we...@gmail.com> wrote:
> Dear all,
>
> It might be a stupid question, but I am not that familiar with Maven. How
> could I run a simple Maven script to create a distribution I could un-tar
> the build on a hadoop cluster and just set the MAHOUT_HOME to run the
> mahout
> script?
>
> It I run "mvn install", the built jars would be put in different
> sub-project
> paths, it's really a little confusion to package the different required
> libs, jars and scripts.
>
> Thanks in advance.
>
> Best wishes,
> Stanley Xu
>