You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Kay Kay <ka...@gmail.com> on 2010/01/23 04:36:57 UTC
Re: build and use hadoop-git
Start with hadoop-common to start building .
hadoop-hdfs / hadoop-mapred pull the dependencies from apache snapshot
repository that contains the nightlies of last successful builds so in
theory all 3 could be built independently because of the respective
snapshots being present in apache snapshot repository.
If you do want to make cross-project changes and test them -
* create a local ivy resolver and
* place it before the apache snapshot in the ivy settings .
* publish the jar for a given project to the directory pointed by the
ivy resolver in step 1
* clear ivy cache
* recompile.
On 11/29/09 11:05 AM, Vasilis Liaskovitis wrote:
> Hi,
>
> how can I build and use hadoop-git?
> The project has recently been split into 3 repositories hadoop-common,
> hadoop-hdfs and hadoop-mapred. It's not clear to me how to
> build/compile and use the git/tip for the whole framework. E.g. would
> building all jars from the 3 subprojects (and copying them under the
> same directory) work?
> Is there a guide/wiki page out there for this? Or perhaps there is
> another repository which still has a centralized trunk for all
> subprojects?
> thanks in advance,
>
> - Vasilis
>
Re: build and use hadoop-git
Posted by Steve Loughran <st...@apache.org>.
Kay Kay wrote:
> Start with hadoop-common to start building .
>
> hadoop-hdfs / hadoop-mapred pull the dependencies from apache snapshot
> repository that contains the nightlies of last successful builds so in
> theory all 3 could be built independently because of the respective
> snapshots being present in apache snapshot repository.
>
> If you do want to make cross-project changes and test them -
> * create a local ivy resolver and
> * place it before the apache snapshot in the ivy settings .
> * publish the jar for a given project to the directory pointed by the
> ivy resolver in step 1
> * clear ivy cache
> * recompile.
I think you just need to tweak build.properties to use the internal
resolver.
This is what I have symlinked into -common, -hdfs and -mapred
#This is symlinked across projects!
patch.version=1
resolvers=internal
#you can increment this number as you see fit
version=0.22.0-alpha-1
hadoop.version=${version}
hadoop-core.version=${version}
hadoop-hdfs.version=${version}
hadoop-mapred.version=${version}
Re: build and use hadoop-git
Posted by Aaron Kimball <aa...@cloudera.com>.
See http://wiki.apache.org/hadoop/HowToContribute for more step-by-step
instructions.
- Aaron
On Fri, Jan 22, 2010 at 7:36 PM, Kay Kay <ka...@gmail.com> wrote:
> Start with hadoop-common to start building .
>
> hadoop-hdfs / hadoop-mapred pull the dependencies from apache snapshot
> repository that contains the nightlies of last successful builds so in
> theory all 3 could be built independently because of the respective
> snapshots being present in apache snapshot repository.
>
> If you do want to make cross-project changes and test them -
> * create a local ivy resolver and
> * place it before the apache snapshot in the ivy settings .
> * publish the jar for a given project to the directory pointed by the ivy
> resolver in step 1
> * clear ivy cache
> * recompile.
>
>
>
>
>
> On 11/29/09 11:05 AM, Vasilis Liaskovitis wrote:
>
>> Hi,
>>
>> how can I build and use hadoop-git?
>> The project has recently been split into 3 repositories hadoop-common,
>> hadoop-hdfs and hadoop-mapred. It's not clear to me how to
>> build/compile and use the git/tip for the whole framework. E.g. would
>> building all jars from the 3 subprojects (and copying them under the
>> same directory) work?
>> Is there a guide/wiki page out there for this? Or perhaps there is
>> another repository which still has a centralized trunk for all
>> subprojects?
>> thanks in advance,
>>
>> - Vasilis
>>
>>
>
>
Re: build and use hadoop-git
Posted by Aaron Kimball <aa...@cloudera.com>.
See http://wiki.apache.org/hadoop/HowToContribute for more step-by-step
instructions.
- Aaron
On Fri, Jan 22, 2010 at 7:36 PM, Kay Kay <ka...@gmail.com> wrote:
> Start with hadoop-common to start building .
>
> hadoop-hdfs / hadoop-mapred pull the dependencies from apache snapshot
> repository that contains the nightlies of last successful builds so in
> theory all 3 could be built independently because of the respective
> snapshots being present in apache snapshot repository.
>
> If you do want to make cross-project changes and test them -
> * create a local ivy resolver and
> * place it before the apache snapshot in the ivy settings .
> * publish the jar for a given project to the directory pointed by the ivy
> resolver in step 1
> * clear ivy cache
> * recompile.
>
>
>
>
>
> On 11/29/09 11:05 AM, Vasilis Liaskovitis wrote:
>
>> Hi,
>>
>> how can I build and use hadoop-git?
>> The project has recently been split into 3 repositories hadoop-common,
>> hadoop-hdfs and hadoop-mapred. It's not clear to me how to
>> build/compile and use the git/tip for the whole framework. E.g. would
>> building all jars from the 3 subprojects (and copying them under the
>> same directory) work?
>> Is there a guide/wiki page out there for this? Or perhaps there is
>> another repository which still has a centralized trunk for all
>> subprojects?
>> thanks in advance,
>>
>> - Vasilis
>>
>>
>
>