You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Siddu <si...@gmail.com> on 2009/11/12 19:13:36 UTC
Building Hadoop from Source ?
Hi all,
I want to build hadoop from source rather than downloading the already
built tar ball.
Can someone please give me the steps or link to any pointers please
Thanks in advance
--
Regards,
~Sid~
I have never met a man so ignorant that i couldn't learn something from him
Re: Building Hadoop from Source ?
Posted by Siddu <si...@gmail.com>.
On Tue, Nov 24, 2009 at 6:10 PM, Siddu <si...@gmail.com> wrote:
>
>
> On Tue, Nov 24, 2009 at 6:01 PM, Steve Loughran <st...@apache.org> wrote:
>
>> Siddu wrote:
>>
>>> On Thu, Nov 12, 2009 at 11:50 PM, Stephen Watt <sw...@us.ibm.com> wrote:
>>>
>>> Hi Sid
>>>>
>>>> Check out the "Building" section in this link -
>>>> http://wiki.apache.org/hadoop/HowToRelease . Its pretty straight
>>>> forward.
>>>> If you choose to not remove the test targets expect the build to take
>>>> upwards of 2 hours as it runs through all the unit tests.
>>>>
>>>>
>>>> Hi all,
>>>
>>> I Have checked out the source code from
>>>
>>> URL: https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20
>>>
>>
Since the above link doesnt exist anymore
i am trying to build hadoop from 3 components .... namely hadoop/common,
hadoop/hdfs , hadoop/mapreduce .
does this suffice or do i have to build any other components ?
and while trying to build hadoop/hdfs i came across the following errors
.... how can i resolve them
[ivy:resolve] :: problems summary ::
[ivy:resolve] :::: WARNINGS
[ivy:resolve] module not found:
org.apache.hadoop#hadoop-core;0.21.0-SNAPSHOT
[ivy:resolve] ==== apache-snapshot: tried
[ivy:resolve]
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-SNAPSHOT/hadoop-core-0.21.0-SNAPSHOT.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-core;0.21.0-SNAPSHOT!hadoop-core.jar:
[ivy:resolve]
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-SNAPSHOT/hadoop-core-0.21.0-SNAPSHOT.jar
[ivy:resolve] ==== maven2: tried
[ivy:resolve]
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.21.0-SNAPSHOT/hadoop-core-0.21.0-SNAPSHOT.pom
[ivy:resolve] -- artifact
org.apache.hadoop#hadoop-core;0.21.0-SNAPSHOT!hadoop-core.jar:
[ivy:resolve]
http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.21.0-SNAPSHOT/hadoop-core-0.21.0-SNAPSHOT.jar
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: UNRESOLVED DEPENDENCIES ::
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :: org.apache.hadoop#hadoop-core;0.21.0-SNAPSHOT: not
found
[ivy:resolve] ::::::::::::::::::::::::::::::::::::::::::::::
[ivy:resolve] :::: ERRORS
[ivy:resolve] Server access Error: Can't connect to SOCKS
proxy:Connection refused url=
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-SNAPSHOT/maven-metadata.xml
[ivy:resolve] Server access Error: Can't connect to SOCKS
proxy:Connection refused url=
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-SNAPSHOT/hadoop-core-0.21.0-SNAPSHOT.pom
[ivy:resolve] Server access Error: Can't connect to SOCKS
proxy:Connection refused url=
https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/hadoop-core/0.21.0-SNAPSHOT/hadoop-core-0.21.0-SNAPSHOT.jar
[ivy:resolve]
[ivy:resolve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS
BUILD FAILED
/home/hadoop/hadoopHdfs/build.xml:1343: impossible to resolve dependencies:
> Repository Root: https://svn.apache.org/repos/asf
>>> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
>>> Revision: 763504
>>> Node Kind: directory
>>> Schedule: normal
>>> Last Changed Author: nigel
>>> Last Changed Rev: 763504
>>> Last Changed Date: 2009-04-09 09:20:11 +0530 (Thu, 09 Apr 2009)
>>>
>>> and i tried to build it using ant command
>>>
>>> any idea why its stopping at resolving dependencies ?
>>>
>>> ivy-resolve-common:
>>> [ivy:resolve] :: resolving dependencies ::
>>> org.apache.hadoop#Hadoop;working@sushanth-laptop
>>> [ivy:resolve] confs: [common]
>>>
>>>
>> Probably can't retrieve the dependency. Either your laptop is offline, or
>> Ant isn't set up to go through any proxy you have
>>
>
> ant -autoproxy #helped me
>
> --
> Regards,
> ~Sid~
> I have never met a man so ignorant that i couldn't learn something from him
>
>
>
--
Regards,
~Sid~
I have never met a man so ignorant that i couldn't learn something from him
Re: Building Hadoop from Source ?
Posted by Siddu <si...@gmail.com>.
On Tue, Nov 24, 2009 at 6:01 PM, Steve Loughran <st...@apache.org> wrote:
> Siddu wrote:
>
>> On Thu, Nov 12, 2009 at 11:50 PM, Stephen Watt <sw...@us.ibm.com> wrote:
>>
>> Hi Sid
>>>
>>> Check out the "Building" section in this link -
>>> http://wiki.apache.org/hadoop/HowToRelease . Its pretty straight
>>> forward.
>>> If you choose to not remove the test targets expect the build to take
>>> upwards of 2 hours as it runs through all the unit tests.
>>>
>>>
>>> Hi all,
>>
>> I Have checked out the source code from
>>
>> URL: https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20
>> Repository Root: https://svn.apache.org/repos/asf
>> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
>> Revision: 763504
>> Node Kind: directory
>> Schedule: normal
>> Last Changed Author: nigel
>> Last Changed Rev: 763504
>> Last Changed Date: 2009-04-09 09:20:11 +0530 (Thu, 09 Apr 2009)
>>
>> and i tried to build it using ant command
>>
>> any idea why its stopping at resolving dependencies ?
>>
>> ivy-resolve-common:
>> [ivy:resolve] :: resolving dependencies ::
>> org.apache.hadoop#Hadoop;working@sushanth-laptop
>> [ivy:resolve] confs: [common]
>>
>>
> Probably can't retrieve the dependency. Either your laptop is offline, or
> Ant isn't set up to go through any proxy you have
>
ant -autoproxy #helped me
--
Regards,
~Sid~
I have never met a man so ignorant that i couldn't learn something from him
Re: Building Hadoop from Source ?
Posted by Steve Loughran <st...@apache.org>.
Siddu wrote:
> On Thu, Nov 12, 2009 at 11:50 PM, Stephen Watt <sw...@us.ibm.com> wrote:
>
>> Hi Sid
>>
>> Check out the "Building" section in this link -
>> http://wiki.apache.org/hadoop/HowToRelease . Its pretty straight forward.
>> If you choose to not remove the test targets expect the build to take
>> upwards of 2 hours as it runs through all the unit tests.
>>
>>
> Hi all,
>
> I Have checked out the source code from
>
> URL: https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20
> Repository Root: https://svn.apache.org/repos/asf
> Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
> Revision: 763504
> Node Kind: directory
> Schedule: normal
> Last Changed Author: nigel
> Last Changed Rev: 763504
> Last Changed Date: 2009-04-09 09:20:11 +0530 (Thu, 09 Apr 2009)
>
> and i tried to build it using ant command
>
> any idea why its stopping at resolving dependencies ?
>
> ivy-resolve-common:
> [ivy:resolve] :: resolving dependencies ::
> org.apache.hadoop#Hadoop;working@sushanth-laptop
> [ivy:resolve] confs: [common]
>
Probably can't retrieve the dependency. Either your laptop is offline,
or Ant isn't set up to go through any proxy you have
Re: Building Hadoop from Source ?
Posted by Siddu <si...@gmail.com>.
On Thu, Nov 12, 2009 at 11:50 PM, Stephen Watt <sw...@us.ibm.com> wrote:
> Hi Sid
>
> Check out the "Building" section in this link -
> http://wiki.apache.org/hadoop/HowToRelease . Its pretty straight forward.
> If you choose to not remove the test targets expect the build to take
> upwards of 2 hours as it runs through all the unit tests.
>
>
Hi all,
I Have checked out the source code from
URL: https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20
Repository Root: https://svn.apache.org/repos/asf
Repository UUID: 13f79535-47bb-0310-9956-ffa450edef68
Revision: 763504
Node Kind: directory
Schedule: normal
Last Changed Author: nigel
Last Changed Rev: 763504
Last Changed Date: 2009-04-09 09:20:11 +0530 (Thu, 09 Apr 2009)
and i tried to build it using ant command
any idea why its stopping at resolving dependencies ?
ivy-resolve-common:
[ivy:resolve] :: resolving dependencies ::
org.apache.hadoop#Hadoop;working@sushanth-laptop
[ivy:resolve] confs: [common]
Please help me out !
> Kind regards
> Steve Watt
>
>
>
> From:
> Siddu <si...@gmail.com>
> To:
> common-user@hadoop.apache.org
> Date:
> 11/12/2009 12:14 PM
> Subject:
> Building Hadoop from Source ?
>
>
>
> Hi all,
>
> I want to build hadoop from source rather than downloading the already
> built tar ball.
>
> Can someone please give me the steps or link to any pointers please
>
> Thanks in advance
>
>
> --
> Regards,
> ~Sid~
> I have never met a man so ignorant that i couldn't learn something from
> him
>
>
>
--
Regards,
~Sid~
I have never met a man so ignorant that i couldn't learn something from him
Re: Building Hadoop from Source ?
Posted by Stephen Watt <sw...@us.ibm.com>.
Hi Sid
Check out the "Building" section in this link -
http://wiki.apache.org/hadoop/HowToRelease . Its pretty straight forward.
If you choose to not remove the test targets expect the build to take
upwards of 2 hours as it runs through all the unit tests.
Kind regards
Steve Watt
From:
Siddu <si...@gmail.com>
To:
common-user@hadoop.apache.org
Date:
11/12/2009 12:14 PM
Subject:
Building Hadoop from Source ?
Hi all,
I want to build hadoop from source rather than downloading the already
built tar ball.
Can someone please give me the steps or link to any pointers please
Thanks in advance
--
Regards,
~Sid~
I have never met a man so ignorant that i couldn't learn something from
him