You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by "Yakubovich, Alexey" <Al...@searshc.com> on 2014/11/22 19:45:54 UTC
building Apache Hadoop (main, Tez)
Hi,
I am trying to learn how to build couple of projects Apache Hadoop distribution, particularly:
1. The Hadoop-min project
https://github.com/apache/hadoop => hadoop-mapreduce-projct => hadoop-mapreduce-examples
groupID org.apache.hadoop
artifactID hadoop-main
2. Tez project
http://tez.apache.org/install_pre_0_5_0.html - tez
groupID org.apache.tez
artifactID tez
Now, I spent quite some time, no success yet.
Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
It seems that you should keep a particular order in building sub-modules ….
Thank you for any help
Alexey
This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by Tomás Fernández Pena <tf...@gmail.com>.
Hi Alexey
In
https://bitacoras.citius.usc.es/tecnologia/2014/06/05/hadoop-para-64-bits/
the steps to compile from source Hadoop r2.4.0 in CentOS 6.5 64 bits are
shown. The description is in spanish, but I think you can easily follow
the steps.
Cheers
Tomas
On 22/11/14 19:56, Leonid Fedotov wrote:
>
> Alexey,
> just download copy of HDP Sandbox and have fun.
> Do not spend time for building from scratch, does not worth it.
>
> Thank you!
>
> Leonid Fedotov
> Systems Architect - Professional Services
> lfedotov@hortonworks.com <ma...@hortonworks.com>
> mobile: +1 650 430 1673
>
>
> On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey"
> <Alexey.Yakubovich@searshc.com <ma...@searshc.com>>
> wrote:
>
> Hi,
>
> I am trying to learn how to build couple of projects Apache
> Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupIDorg.apache.hadoop
> artifactIDhadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupIDorg.apache.tez
> artifactIDtez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP
> (2.1)?
>
> It seems that you should keep a particular order in building
> sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is
> confidential and may contain proprietary or legally privileged
> information. If you are not the intended recipient, please delete
> it without reading the contents. Thank you.
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or
> entity to which it is addressed and may contain information that is
> confidential, privileged and exempt from disclosure under applicable
> law. If the reader of this message is not the intended recipient, you
> are hereby notified that any printing, copying, dissemination,
> distribution, disclosure or forwarding of this communication is
> strictly prohibited. If you have received this communication in error,
> please contact the sender immediately and delete it from your system.
> Thank You.
Re: building Apache Hadoop (main, Tez)
Posted by Tomás Fernández Pena <tf...@gmail.com>.
Hi Alexey
In
https://bitacoras.citius.usc.es/tecnologia/2014/06/05/hadoop-para-64-bits/
the steps to compile from source Hadoop r2.4.0 in CentOS 6.5 64 bits are
shown. The description is in spanish, but I think you can easily follow
the steps.
Cheers
Tomas
On 22/11/14 19:56, Leonid Fedotov wrote:
>
> Alexey,
> just download copy of HDP Sandbox and have fun.
> Do not spend time for building from scratch, does not worth it.
>
> Thank you!
>
> Leonid Fedotov
> Systems Architect - Professional Services
> lfedotov@hortonworks.com <ma...@hortonworks.com>
> mobile: +1 650 430 1673
>
>
> On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey"
> <Alexey.Yakubovich@searshc.com <ma...@searshc.com>>
> wrote:
>
> Hi,
>
> I am trying to learn how to build couple of projects Apache
> Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupIDorg.apache.hadoop
> artifactIDhadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupIDorg.apache.tez
> artifactIDtez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP
> (2.1)?
>
> It seems that you should keep a particular order in building
> sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is
> confidential and may contain proprietary or legally privileged
> information. If you are not the intended recipient, please delete
> it without reading the contents. Thank you.
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or
> entity to which it is addressed and may contain information that is
> confidential, privileged and exempt from disclosure under applicable
> law. If the reader of this message is not the intended recipient, you
> are hereby notified that any printing, copying, dissemination,
> distribution, disclosure or forwarding of this communication is
> strictly prohibited. If you have received this communication in error,
> please contact the sender immediately and delete it from your system.
> Thank You.
Re: building Apache Hadoop (main, Tez)
Posted by Tomás Fernández Pena <tf...@gmail.com>.
Hi Alexey
In
https://bitacoras.citius.usc.es/tecnologia/2014/06/05/hadoop-para-64-bits/
the steps to compile from source Hadoop r2.4.0 in CentOS 6.5 64 bits are
shown. The description is in spanish, but I think you can easily follow
the steps.
Cheers
Tomas
On 22/11/14 19:56, Leonid Fedotov wrote:
>
> Alexey,
> just download copy of HDP Sandbox and have fun.
> Do not spend time for building from scratch, does not worth it.
>
> Thank you!
>
> Leonid Fedotov
> Systems Architect - Professional Services
> lfedotov@hortonworks.com <ma...@hortonworks.com>
> mobile: +1 650 430 1673
>
>
> On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey"
> <Alexey.Yakubovich@searshc.com <ma...@searshc.com>>
> wrote:
>
> Hi,
>
> I am trying to learn how to build couple of projects Apache
> Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupIDorg.apache.hadoop
> artifactIDhadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupIDorg.apache.tez
> artifactIDtez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP
> (2.1)?
>
> It seems that you should keep a particular order in building
> sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is
> confidential and may contain proprietary or legally privileged
> information. If you are not the intended recipient, please delete
> it without reading the contents. Thank you.
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or
> entity to which it is addressed and may contain information that is
> confidential, privileged and exempt from disclosure under applicable
> law. If the reader of this message is not the intended recipient, you
> are hereby notified that any printing, copying, dissemination,
> distribution, disclosure or forwarding of this communication is
> strictly prohibited. If you have received this communication in error,
> please contact the sender immediately and delete it from your system.
> Thank You.
Re: building Apache Hadoop (main, Tez)
Posted by Tomás Fernández Pena <tf...@gmail.com>.
Hi Alexey
In
https://bitacoras.citius.usc.es/tecnologia/2014/06/05/hadoop-para-64-bits/
the steps to compile from source Hadoop r2.4.0 in CentOS 6.5 64 bits are
shown. The description is in spanish, but I think you can easily follow
the steps.
Cheers
Tomas
On 22/11/14 19:56, Leonid Fedotov wrote:
>
> Alexey,
> just download copy of HDP Sandbox and have fun.
> Do not spend time for building from scratch, does not worth it.
>
> Thank you!
>
> Leonid Fedotov
> Systems Architect - Professional Services
> lfedotov@hortonworks.com <ma...@hortonworks.com>
> mobile: +1 650 430 1673
>
>
> On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey"
> <Alexey.Yakubovich@searshc.com <ma...@searshc.com>>
> wrote:
>
> Hi,
>
> I am trying to learn how to build couple of projects Apache
> Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupIDorg.apache.hadoop
> artifactIDhadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupIDorg.apache.tez
> artifactIDtez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP
> (2.1)?
>
> It seems that you should keep a particular order in building
> sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is
> confidential and may contain proprietary or legally privileged
> information. If you are not the intended recipient, please delete
> it without reading the contents. Thank you.
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or
> entity to which it is addressed and may contain information that is
> confidential, privileged and exempt from disclosure under applicable
> law. If the reader of this message is not the intended recipient, you
> are hereby notified that any printing, copying, dissemination,
> distribution, disclosure or forwarding of this communication is
> strictly prohibited. If you have received this communication in error,
> please contact the sender immediately and delete it from your system.
> Thank You.
Re: building Apache Hadoop (main, Tez)
Posted by Leonid Fedotov <lf...@hortonworks.com>.
Alexey,
just download copy of HDP Sandbox and have fun.
Do not spend time for building from scratch, does not worth it.
Thank you!
Leonid Fedotov
Systems Architect - Professional Services
lfedotov@hortonworks.com
mobile: +1 650 430 1673
On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey" <
Alexey.Yakubovich@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop
> distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupID org.apache.hadoop
> artifactID hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID org.apache.tez
> artifactID tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules
> ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is confidential and
> may contain proprietary or legally privileged information. If you are not
> the intended recipient, please delete it without reading the contents.
> Thank you.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: building Apache Hadoop (main, Tez)
Posted by "Yakubovich, Alexey" <Al...@searshc.com>.
Hitesh,
Thank you, with this your help I successfully build both hadoop-mail and
tez projects from Apache.
On the way I of course should have fixed protoc Š..
Thank you again
Alexey
On 11/22/14, 10:25 PM, "Hitesh Shah" <hi...@apache.org> wrote:
>Hi Alexey,
>
>Would you mind sharing details on the issues that you are facing?
>
>For both hadoop and tez, refer to the respective BUILDING.txt as it
>contains some basic information on required tools to build the project (
>maven, protoc, etc ).
>
>For hadoop, you should just need to run ³mvn install -DskipTests² at the
>very top of the source tree.
>For tez, modify the top-level pom.xml to set hadoop.version to the
>version of hadoop that you just compiled ( from the previous step ) and
>then run ³mvn install -DskipTests²
>
>‹ Hitesh
>
>On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey
><Al...@searshc.com> wrote:
>
>> Hi,
>>
>> I am trying to learn how to build couple of projects Apache Hadoop
>>distribution, particularly:
>>
>> 1. The Hadoop-min project
>>
>> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
>>hadoop-mapreduce-examples
>> groupID
>> org.apache.hadoop
>> artifactID
>> hadoop-main
>>
>> 2. Tez project
>>
>> http://tez.apache.org/install_pre_0_5_0.html - tez
>> groupID
>> org.apache.tez
>> artifactID
>> tez
>>
>> Now, I spent quite some time, no success yet.
>> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>>
>> It seems that you should keep a particular order in building
>>sub-modules Š.
>>
>> Thank you for any help
>>
>> Alexey
>> This message, including any attachments, is the property of Sears
>>Holdings Corporation and/or one of its subsidiaries. It is confidential
>>and may contain proprietary or legally privileged information. If you
>>are not the intended recipient, please delete it without reading the
>>contents. Thank you.
>
This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by "Yakubovich, Alexey" <Al...@searshc.com>.
Hitesh,
Thank you, with this your help I successfully build both hadoop-mail and
tez projects from Apache.
On the way I of course should have fixed protoc Š..
Thank you again
Alexey
On 11/22/14, 10:25 PM, "Hitesh Shah" <hi...@apache.org> wrote:
>Hi Alexey,
>
>Would you mind sharing details on the issues that you are facing?
>
>For both hadoop and tez, refer to the respective BUILDING.txt as it
>contains some basic information on required tools to build the project (
>maven, protoc, etc ).
>
>For hadoop, you should just need to run ³mvn install -DskipTests² at the
>very top of the source tree.
>For tez, modify the top-level pom.xml to set hadoop.version to the
>version of hadoop that you just compiled ( from the previous step ) and
>then run ³mvn install -DskipTests²
>
>‹ Hitesh
>
>On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey
><Al...@searshc.com> wrote:
>
>> Hi,
>>
>> I am trying to learn how to build couple of projects Apache Hadoop
>>distribution, particularly:
>>
>> 1. The Hadoop-min project
>>
>> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
>>hadoop-mapreduce-examples
>> groupID
>> org.apache.hadoop
>> artifactID
>> hadoop-main
>>
>> 2. Tez project
>>
>> http://tez.apache.org/install_pre_0_5_0.html - tez
>> groupID
>> org.apache.tez
>> artifactID
>> tez
>>
>> Now, I spent quite some time, no success yet.
>> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>>
>> It seems that you should keep a particular order in building
>>sub-modules Š.
>>
>> Thank you for any help
>>
>> Alexey
>> This message, including any attachments, is the property of Sears
>>Holdings Corporation and/or one of its subsidiaries. It is confidential
>>and may contain proprietary or legally privileged information. If you
>>are not the intended recipient, please delete it without reading the
>>contents. Thank you.
>
This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by "Yakubovich, Alexey" <Al...@searshc.com>.
Hitesh,
Thank you, with this your help I successfully build both hadoop-mail and
tez projects from Apache.
On the way I of course should have fixed protoc Š..
Thank you again
Alexey
On 11/22/14, 10:25 PM, "Hitesh Shah" <hi...@apache.org> wrote:
>Hi Alexey,
>
>Would you mind sharing details on the issues that you are facing?
>
>For both hadoop and tez, refer to the respective BUILDING.txt as it
>contains some basic information on required tools to build the project (
>maven, protoc, etc ).
>
>For hadoop, you should just need to run ³mvn install -DskipTests² at the
>very top of the source tree.
>For tez, modify the top-level pom.xml to set hadoop.version to the
>version of hadoop that you just compiled ( from the previous step ) and
>then run ³mvn install -DskipTests²
>
>‹ Hitesh
>
>On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey
><Al...@searshc.com> wrote:
>
>> Hi,
>>
>> I am trying to learn how to build couple of projects Apache Hadoop
>>distribution, particularly:
>>
>> 1. The Hadoop-min project
>>
>> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
>>hadoop-mapreduce-examples
>> groupID
>> org.apache.hadoop
>> artifactID
>> hadoop-main
>>
>> 2. Tez project
>>
>> http://tez.apache.org/install_pre_0_5_0.html - tez
>> groupID
>> org.apache.tez
>> artifactID
>> tez
>>
>> Now, I spent quite some time, no success yet.
>> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>>
>> It seems that you should keep a particular order in building
>>sub-modules Š.
>>
>> Thank you for any help
>>
>> Alexey
>> This message, including any attachments, is the property of Sears
>>Holdings Corporation and/or one of its subsidiaries. It is confidential
>>and may contain proprietary or legally privileged information. If you
>>are not the intended recipient, please delete it without reading the
>>contents. Thank you.
>
This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by "Yakubovich, Alexey" <Al...@searshc.com>.
Hitesh,
Thank you, with this your help I successfully build both hadoop-mail and
tez projects from Apache.
On the way I of course should have fixed protoc Š..
Thank you again
Alexey
On 11/22/14, 10:25 PM, "Hitesh Shah" <hi...@apache.org> wrote:
>Hi Alexey,
>
>Would you mind sharing details on the issues that you are facing?
>
>For both hadoop and tez, refer to the respective BUILDING.txt as it
>contains some basic information on required tools to build the project (
>maven, protoc, etc ).
>
>For hadoop, you should just need to run ³mvn install -DskipTests² at the
>very top of the source tree.
>For tez, modify the top-level pom.xml to set hadoop.version to the
>version of hadoop that you just compiled ( from the previous step ) and
>then run ³mvn install -DskipTests²
>
>‹ Hitesh
>
>On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey
><Al...@searshc.com> wrote:
>
>> Hi,
>>
>> I am trying to learn how to build couple of projects Apache Hadoop
>>distribution, particularly:
>>
>> 1. The Hadoop-min project
>>
>> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
>>hadoop-mapreduce-examples
>> groupID
>> org.apache.hadoop
>> artifactID
>> hadoop-main
>>
>> 2. Tez project
>>
>> http://tez.apache.org/install_pre_0_5_0.html - tez
>> groupID
>> org.apache.tez
>> artifactID
>> tez
>>
>> Now, I spent quite some time, no success yet.
>> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>>
>> It seems that you should keep a particular order in building
>>sub-modules Š.
>>
>> Thank you for any help
>>
>> Alexey
>> This message, including any attachments, is the property of Sears
>>Holdings Corporation and/or one of its subsidiaries. It is confidential
>>and may contain proprietary or legally privileged information. If you
>>are not the intended recipient, please delete it without reading the
>>contents. Thank you.
>
This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by Hitesh Shah <hi...@apache.org>.
Hi Alexey,
Would you mind sharing details on the issues that you are facing?
For both hadoop and tez, refer to the respective BUILDING.txt as it contains some basic information on required tools to build the project ( maven, protoc, etc ).
For hadoop, you should just need to run “mvn install -DskipTests” at the very top of the source tree.
For tez, modify the top-level pom.xml to set hadoop.version to the version of hadoop that you just compiled ( from the previous step ) and then run “mvn install -DskipTests”
— Hitesh
On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey <Al...@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct => hadoop-mapreduce-examples
> groupID
> org.apache.hadoop
> artifactID
> hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID
> org.apache.tez
> artifactID
> tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by Leonid Fedotov <lf...@hortonworks.com>.
Alexey,
just download copy of HDP Sandbox and have fun.
Do not spend time for building from scratch, does not worth it.
Thank you!
Leonid Fedotov
Systems Architect - Professional Services
lfedotov@hortonworks.com
mobile: +1 650 430 1673
On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey" <
Alexey.Yakubovich@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop
> distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupID org.apache.hadoop
> artifactID hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID org.apache.tez
> artifactID tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules
> ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is confidential and
> may contain proprietary or legally privileged information. If you are not
> the intended recipient, please delete it without reading the contents.
> Thank you.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: building Apache Hadoop (main, Tez)
Posted by Leonid Fedotov <lf...@hortonworks.com>.
Alexey,
just download copy of HDP Sandbox and have fun.
Do not spend time for building from scratch, does not worth it.
Thank you!
Leonid Fedotov
Systems Architect - Professional Services
lfedotov@hortonworks.com
mobile: +1 650 430 1673
On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey" <
Alexey.Yakubovich@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop
> distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupID org.apache.hadoop
> artifactID hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID org.apache.tez
> artifactID tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules
> ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is confidential and
> may contain proprietary or legally privileged information. If you are not
> the intended recipient, please delete it without reading the contents.
> Thank you.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: building Apache Hadoop (main, Tez)
Posted by Hitesh Shah <hi...@apache.org>.
Hi Alexey,
Would you mind sharing details on the issues that you are facing?
For both hadoop and tez, refer to the respective BUILDING.txt as it contains some basic information on required tools to build the project ( maven, protoc, etc ).
For hadoop, you should just need to run “mvn install -DskipTests” at the very top of the source tree.
For tez, modify the top-level pom.xml to set hadoop.version to the version of hadoop that you just compiled ( from the previous step ) and then run “mvn install -DskipTests”
— Hitesh
On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey <Al...@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct => hadoop-mapreduce-examples
> groupID
> org.apache.hadoop
> artifactID
> hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID
> org.apache.tez
> artifactID
> tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by Hitesh Shah <hi...@apache.org>.
Hi Alexey,
Would you mind sharing details on the issues that you are facing?
For both hadoop and tez, refer to the respective BUILDING.txt as it contains some basic information on required tools to build the project ( maven, protoc, etc ).
For hadoop, you should just need to run “mvn install -DskipTests” at the very top of the source tree.
For tez, modify the top-level pom.xml to set hadoop.version to the version of hadoop that you just compiled ( from the previous step ) and then run “mvn install -DskipTests”
— Hitesh
On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey <Al...@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct => hadoop-mapreduce-examples
> groupID
> org.apache.hadoop
> artifactID
> hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID
> org.apache.tez
> artifactID
> tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by Hitesh Shah <hi...@apache.org>.
Hi Alexey,
Would you mind sharing details on the issues that you are facing?
For both hadoop and tez, refer to the respective BUILDING.txt as it contains some basic information on required tools to build the project ( maven, protoc, etc ).
For hadoop, you should just need to run “mvn install -DskipTests” at the very top of the source tree.
For tez, modify the top-level pom.xml to set hadoop.version to the version of hadoop that you just compiled ( from the previous step ) and then run “mvn install -DskipTests”
— Hitesh
On Nov 22, 2014, at 10:45 AM, Yakubovich, Alexey <Al...@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct => hadoop-mapreduce-examples
> groupID
> org.apache.hadoop
> artifactID
> hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID
> org.apache.tez
> artifactID
> tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears Holdings Corporation and/or one of its subsidiaries. It is confidential and may contain proprietary or legally privileged information. If you are not the intended recipient, please delete it without reading the contents. Thank you.
Re: building Apache Hadoop (main, Tez)
Posted by Leonid Fedotov <lf...@hortonworks.com>.
Alexey,
just download copy of HDP Sandbox and have fun.
Do not spend time for building from scratch, does not worth it.
Thank you!
Leonid Fedotov
Systems Architect - Professional Services
lfedotov@hortonworks.com
mobile: +1 650 430 1673
On Nov 22, 2014 10:47 AM, "Yakubovich, Alexey" <
Alexey.Yakubovich@searshc.com> wrote:
> Hi,
>
> I am trying to learn how to build couple of projects Apache Hadoop
> distribution, particularly:
>
> 1. The Hadoop-min project
>
> https://github.com/apache/hadoop => hadoop-mapreduce-projct =>
> hadoop-mapreduce-examples
> groupID org.apache.hadoop
> artifactID hadoop-main
>
> 2. Tez project
>
> http://tez.apache.org/install_pre_0_5_0.html - tez
> groupID org.apache.tez
> artifactID tez
>
> Now, I spent quite some time, no success yet.
> Is ip possible at all, of you suppose to use Cloudera (5) or HDP (2.1)?
>
> It seems that you should keep a particular order in building sub-modules
> ….
>
> Thank you for any help
>
> Alexey
> This message, including any attachments, is the property of Sears
> Holdings Corporation and/or one of its subsidiaries. It is confidential and
> may contain proprietary or legally privileged information. If you are not
> the intended recipient, please delete it without reading the contents.
> Thank you.
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.