You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Lucio Crusca <lu...@sulweb.org> on 2015/02/11 23:02:46 UTC
Building for Windows
Hello everybody,
I'm absolutely new to hadoop and a customer asked me to build version 2.6 for
Windows Server 2012 R2. I'm myself a java programmer, among other things, but
I've never used hadoop before.
I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...) and
other toys specified in the BUILDING.txt file bundled with hadoop sources. I
also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
Platform, ...).
Running
mvn package -Pdist -Dtar
it compiles everything till MiniKDC included, but then it fails a test after
compiling Auth.
Here you can see the full output of the mvn command:
http://hastebin.com/aqixebojuv.tex
Can you help me understand what I'm doing wrong?
Thanks in advance
Lucio.
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
There are about 3000 tests
It should be particular box configuration to run all tests successfully
you should have lots of memory
It takes min 1 hour to run all tests
Look at hadoop pre-commit builds on jenkins
https://builds.apache.org/job/PreCommit-HADOOP-Build/
On Wed, Feb 11, 2015 at 3:55 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha
> scritto:
> > in addition to skipTests you want to add "native-win" profile
> >
> > > mvn clean package -Pdist,native-win -DskipTests -Dtar
>
> Ok thanks but... what's the point of having tests in place if you have to
> skip
> them in order to build?
>
> >
> > this command must be run from a Windows SDK command prompt (not cygwin)
>
> Yes I was already doing that, Cygwin is only installed to provide a few
> required unix commands (from BUILDING.txt: * Unix command-line tools from
> GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
> remember I had problems with GnuWin32 and went for Cygwin instead.
>
>
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
There are about 3000 tests
It should be particular box configuration to run all tests successfully
you should have lots of memory
It takes min 1 hour to run all tests
Look at hadoop pre-commit builds on jenkins
https://builds.apache.org/job/PreCommit-HADOOP-Build/
On Wed, Feb 11, 2015 at 3:55 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha
> scritto:
> > in addition to skipTests you want to add "native-win" profile
> >
> > > mvn clean package -Pdist,native-win -DskipTests -Dtar
>
> Ok thanks but... what's the point of having tests in place if you have to
> skip
> them in order to build?
>
> >
> > this command must be run from a Windows SDK command prompt (not cygwin)
>
> Yes I was already doing that, Cygwin is only installed to provide a few
> required unix commands (from BUILDING.txt: * Unix command-line tools from
> GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
> remember I had problems with GnuWin32 and went for Cygwin instead.
>
>
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
There are about 3000 tests
It should be particular box configuration to run all tests successfully
you should have lots of memory
It takes min 1 hour to run all tests
Look at hadoop pre-commit builds on jenkins
https://builds.apache.org/job/PreCommit-HADOOP-Build/
On Wed, Feb 11, 2015 at 3:55 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha
> scritto:
> > in addition to skipTests you want to add "native-win" profile
> >
> > > mvn clean package -Pdist,native-win -DskipTests -Dtar
>
> Ok thanks but... what's the point of having tests in place if you have to
> skip
> them in order to build?
>
> >
> > this command must be run from a Windows SDK command prompt (not cygwin)
>
> Yes I was already doing that, Cygwin is only installed to provide a few
> required unix commands (from BUILDING.txt: * Unix command-line tools from
> GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
> remember I had problems with GnuWin32 and went for Cygwin instead.
>
>
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
There are about 3000 tests
It should be particular box configuration to run all tests successfully
you should have lots of memory
It takes min 1 hour to run all tests
Look at hadoop pre-commit builds on jenkins
https://builds.apache.org/job/PreCommit-HADOOP-Build/
On Wed, Feb 11, 2015 at 3:55 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha
> scritto:
> > in addition to skipTests you want to add "native-win" profile
> >
> > > mvn clean package -Pdist,native-win -DskipTests -Dtar
>
> Ok thanks but... what's the point of having tests in place if you have to
> skip
> them in order to build?
>
> >
> > this command must be run from a Windows SDK command prompt (not cygwin)
>
> Yes I was already doing that, Cygwin is only installed to provide a few
> required unix commands (from BUILDING.txt: * Unix command-line tools from
> GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
> remember I had problems with GnuWin32 and went for Cygwin instead.
>
>
>
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha scritto:
> in addition to skipTests you want to add "native-win" profile
>
> > mvn clean package -Pdist,native-win -DskipTests -Dtar
Ok thanks but... what's the point of having tests in place if you have to skip
them in order to build?
>
> this command must be run from a Windows SDK command prompt (not cygwin)
Yes I was already doing that, Cygwin is only installed to provide a few
required unix commands (from BUILDING.txt: * Unix command-line tools from
GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
remember I had problems with GnuWin32 and went for Cygwin instead.
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha scritto:
> in addition to skipTests you want to add "native-win" profile
>
> > mvn clean package -Pdist,native-win -DskipTests -Dtar
Ok thanks but... what's the point of having tests in place if you have to skip
them in order to build?
>
> this command must be run from a Windows SDK command prompt (not cygwin)
Yes I was already doing that, Cygwin is only installed to provide a few
required unix commands (from BUILDING.txt: * Unix command-line tools from
GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
remember I had problems with GnuWin32 and went for Cygwin instead.
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha scritto:
> in addition to skipTests you want to add "native-win" profile
>
> > mvn clean package -Pdist,native-win -DskipTests -Dtar
Ok thanks but... what's the point of having tests in place if you have to skip
them in order to build?
>
> this command must be run from a Windows SDK command prompt (not cygwin)
Yes I was already doing that, Cygwin is only installed to provide a few
required unix commands (from BUILDING.txt: * Unix command-line tools from
GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
remember I had problems with GnuWin32 and went for Cygwin instead.
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
In data mercoledì 11 febbraio 2015 15:17:23, Alexander Pivovarov ha scritto:
> in addition to skipTests you want to add "native-win" profile
>
> > mvn clean package -Pdist,native-win -DskipTests -Dtar
Ok thanks but... what's the point of having tests in place if you have to skip
them in order to build?
>
> this command must be run from a Windows SDK command prompt (not cygwin)
Yes I was already doing that, Cygwin is only installed to provide a few
required unix commands (from BUILDING.txt: * Unix command-line tools from
GnuWin32 or Cygwin: sh, mkdir, rm, cp, tar, gzip). For some reason I don't
remember I had problems with GnuWin32 and went for Cygwin instead.
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
in addition to skipTests you want to add "native-win" profile
> mvn clean package -Pdist,native-win -DskipTests -Dtar
this command must be run from a Windows SDK command prompt (not cygwin) as
documented in BUILDING.txt. A successful build generates a binary hadoop
.tar.gz package in hadoop-dist\target\.
https://wiki.apache.org/hadoop/Hadoop2OnWindows
https://svn.apache.org/viewvc/hadoop/common/branches/branch-2/BUILDING.txt?view=markup
On Wed, Feb 11, 2015 at 3:09 PM, Alexander Pivovarov <ap...@gmail.com>
wrote:
> try
>
> mvn package -Pdist -Dtar -DskipTests
>
> On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
>
>> Hello everybody,
>>
>> I'm absolutely new to hadoop and a customer asked me to build version 2.6
>> for
>> Windows Server 2012 R2. I'm myself a java programmer, among other things,
>> but
>> I've never used hadoop before.
>>
>> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
>> and
>> other toys specified in the BUILDING.txt file bundled with hadoop
>> sources. I
>> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
>> Platform, ...).
>>
>> Running
>>
>> mvn package -Pdist -Dtar
>>
>> it compiles everything till MiniKDC included, but then it fails a test
>> after
>> compiling Auth.
>>
>> Here you can see the full output of the mvn command:
>>
>> http://hastebin.com/aqixebojuv.tex
>>
>> Can you help me understand what I'm doing wrong?
>>
>> Thanks in advance
>> Lucio.
>>
>
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
in addition to skipTests you want to add "native-win" profile
> mvn clean package -Pdist,native-win -DskipTests -Dtar
this command must be run from a Windows SDK command prompt (not cygwin) as
documented in BUILDING.txt. A successful build generates a binary hadoop
.tar.gz package in hadoop-dist\target\.
https://wiki.apache.org/hadoop/Hadoop2OnWindows
https://svn.apache.org/viewvc/hadoop/common/branches/branch-2/BUILDING.txt?view=markup
On Wed, Feb 11, 2015 at 3:09 PM, Alexander Pivovarov <ap...@gmail.com>
wrote:
> try
>
> mvn package -Pdist -Dtar -DskipTests
>
> On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
>
>> Hello everybody,
>>
>> I'm absolutely new to hadoop and a customer asked me to build version 2.6
>> for
>> Windows Server 2012 R2. I'm myself a java programmer, among other things,
>> but
>> I've never used hadoop before.
>>
>> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
>> and
>> other toys specified in the BUILDING.txt file bundled with hadoop
>> sources. I
>> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
>> Platform, ...).
>>
>> Running
>>
>> mvn package -Pdist -Dtar
>>
>> it compiles everything till MiniKDC included, but then it fails a test
>> after
>> compiling Auth.
>>
>> Here you can see the full output of the mvn command:
>>
>> http://hastebin.com/aqixebojuv.tex
>>
>> Can you help me understand what I'm doing wrong?
>>
>> Thanks in advance
>> Lucio.
>>
>
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
in addition to skipTests you want to add "native-win" profile
> mvn clean package -Pdist,native-win -DskipTests -Dtar
this command must be run from a Windows SDK command prompt (not cygwin) as
documented in BUILDING.txt. A successful build generates a binary hadoop
.tar.gz package in hadoop-dist\target\.
https://wiki.apache.org/hadoop/Hadoop2OnWindows
https://svn.apache.org/viewvc/hadoop/common/branches/branch-2/BUILDING.txt?view=markup
On Wed, Feb 11, 2015 at 3:09 PM, Alexander Pivovarov <ap...@gmail.com>
wrote:
> try
>
> mvn package -Pdist -Dtar -DskipTests
>
> On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
>
>> Hello everybody,
>>
>> I'm absolutely new to hadoop and a customer asked me to build version 2.6
>> for
>> Windows Server 2012 R2. I'm myself a java programmer, among other things,
>> but
>> I've never used hadoop before.
>>
>> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
>> and
>> other toys specified in the BUILDING.txt file bundled with hadoop
>> sources. I
>> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
>> Platform, ...).
>>
>> Running
>>
>> mvn package -Pdist -Dtar
>>
>> it compiles everything till MiniKDC included, but then it fails a test
>> after
>> compiling Auth.
>>
>> Here you can see the full output of the mvn command:
>>
>> http://hastebin.com/aqixebojuv.tex
>>
>> Can you help me understand what I'm doing wrong?
>>
>> Thanks in advance
>> Lucio.
>>
>
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
in addition to skipTests you want to add "native-win" profile
> mvn clean package -Pdist,native-win -DskipTests -Dtar
this command must be run from a Windows SDK command prompt (not cygwin) as
documented in BUILDING.txt. A successful build generates a binary hadoop
.tar.gz package in hadoop-dist\target\.
https://wiki.apache.org/hadoop/Hadoop2OnWindows
https://svn.apache.org/viewvc/hadoop/common/branches/branch-2/BUILDING.txt?view=markup
On Wed, Feb 11, 2015 at 3:09 PM, Alexander Pivovarov <ap...@gmail.com>
wrote:
> try
>
> mvn package -Pdist -Dtar -DskipTests
>
> On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
>
>> Hello everybody,
>>
>> I'm absolutely new to hadoop and a customer asked me to build version 2.6
>> for
>> Windows Server 2012 R2. I'm myself a java programmer, among other things,
>> but
>> I've never used hadoop before.
>>
>> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
>> and
>> other toys specified in the BUILDING.txt file bundled with hadoop
>> sources. I
>> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
>> Platform, ...).
>>
>> Running
>>
>> mvn package -Pdist -Dtar
>>
>> it compiles everything till MiniKDC included, but then it fails a test
>> after
>> compiling Auth.
>>
>> Here you can see the full output of the mvn command:
>>
>> http://hastebin.com/aqixebojuv.tex
>>
>> Can you help me understand what I'm doing wrong?
>>
>> Thanks in advance
>> Lucio.
>>
>
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
try
mvn package -Pdist -Dtar -DskipTests
On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version 2.6
> for
> Windows Server 2012 R2. I'm myself a java programmer, among other things,
> but
> I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
> and
> other toys specified in the BUILDING.txt file bundled with hadoop sources.
> I
> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
> Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after
> compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
>
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
try
mvn package -Pdist -Dtar -DskipTests
On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version 2.6
> for
> Windows Server 2012 R2. I'm myself a java programmer, among other things,
> but
> I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
> and
> other toys specified in the BUILDING.txt file bundled with hadoop sources.
> I
> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
> Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after
> compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
>
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Lucio,
You need to install any of following on your build machine. These are one time install and do not need internet connection. You can download ISO of VS and install.
These tools are necessary to build native C++ code in hadoop-common and hadoop-hdfs
1.Windows 7.1 SDK (Along with Microsoft Visual C++ 10)
OR
2. Windows 8.1 SDK with Visual Studio 2013 Express (If this is installed, follow instructions in http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988 to upgrade Build files0
The above installation can be in any drive.
Just ensure that you use the command prompt given by SDK/Visual Studio. These command prompts will have paths set to msbuild.exe, cl.exe etc.
If you do not want to use these command prompt, then run the relevant batch files to set all ENV variable. These batch files can be found in the VS installation directory.
Eg: "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64\vcvarsx86_amd64.bat" This batch files will set all relevant PATH
Maven needs internet connection to download the dependent POM and JARs.
If your build server is not having internet access, then you need to complete a successful build on some other machine and copy maven repo directory to build server.
While building you can instruct maven to work offline and use the build directory you have copied.
Eg: you can add this option "-Drepo.dir=D:\maven_repo -o" to mvn commands on build server
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 12:56
> To: user@hadoop.apache.org
> Subject: Re: Building for Windows
>
> Though I've gone go one step further, the build now stops with the
> following
> error:
>
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-
> plugin:1.2:exec
> (compile-ms-winutils) on project hadoop-common: Command execution
> failed.
> Cannot run program "msbuild"...
>
> I'm running the build from the Windows SDK command prompt, but
> msbuild.exe isn't on the PATH and it is actually missing in the whole
> C:.
>
> I do have a msbuild.exe file on the Windows installation CD-ROM in
>
> D:
> \sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d
> 4ddf5d348
>
> but I prefer avoid using it directly, because I need a repeatable build
> procedure. This is a test drive, but I'll have to build hadoop on a
> production server that has no internet access, so I'd like to
> understand what should I do in order to have msbuild.exe in C:.
>
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Lucio,
You need to install any of following on your build machine. These are one time install and do not need internet connection. You can download ISO of VS and install.
These tools are necessary to build native C++ code in hadoop-common and hadoop-hdfs
1.Windows 7.1 SDK (Along with Microsoft Visual C++ 10)
OR
2. Windows 8.1 SDK with Visual Studio 2013 Express (If this is installed, follow instructions in http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988 to upgrade Build files0
The above installation can be in any drive.
Just ensure that you use the command prompt given by SDK/Visual Studio. These command prompts will have paths set to msbuild.exe, cl.exe etc.
If you do not want to use these command prompt, then run the relevant batch files to set all ENV variable. These batch files can be found in the VS installation directory.
Eg: "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64\vcvarsx86_amd64.bat" This batch files will set all relevant PATH
Maven needs internet connection to download the dependent POM and JARs.
If your build server is not having internet access, then you need to complete a successful build on some other machine and copy maven repo directory to build server.
While building you can instruct maven to work offline and use the build directory you have copied.
Eg: you can add this option "-Drepo.dir=D:\maven_repo -o" to mvn commands on build server
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 12:56
> To: user@hadoop.apache.org
> Subject: Re: Building for Windows
>
> Though I've gone go one step further, the build now stops with the
> following
> error:
>
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-
> plugin:1.2:exec
> (compile-ms-winutils) on project hadoop-common: Command execution
> failed.
> Cannot run program "msbuild"...
>
> I'm running the build from the Windows SDK command prompt, but
> msbuild.exe isn't on the PATH and it is actually missing in the whole
> C:.
>
> I do have a msbuild.exe file on the Windows installation CD-ROM in
>
> D:
> \sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d
> 4ddf5d348
>
> but I prefer avoid using it directly, because I need a repeatable build
> procedure. This is a test drive, but I'll have to build hadoop on a
> production server that has no internet access, so I'd like to
> understand what should I do in order to have msbuild.exe in C:.
>
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Lucio,
You need to install any of following on your build machine. These are one time install and do not need internet connection. You can download ISO of VS and install.
These tools are necessary to build native C++ code in hadoop-common and hadoop-hdfs
1.Windows 7.1 SDK (Along with Microsoft Visual C++ 10)
OR
2. Windows 8.1 SDK with Visual Studio 2013 Express (If this is installed, follow instructions in http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988 to upgrade Build files0
The above installation can be in any drive.
Just ensure that you use the command prompt given by SDK/Visual Studio. These command prompts will have paths set to msbuild.exe, cl.exe etc.
If you do not want to use these command prompt, then run the relevant batch files to set all ENV variable. These batch files can be found in the VS installation directory.
Eg: "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64\vcvarsx86_amd64.bat" This batch files will set all relevant PATH
Maven needs internet connection to download the dependent POM and JARs.
If your build server is not having internet access, then you need to complete a successful build on some other machine and copy maven repo directory to build server.
While building you can instruct maven to work offline and use the build directory you have copied.
Eg: you can add this option "-Drepo.dir=D:\maven_repo -o" to mvn commands on build server
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 12:56
> To: user@hadoop.apache.org
> Subject: Re: Building for Windows
>
> Though I've gone go one step further, the build now stops with the
> following
> error:
>
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-
> plugin:1.2:exec
> (compile-ms-winutils) on project hadoop-common: Command execution
> failed.
> Cannot run program "msbuild"...
>
> I'm running the build from the Windows SDK command prompt, but
> msbuild.exe isn't on the PATH and it is actually missing in the whole
> C:.
>
> I do have a msbuild.exe file on the Windows installation CD-ROM in
>
> D:
> \sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d
> 4ddf5d348
>
> but I prefer avoid using it directly, because I need a repeatable build
> procedure. This is a test drive, but I'll have to build hadoop on a
> production server that has no internet access, so I'd like to
> understand what should I do in order to have msbuild.exe in C:.
>
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Lucio,
You need to install any of following on your build machine. These are one time install and do not need internet connection. You can download ISO of VS and install.
These tools are necessary to build native C++ code in hadoop-common and hadoop-hdfs
1.Windows 7.1 SDK (Along with Microsoft Visual C++ 10)
OR
2. Windows 8.1 SDK with Visual Studio 2013 Express (If this is installed, follow instructions in http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988 to upgrade Build files0
The above installation can be in any drive.
Just ensure that you use the command prompt given by SDK/Visual Studio. These command prompts will have paths set to msbuild.exe, cl.exe etc.
If you do not want to use these command prompt, then run the relevant batch files to set all ENV variable. These batch files can be found in the VS installation directory.
Eg: "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64\vcvarsx86_amd64.bat" This batch files will set all relevant PATH
Maven needs internet connection to download the dependent POM and JARs.
If your build server is not having internet access, then you need to complete a successful build on some other machine and copy maven repo directory to build server.
While building you can instruct maven to work offline and use the build directory you have copied.
Eg: you can add this option "-Drepo.dir=D:\maven_repo -o" to mvn commands on build server
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 12:56
> To: user@hadoop.apache.org
> Subject: Re: Building for Windows
>
> Though I've gone go one step further, the build now stops with the
> following
> error:
>
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-
> plugin:1.2:exec
> (compile-ms-winutils) on project hadoop-common: Command execution
> failed.
> Cannot run program "msbuild"...
>
> I'm running the build from the Windows SDK command prompt, but
> msbuild.exe isn't on the PATH and it is actually missing in the whole
> C:.
>
> I do have a msbuild.exe file on the Windows installation CD-ROM in
>
> D:
> \sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d
> 4ddf5d348
>
> but I prefer avoid using it directly, because I need a repeatable build
> procedure. This is a test drive, but I'll have to build hadoop on a
> production server that has no internet access, so I'd like to
> understand what should I do in order to have msbuild.exe in C:.
>
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
Though I've gone go one step further, the build now stops with the following
error:
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
Cannot run program "msbuild"...
I'm running the build from the Windows SDK command prompt, but msbuild.exe
isn't on the PATH and it is actually missing in the whole C:.
I do have a msbuild.exe file on the Windows installation CD-ROM in
D:
\sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d4ddf5d348
but I prefer avoid using it directly, because I need a repeatable build
procedure. This is a test drive, but I'll have to build hadoop on a production
server that has no internet access, so I'd like to understand what should I do
in order to have msbuild.exe in C:.
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi Kiran,
Really helped me.
Thanks,
Naveen
-----Original Message-----
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Thursday, February 12, 2015 11:42 AM
To: user@hadoop.apache.org; Naveen Kumar Pokala
Cc: lucio@sulweb.org
Subject: RE: Building for Windows
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open
> $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip,
> ...) and other toys specified in the BUILDING.txt file bundled with
> hadoop sources. I also set the PATH and other environment variables
> (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
Though I've gone go one step further, the build now stops with the following
error:
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
Cannot run program "msbuild"...
I'm running the build from the Windows SDK command prompt, but msbuild.exe
isn't on the PATH and it is actually missing in the whole C:.
I do have a msbuild.exe file on the Windows installation CD-ROM in
D:
\sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d4ddf5d348
but I prefer avoid using it directly, because I need a repeatable build
procedure. This is a test drive, but I'll have to build hadoop on a production
server that has no internet access, so I'd like to understand what should I do
in order to have msbuild.exe in C:.
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi Kiran,
Really helped me.
Thanks,
Naveen
-----Original Message-----
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Thursday, February 12, 2015 11:42 AM
To: user@hadoop.apache.org; Naveen Kumar Pokala
Cc: lucio@sulweb.org
Subject: RE: Building for Windows
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open
> $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip,
> ...) and other toys specified in the BUILDING.txt file bundled with
> hadoop sources. I also set the PATH and other environment variables
> (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi Kiran,
Really helped me.
Thanks,
Naveen
-----Original Message-----
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Thursday, February 12, 2015 11:42 AM
To: user@hadoop.apache.org; Naveen Kumar Pokala
Cc: lucio@sulweb.org
Subject: RE: Building for Windows
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open
> $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip,
> ...) and other toys specified in the BUILDING.txt file bundled with
> hadoop sources. I also set the PATH and other environment variables
> (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
Though I've gone go one step further, the build now stops with the following
error:
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
Cannot run program "msbuild"...
I'm running the build from the Windows SDK command prompt, but msbuild.exe
isn't on the PATH and it is actually missing in the whole C:.
I do have a msbuild.exe file on the Windows installation CD-ROM in
D:
\sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d4ddf5d348
but I prefer avoid using it directly, because I need a repeatable build
procedure. This is a test drive, but I'll have to build hadoop on a production
server that has no internet access, so I'd like to understand what should I do
in order to have msbuild.exe in C:.
Re: Building for Windows
Posted by Lucio Crusca <lu...@sulweb.org>.
Though I've gone go one step further, the build now stops with the following
error:
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
Cannot run program "msbuild"...
I'm running the build from the Windows SDK command prompt, but msbuild.exe
isn't on the PATH and it is actually missing in the whole C:.
I do have a msbuild.exe file on the Windows installation CD-ROM in
D:
\sources\sxs\amd64_msbuild_b03f5f7f11d50a3a_3.5.9600.16384_none_ecc760d4ddf5d348
but I prefer avoid using it directly, because I need a repeatable build
procedure. This is a test drive, but I'll have to build hadoop on a production
server that has no internet access, so I'd like to understand what should I do
in order to have msbuild.exe in C:.
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi Kiran,
Really helped me.
Thanks,
Naveen
-----Original Message-----
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Thursday, February 12, 2015 11:42 AM
To: user@hadoop.apache.org; Naveen Kumar Pokala
Cc: lucio@sulweb.org
Subject: RE: Building for Windows
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open
> $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip,
> ...) and other toys specified in the BUILDING.txt file bundled with
> hadoop sources. I also set the PATH and other environment variables
> (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv,
> gzip, ...) and other toys specified in the BUILDING.txt file bundled
> with hadoop sources. I also set the PATH and other environment
> variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv,
> gzip, ...) and other toys specified in the BUILDING.txt file bundled
> with hadoop sources. I also set the PATH and other environment
> variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv,
> gzip, ...) and other toys specified in the BUILDING.txt file bundled
> with hadoop sources. I also set the PATH and other environment
> variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
RE: Building for Windows
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Naveen,
Did you see the compilation steps from comments in blog
http://zutai.blogspot.com/2014/06/build-install-and-run-hadoop-24-240-on.html?showComment=1422091525887#c2264594416650430988
I had posted it.
Good to know it helped you.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
> -----Original Message-----
> From: Naveen Kumar Pokala [mailto:npokala@spcapitaliq.com]
> Sent: Thursday, February 12, 2015 11:26
> To: user@hadoop.apache.org
> Cc: lucio@sulweb.org
> Subject: RE: Building for Windows
>
> Hi lucio,
>
> Following steps helped me in building Hadoop on windows 7.
>
> Hadoop-3.0.0 build instructions for Windows 8.1
> ----------------------------------------------
> I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have
> Windows 8.1 64bit
>
> Pre-requisites:
> ---------------
> 1. Download and install latest version of cmake for windows from
> http://www.cmake.org/download/ 2. Install Visual Studio Express 2013 3.
> Get latest version of trunk code from git://git.apache.org/hadoop.git
> (Try to use shortest path such as d:\hdp-git) 4. Download and install
> proto.exe (version 2.5.0) for windows 5. Ensure you have JDK-1.7 and
> Maven 3.0.5 or above installed and set in ENV variables
>
> Build settings changes:
> ----------------------
> 1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj
> and winutils.vcxproj from VS2010 to VS2013
> a) Open $hadoop-common-project\hadoop-
> common\src\main\winutils\winutils.sln in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln
> in VS2013.
> It will prompt you to upgrade the project to VS2013. Click yes.
>
> 2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual
> Studio 10 Win64", change it to "Visual Studio 12 Win64"
>
> Build Process:
> 1. Open "Developer Command Prompt for VS2013" located at "C:\Program
> Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
> This will open new command shell. Use this to build hadoop.
>
> 2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files
> (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
>
> 3. Change to $HADOOP directory and run maven build $mvn install -
> DskipTests
>
>
> It definitely Works.
>
> -Naveen.
>
>
> -----Original Message-----
> From: Lucio Crusca [mailto:lucio@sulweb.org]
> Sent: Thursday, February 12, 2015 3:33 AM
> To: user@hadoop.apache.org
> Subject: Building for Windows
>
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version
> 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among
> other things, but I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv,
> gzip, ...) and other toys specified in the BUILDING.txt file bundled
> with hadoop sources. I also set the PATH and other environment
> variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi lucio,
Following steps helped me in building Hadoop on windows 7.
Hadoop-3.0.0 build instructions for Windows 8.1
----------------------------------------------
I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have Windows 8.1 64bit
Pre-requisites:
---------------
1. Download and install latest version of cmake for windows from http://www.cmake.org/download/
2. Install Visual Studio Express 2013
3. Get latest version of trunk code from git://git.apache.org/hadoop.git
(Try to use shortest path such as d:\hdp-git)
4. Download and install proto.exe (version 2.5.0) for windows
5. Ensure you have JDK-1.7 and Maven 3.0.5 or above installed and set in ENV variables
Build settings changes:
----------------------
1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj and winutils.vcxproj from VS2010 to VS2013
a) Open $hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual Studio 10 Win64", change it to "Visual Studio 12 Win64"
Build Process:
1. Open "Developer Command Prompt for VS2013" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
This will open new command shell. Use this to build hadoop.
2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
3. Change to $HADOOP directory and run maven build
$mvn install -DskipTests
It definitely Works.
-Naveen.
-----Original Message-----
From: Lucio Crusca [mailto:lucio@sulweb.org]
Sent: Thursday, February 12, 2015 3:33 AM
To: user@hadoop.apache.org
Subject: Building for Windows
Hello everybody,
I'm absolutely new to hadoop and a customer asked me to build version 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among other things, but I've never used hadoop before.
I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...) and other toys specified in the BUILDING.txt file bundled with hadoop sources. I also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
Running
mvn package -Pdist -Dtar
it compiles everything till MiniKDC included, but then it fails a test after compiling Auth.
Here you can see the full output of the mvn command:
http://hastebin.com/aqixebojuv.tex
Can you help me understand what I'm doing wrong?
Thanks in advance
Lucio.
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi lucio,
Following steps helped me in building Hadoop on windows 7.
Hadoop-3.0.0 build instructions for Windows 8.1
----------------------------------------------
I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have Windows 8.1 64bit
Pre-requisites:
---------------
1. Download and install latest version of cmake for windows from http://www.cmake.org/download/
2. Install Visual Studio Express 2013
3. Get latest version of trunk code from git://git.apache.org/hadoop.git
(Try to use shortest path such as d:\hdp-git)
4. Download and install proto.exe (version 2.5.0) for windows
5. Ensure you have JDK-1.7 and Maven 3.0.5 or above installed and set in ENV variables
Build settings changes:
----------------------
1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj and winutils.vcxproj from VS2010 to VS2013
a) Open $hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual Studio 10 Win64", change it to "Visual Studio 12 Win64"
Build Process:
1. Open "Developer Command Prompt for VS2013" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
This will open new command shell. Use this to build hadoop.
2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
3. Change to $HADOOP directory and run maven build
$mvn install -DskipTests
It definitely Works.
-Naveen.
-----Original Message-----
From: Lucio Crusca [mailto:lucio@sulweb.org]
Sent: Thursday, February 12, 2015 3:33 AM
To: user@hadoop.apache.org
Subject: Building for Windows
Hello everybody,
I'm absolutely new to hadoop and a customer asked me to build version 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among other things, but I've never used hadoop before.
I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...) and other toys specified in the BUILDING.txt file bundled with hadoop sources. I also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
Running
mvn package -Pdist -Dtar
it compiles everything till MiniKDC included, but then it fails a test after compiling Auth.
Here you can see the full output of the mvn command:
http://hastebin.com/aqixebojuv.tex
Can you help me understand what I'm doing wrong?
Thanks in advance
Lucio.
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi lucio,
Following steps helped me in building Hadoop on windows 7.
Hadoop-3.0.0 build instructions for Windows 8.1
----------------------------------------------
I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have Windows 8.1 64bit
Pre-requisites:
---------------
1. Download and install latest version of cmake for windows from http://www.cmake.org/download/
2. Install Visual Studio Express 2013
3. Get latest version of trunk code from git://git.apache.org/hadoop.git
(Try to use shortest path such as d:\hdp-git)
4. Download and install proto.exe (version 2.5.0) for windows
5. Ensure you have JDK-1.7 and Maven 3.0.5 or above installed and set in ENV variables
Build settings changes:
----------------------
1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj and winutils.vcxproj from VS2010 to VS2013
a) Open $hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual Studio 10 Win64", change it to "Visual Studio 12 Win64"
Build Process:
1. Open "Developer Command Prompt for VS2013" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
This will open new command shell. Use this to build hadoop.
2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
3. Change to $HADOOP directory and run maven build
$mvn install -DskipTests
It definitely Works.
-Naveen.
-----Original Message-----
From: Lucio Crusca [mailto:lucio@sulweb.org]
Sent: Thursday, February 12, 2015 3:33 AM
To: user@hadoop.apache.org
Subject: Building for Windows
Hello everybody,
I'm absolutely new to hadoop and a customer asked me to build version 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among other things, but I've never used hadoop before.
I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...) and other toys specified in the BUILDING.txt file bundled with hadoop sources. I also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
Running
mvn package -Pdist -Dtar
it compiles everything till MiniKDC included, but then it fails a test after compiling Auth.
Here you can see the full output of the mvn command:
http://hastebin.com/aqixebojuv.tex
Can you help me understand what I'm doing wrong?
Thanks in advance
Lucio.
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
try
mvn package -Pdist -Dtar -DskipTests
On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version 2.6
> for
> Windows Server 2012 R2. I'm myself a java programmer, among other things,
> but
> I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
> and
> other toys specified in the BUILDING.txt file bundled with hadoop sources.
> I
> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
> Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after
> compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
>
RE: Building for Windows
Posted by Naveen Kumar Pokala <np...@spcapitaliq.com>.
Hi lucio,
Following steps helped me in building Hadoop on windows 7.
Hadoop-3.0.0 build instructions for Windows 8.1
----------------------------------------------
I compiled Hadoop-3.0.0 from Git Trunk. I have not used cygwin. I have Windows 8.1 64bit
Pre-requisites:
---------------
1. Download and install latest version of cmake for windows from http://www.cmake.org/download/
2. Install Visual Studio Express 2013
3. Get latest version of trunk code from git://git.apache.org/hadoop.git
(Try to use shortest path such as d:\hdp-git)
4. Download and install proto.exe (version 2.5.0) for windows
5. Ensure you have JDK-1.7 and Maven 3.0.5 or above installed and set in ENV variables
Build settings changes:
----------------------
1. Migrate Visual Studio Projects native.vcxproj, libwinutils.vcxproj and winutils.vcxproj from VS2010 to VS2013
a) Open $hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
a) Open $hadoop-common-project\hadoop-common\src\main\native\native.sln in VS2013.
It will prompt you to upgrade the project to VS2013. Click yes.
2. Open $hadoop-hdfs-project\hadoop-hdfs\pom.xml. Search for "Visual Studio 10 Win64", change it to "Visual Studio 12 Win64"
Build Process:
1. Open "Developer Command Prompt for VS2013" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\Tools\Shortcuts"
This will open new command shell. Use this to build hadoop.
2. Run batch file "vcvarsx86_amd64.bat" located at "C:\Program Files (x86)\Microsoft Visual Studio 12.0\VC\bin\x86_amd64"
3. Change to $HADOOP directory and run maven build
$mvn install -DskipTests
It definitely Works.
-Naveen.
-----Original Message-----
From: Lucio Crusca [mailto:lucio@sulweb.org]
Sent: Thursday, February 12, 2015 3:33 AM
To: user@hadoop.apache.org
Subject: Building for Windows
Hello everybody,
I'm absolutely new to hadoop and a customer asked me to build version 2.6 for Windows Server 2012 R2. I'm myself a java programmer, among other things, but I've never used hadoop before.
I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...) and other toys specified in the BUILDING.txt file bundled with hadoop sources. I also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME, Platform, ...).
Running
mvn package -Pdist -Dtar
it compiles everything till MiniKDC included, but then it fails a test after compiling Auth.
Here you can see the full output of the mvn command:
http://hastebin.com/aqixebojuv.tex
Can you help me understand what I'm doing wrong?
Thanks in advance
Lucio.
Re: Building for Windows
Posted by Alexander Pivovarov <ap...@gmail.com>.
try
mvn package -Pdist -Dtar -DskipTests
On Wed, Feb 11, 2015 at 2:02 PM, Lucio Crusca <lu...@sulweb.org> wrote:
> Hello everybody,
>
> I'm absolutely new to hadoop and a customer asked me to build version 2.6
> for
> Windows Server 2012 R2. I'm myself a java programmer, among other things,
> but
> I've never used hadoop before.
>
> I've downloaded and installed JDK7, Maven, Cygwin (for sh, mv, gzip, ...)
> and
> other toys specified in the BUILDING.txt file bundled with hadoop sources.
> I
> also set the PATH and other environment variables (JAVA_HOME, ZLIB_HOME,
> Platform, ...).
>
> Running
>
> mvn package -Pdist -Dtar
>
> it compiles everything till MiniKDC included, but then it fails a test
> after
> compiling Auth.
>
> Here you can see the full output of the mvn command:
>
> http://hastebin.com/aqixebojuv.tex
>
> Can you help me understand what I'm doing wrong?
>
> Thanks in advance
> Lucio.
>