You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Venkat Ramakrishnan <ve...@gmail.com> on 2015/02/10 11:52:01 UTC
Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
parent: sun.misc.Launcher$AppClassLoader@647e05]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
with basic configurator -->
[DEBUG] (f) arguments =
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
/nologo, /p:Configuration=Release,
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
/p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir =
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0
@ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
/nologo /p:Configuration=Release
/p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
/p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
/p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration "Release|Win32" is
invalid. Please specify a valid solution configuration using the
Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
/p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
blank to use the default solution configuration.
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
(default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
(default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
: error MSB4126: The specified solution configuration "Release|Win32" is
invalid. Please specify a valid solution configuration using the
Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
/p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
blank to use the default solution configuration.
[D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [
5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [
3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [
7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [
0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [
10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04
min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec
(compile-ms-winutils) on project hadoop-common: Command execution failed.
Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
project hadoop-common: Command execution failed.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command
execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an
error: 1(Exit value: 1)
at
org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Venkat,
I checked the log file
Below is the particular error appearing at line 635 in output.txt you attached.
[ERROR] Could not find project to resume reactor build from: :hadoop-yarn-web-proxy vs [MavenProject: org.apache.hadoop:hadoop-main:2.6.0 @ D:\h\HADOOP~2.0-S\pom.xml, MavenProject: org.apache.hadoop:hadoop-project:2.6.0 @
I did not face this error. I think it’s not related to windows.
From your log I observed that you are using JDK 8. Not sure if this has any relation to the issue you are facing.
I had compiled with JDK 7.
I have very limited knowledge of YARN.
Any YARN experts can comment on this issue.
Temporarily, may be you can try skipping build of this particular component (yarn-web-proxy) by commenting it from pom.xml.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Friday, February 13, 2015 06:34
To: Kiran Kumar.M.R
Cc: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move forward.
Now, I am at a stage where the compilation does not complain about any specific
errors in the modules, but instead about some duplicate entries in hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org<ma...@hadoop.apache.org>; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Venkat,
I checked the log file
Below is the particular error appearing at line 635 in output.txt you attached.
[ERROR] Could not find project to resume reactor build from: :hadoop-yarn-web-proxy vs [MavenProject: org.apache.hadoop:hadoop-main:2.6.0 @ D:\h\HADOOP~2.0-S\pom.xml, MavenProject: org.apache.hadoop:hadoop-project:2.6.0 @
I did not face this error. I think it’s not related to windows.
From your log I observed that you are using JDK 8. Not sure if this has any relation to the issue you are facing.
I had compiled with JDK 7.
I have very limited knowledge of YARN.
Any YARN experts can comment on this issue.
Temporarily, may be you can try skipping build of this particular component (yarn-web-proxy) by commenting it from pom.xml.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Friday, February 13, 2015 06:34
To: Kiran Kumar.M.R
Cc: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move forward.
Now, I am at a stage where the compilation does not complain about any specific
errors in the modules, but instead about some duplicate entries in hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org<ma...@hadoop.apache.org>; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Venkat,
I checked the log file
Below is the particular error appearing at line 635 in output.txt you attached.
[ERROR] Could not find project to resume reactor build from: :hadoop-yarn-web-proxy vs [MavenProject: org.apache.hadoop:hadoop-main:2.6.0 @ D:\h\HADOOP~2.0-S\pom.xml, MavenProject: org.apache.hadoop:hadoop-project:2.6.0 @
I did not face this error. I think it’s not related to windows.
From your log I observed that you are using JDK 8. Not sure if this has any relation to the issue you are facing.
I had compiled with JDK 7.
I have very limited knowledge of YARN.
Any YARN experts can comment on this issue.
Temporarily, may be you can try skipping build of this particular component (yarn-web-proxy) by commenting it from pom.xml.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Friday, February 13, 2015 06:34
To: Kiran Kumar.M.R
Cc: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move forward.
Now, I am at a stage where the compilation does not complain about any specific
errors in the modules, but instead about some duplicate entries in hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org<ma...@hadoop.apache.org>; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi Venkat,
I checked the log file
Below is the particular error appearing at line 635 in output.txt you attached.
[ERROR] Could not find project to resume reactor build from: :hadoop-yarn-web-proxy vs [MavenProject: org.apache.hadoop:hadoop-main:2.6.0 @ D:\h\HADOOP~2.0-S\pom.xml, MavenProject: org.apache.hadoop:hadoop-project:2.6.0 @
I did not face this error. I think it’s not related to windows.
From your log I observed that you are using JDK 8. Not sure if this has any relation to the issue you are facing.
I had compiled with JDK 7.
I have very limited knowledge of YARN.
Any YARN experts can comment on this issue.
Temporarily, may be you can try skipping build of this particular component (yarn-web-proxy) by commenting it from pom.xml.
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Friday, February 13, 2015 06:34
To: Kiran Kumar.M.R
Cc: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move forward.
Now, I am at a stage where the compilation does not complain about any specific
errors in the modules, but instead about some duplicate entries in hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org<ma...@hadoop.apache.org>; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move
forward.
Now, I am at a stage where the compilation does not complain about any
specific
errors in the modules, but instead about some duplicate entries in
hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me
know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> I did following changes to make compilation successful
>
> 1.
> hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
>
> Line 31: Add WINAPI to declaration
>
> static DWORD *WINAPI* runThread(LPVOID toRun) {
>
>
>
> 2.
> hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
>
> Comment lines 99 and 105
>
> 99: //#pragma comment(linker, "/INCLUDE:_tls_used")
>
> 105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* Tuesday, February 10, 2015 22:52
> *To:* user@hadoop.apache.org; Kiran Kumar.M.R
> *Subject:* Re: Error with winutils.sln
>
>
>
> Hi Kiran,
>
>
>
> I made much progress on winutils suggestions that you gave,
>
> and I have progressed till hadoop-hdfs module. Thank you for your help!
>
>
>
> I am getting the following error in the hdfs module:
>
>
>
> [exec] ClCompile:
>
> [exec] All outputs are up-to-date.
>
> [exec] Lib:
>
> [exec] All outputs are up-to-date.
>
> [exec] hdfs_static.vcxproj ->
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
>
> [exec] FinalizeBuildStatus:
>
> [exec] Deleting file
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
>
> [exec] Touching
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
> (default targets).
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default targets) -- FAILED.
>
> [exec]
>
> [exec] Build FAILED.
>
> [exec]
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default target) (1) ->
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
> (default target) (3) ->
>
> [exec] (Link target) ->
>
> *[exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol _tls_used
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol pTlsCallback
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec]
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
> : fatal error LNK1120: 2 unresolved externals
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> [exec]
>
> [exec] 0 Warning(s)
>
> [exec] 3 Error(s)
>
> [exec]
>
> [exec] Time Elapsed 00:00:40.39
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
> min]
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
>
>
> Have you seen this? How to resolve this?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
> On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <
> Kiran.Kumar.MR@huawei.com> wrote:
>
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move
forward.
Now, I am at a stage where the compilation does not complain about any
specific
errors in the modules, but instead about some duplicate entries in
hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me
know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> I did following changes to make compilation successful
>
> 1.
> hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
>
> Line 31: Add WINAPI to declaration
>
> static DWORD *WINAPI* runThread(LPVOID toRun) {
>
>
>
> 2.
> hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
>
> Comment lines 99 and 105
>
> 99: //#pragma comment(linker, "/INCLUDE:_tls_used")
>
> 105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* Tuesday, February 10, 2015 22:52
> *To:* user@hadoop.apache.org; Kiran Kumar.M.R
> *Subject:* Re: Error with winutils.sln
>
>
>
> Hi Kiran,
>
>
>
> I made much progress on winutils suggestions that you gave,
>
> and I have progressed till hadoop-hdfs module. Thank you for your help!
>
>
>
> I am getting the following error in the hdfs module:
>
>
>
> [exec] ClCompile:
>
> [exec] All outputs are up-to-date.
>
> [exec] Lib:
>
> [exec] All outputs are up-to-date.
>
> [exec] hdfs_static.vcxproj ->
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
>
> [exec] FinalizeBuildStatus:
>
> [exec] Deleting file
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
>
> [exec] Touching
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
> (default targets).
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default targets) -- FAILED.
>
> [exec]
>
> [exec] Build FAILED.
>
> [exec]
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default target) (1) ->
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
> (default target) (3) ->
>
> [exec] (Link target) ->
>
> *[exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol _tls_used
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol pTlsCallback
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec]
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
> : fatal error LNK1120: 2 unresolved externals
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> [exec]
>
> [exec] 0 Warning(s)
>
> [exec] 3 Error(s)
>
> [exec]
>
> [exec] Time Elapsed 00:00:40.39
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
> min]
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
>
>
> Have you seen this? How to resolve this?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
> On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <
> Kiran.Kumar.MR@huawei.com> wrote:
>
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move
forward.
Now, I am at a stage where the compilation does not complain about any
specific
errors in the modules, but instead about some duplicate entries in
hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me
know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> I did following changes to make compilation successful
>
> 1.
> hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
>
> Line 31: Add WINAPI to declaration
>
> static DWORD *WINAPI* runThread(LPVOID toRun) {
>
>
>
> 2.
> hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
>
> Comment lines 99 and 105
>
> 99: //#pragma comment(linker, "/INCLUDE:_tls_used")
>
> 105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* Tuesday, February 10, 2015 22:52
> *To:* user@hadoop.apache.org; Kiran Kumar.M.R
> *Subject:* Re: Error with winutils.sln
>
>
>
> Hi Kiran,
>
>
>
> I made much progress on winutils suggestions that you gave,
>
> and I have progressed till hadoop-hdfs module. Thank you for your help!
>
>
>
> I am getting the following error in the hdfs module:
>
>
>
> [exec] ClCompile:
>
> [exec] All outputs are up-to-date.
>
> [exec] Lib:
>
> [exec] All outputs are up-to-date.
>
> [exec] hdfs_static.vcxproj ->
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
>
> [exec] FinalizeBuildStatus:
>
> [exec] Deleting file
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
>
> [exec] Touching
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
> (default targets).
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default targets) -- FAILED.
>
> [exec]
>
> [exec] Build FAILED.
>
> [exec]
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default target) (1) ->
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
> (default target) (3) ->
>
> [exec] (Link target) ->
>
> *[exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol _tls_used
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol pTlsCallback
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec]
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
> : fatal error LNK1120: 2 unresolved externals
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> [exec]
>
> [exec] 0 Warning(s)
>
> [exec] 3 Error(s)
>
> [exec]
>
> [exec] Time Elapsed 00:00:40.39
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
> min]
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
>
>
> Have you seen this? How to resolve this?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
> On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <
> Kiran.Kumar.MR@huawei.com> wrote:
>
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
Again, with your inputs, I was able to compile the HDFS module & move
forward.
Now, I am at a stage where the compilation does not complain about any
specific
errors in the modules, but instead about some duplicate entries in
hadoop-project/pom.xml file.
I am attaching the debug output for your attention. Could you please let me
know
what is going wrong, so that I can correct, and move forward?
Thanks & Best Regards,
Venkat.
On Thu, Feb 12, 2015 at 9:26 AM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> I did following changes to make compilation successful
>
> 1.
> hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
>
> Line 31: Add WINAPI to declaration
>
> static DWORD *WINAPI* runThread(LPVOID toRun) {
>
>
>
> 2.
> hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
>
> Comment lines 99 and 105
>
> 99: //#pragma comment(linker, "/INCLUDE:_tls_used")
>
> 105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* Tuesday, February 10, 2015 22:52
> *To:* user@hadoop.apache.org; Kiran Kumar.M.R
> *Subject:* Re: Error with winutils.sln
>
>
>
> Hi Kiran,
>
>
>
> I made much progress on winutils suggestions that you gave,
>
> and I have progressed till hadoop-hdfs module. Thank you for your help!
>
>
>
> I am getting the following error in the hdfs module:
>
>
>
> [exec] ClCompile:
>
> [exec] All outputs are up-to-date.
>
> [exec] Lib:
>
> [exec] All outputs are up-to-date.
>
> [exec] hdfs_static.vcxproj ->
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
>
> [exec] FinalizeBuildStatus:
>
> [exec] Deleting file
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
>
> [exec] Touching
> "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
> (default targets).
>
> [exec] Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default targets) -- FAILED.
>
> [exec]
>
> [exec] Build FAILED.
>
> [exec]
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
> (default target) (1) ->
>
> [exec]
> "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
> (default target) (3) ->
>
> [exec] (Link target) ->
>
> *[exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol _tls_used
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec] thread_local_storage.obj : error LNK2001: unresolved
> external symbol pTlsCallback
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> * [exec]
> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
> : fatal error LNK1120: 2 unresolved externals
> [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
>
> [exec]
>
> [exec] 0 Warning(s)
>
> [exec] 3 Error(s)
>
> [exec]
>
> [exec] Time Elapsed 00:00:40.39
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
> min]
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
>
>
> Have you seen this? How to resolve this?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
> On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <
> Kiran.Kumar.MR@huawei.com> wrote:
>
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
>
>
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
I did following changes to make compilation successful
1. hadoop-hdfs-project\hadoop-hdfs\src\main\native\libhdfs\os\windows\thread.c
Line 31: Add WINAPI to declaration
static DWORD WINAPI runThread(LPVOID toRun) {
2. hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/os/windows/thread_local_storage.c
Comment lines 99 and 105
99: //#pragma comment(linker, "/INCLUDE:_tls_used")
105://#pragma comment(linker, "/INCLUDE:pTlsCallback")
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 22:52
To: user@hadoop.apache.org; Kiran Kumar.M.R
Subject: Re: Error with winutils.sln
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj -> D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file "hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching "hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj" (default targets).
[exec] Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj" (default target) (1) ->
[exec] "D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj" (default target) (3) ->
[exec] (Link target) ->
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol _tls_used [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] thread_local_storage.obj : error LNK2001: unresolved external symbol pTlsCallback [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec] D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll : fatal error LNK1120: 2 unresolved externals [D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27 min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>> wrote:
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com<ma...@huawei.com>]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj ->
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file
"hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching
"hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
(default targets).
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default target) (1) ->
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
(default target) (3) ->
[exec] (Link target) ->
*[exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol _tls_used
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol pTlsCallback
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
: fatal error LNK1120: 2 unresolved externals
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj ->
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file
"hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching
"hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
(default targets).
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default target) (1) ->
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
(default target) (3) ->
[exec] (Link target) ->
*[exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol _tls_used
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol pTlsCallback
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
: fatal error LNK1120: 2 unresolved externals
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj ->
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file
"hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching
"hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
(default targets).
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default target) (1) ->
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
(default target) (3) ->
[exec] (Link target) ->
*[exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol _tls_used
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol pTlsCallback
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
: fatal error LNK1120: 2 unresolved externals
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Hi Kiran,
I made much progress on winutils suggestions that you gave,
and I have progressed till hadoop-hdfs module. Thank you for your help!
I am getting the following error in the hdfs module:
[exec] ClCompile:
[exec] All outputs are up-to-date.
[exec] Lib:
[exec] All outputs are up-to-date.
[exec] hdfs_static.vcxproj ->
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.lib
[exec] FinalizeBuildStatus:
[exec] Deleting file
"hdfs_static.dir\RelWithDebInfo\hdfs_static.unsuccessfulbuild".
[exec] Touching
"hdfs_static.dir\RelWithDebInfo\hdfs_static.lastbuildstate".
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs_static.vcxproj"
(default targets).
[exec] Done Building Project
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default targets) -- FAILED.
[exec]
[exec] Build FAILED.
[exec]
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\ALL_BUILD.vcxproj"
(default target) (1) ->
[exec]
"D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj"
(default target) (3) ->
[exec] (Link target) ->
*[exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol _tls_used
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec] thread_local_storage.obj : error LNK2001: unresolved
external symbol pTlsCallback
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
* [exec]
D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\target\bin\RelWithDebInfo\hdfs.dll
: fatal error LNK1120: 2 unresolved externals
[D:\h\hadoop-2.6.0-src\hadoop-hdfs-project\hadoop-hdfs\target\native\hdfs.vcxproj]*
[exec]
[exec] 0 Warning(s)
[exec] 3 Error(s)
[exec]
[exec] Time Elapsed 00:00:40.39
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop HDFS ................................. FAILURE [02:27
min]
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
Have you seen this? How to resolve this?
Thanks,
Venkat.
On Tue, Feb 10, 2015 at 5:07 PM, Kiran Kumar.M.R <Ki...@huawei.com>
wrote:
> cmake is required.
>
>
>
> While compiling use below command
>
> $mvn clean install –Pnative-win –DskipTests
>
>
>
> -Pnative-win ensures that windows profile is chose to compile native
> components
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
> *Sent:* Tuesday, February 10, 2015 16:38
>
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> To be more precise:
>
> 1. Replace x64 with Win32 in following files
>
> hadoop-common-project\hadoop-common\src\main\native\native.sln
>
> hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
>
> hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
>
>
>
> 2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in
> following file
>
> hadoop-hdfs-project\hadoop-hdfs\pom.xml
>
>
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Kiran Kumar.M.R
> *Sent:* Tuesday, February 10, 2015 16:33
> *To:* user@hadoop.apache.org
> *Subject:* RE: Error with winutils.sln
>
>
>
> Hi,
>
> Build files support only x64 (64 bit). You can add 32bit build as below
>
> 1. You can edit .sln files and replace x64 with Win32 and the
> compile.
>
> 2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
>
> To replace “Visual Studio 10 Win64” with “Visual Studio 10”
>
>
>
>
>
>
>
> Regards,
>
> Kiran
>
>
> __________________________________________________________________________________________________________
>
> This e-mail and its attachments contain confidential information from
> HUAWEI, which is intended only for the person or entity whose address is
> listed above. Any use of the information contained herein in any way
> (including, but not limited to, total or partial disclosure, reproduction,
> or dissemination) by persons other than the intended recipient(s) is
> prohibited. If you receive this e-mail in error, please notify the sender
> by phone or email immediately and delete it!
>
>
> __________________________________________________________________________________________________________
>
>
>
>
>
>
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com
> <ve...@gmail.com>]
> *Sent:* Tuesday, February 10, 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
cmake is required.
While compiling use below command
$mvn clean install –Pnative-win –DskipTests
-Pnative-win ensures that windows profile is chose to compile native components
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R [mailto:Kiran.Kumar.MR@huawei.com]
Sent: Tuesday, February 10, 2015 16:38
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
Download patch from jira : https://issues.apache.org/jira/i#browse/HADOOP-9922
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 17:06
To: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <ro...@huawei.com>> wrote:
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
Download patch from jira : https://issues.apache.org/jira/i#browse/HADOOP-9922
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 17:06
To: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <ro...@huawei.com>> wrote:
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
Download patch from jira : https://issues.apache.org/jira/i#browse/HADOOP-9922
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 17:06
To: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <ro...@huawei.com>> wrote:
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
Download patch from jira : https://issues.apache.org/jira/i#browse/HADOOP-9922
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 17:06
To: user@hadoop.apache.org
Subject: Re: Error with winutils.sln
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <ro...@huawei.com>> wrote:
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com<ma...@gmail.com>]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <
rohithsharmaks@huawei.com> wrote:
> There are some issues for compiling Hadoop in win32 platform. Even I am
> facing same issues. I think it is explicitly removed the support.
>
>
>
> But It is possible to compile successfully by tweaking some of the files.
> Follow the below instructions
>
> 1. Apply the patch HADOOP-9922.patch to your 2.6 version
>
> *patch –p1 < HADOOP-9922.patch*
>
> 2. Replace “Release|x64” with “Release|Win32” in
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.sln*
>
> 3. Replace “x64” with “Win32” in
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.vcxproj* and
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *libwinutils.vcxproj*
>
>
>
> If in your machine native compilation does not happen because of cmake not
> installed or any other reason then you will face issue while compiling hdfs
> project. So, for the sake of compiling you can skip native compilation at
> hdfs.
>
> 4. To skip native compilation, add “<skip>${skipTests}</skip>”
> or “<skip>true</skip>” in $HADOOP_HOME
> \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
>
> <configuration>
>
> * <skip>${skipTests}</skip>*
>
> <target>
>
> <mkdir dir="${project.build.directory}/native"/>
>
> Note : there are 2 occurrences, you add at both 2 occurrence
>
>
>
> And compile using “mvn clean install –DskipTests”
>
>
>
> Hope this will help to compile.. enjoy with Hadoop!!!
>
>
>
> Thanks & Regards
>
> Rohith Sharma K S
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* 10 February 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <
rohithsharmaks@huawei.com> wrote:
> There are some issues for compiling Hadoop in win32 platform. Even I am
> facing same issues. I think it is explicitly removed the support.
>
>
>
> But It is possible to compile successfully by tweaking some of the files.
> Follow the below instructions
>
> 1. Apply the patch HADOOP-9922.patch to your 2.6 version
>
> *patch –p1 < HADOOP-9922.patch*
>
> 2. Replace “Release|x64” with “Release|Win32” in
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.sln*
>
> 3. Replace “x64” with “Win32” in
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.vcxproj* and
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *libwinutils.vcxproj*
>
>
>
> If in your machine native compilation does not happen because of cmake not
> installed or any other reason then you will face issue while compiling hdfs
> project. So, for the sake of compiling you can skip native compilation at
> hdfs.
>
> 4. To skip native compilation, add “<skip>${skipTests}</skip>”
> or “<skip>true</skip>” in $HADOOP_HOME
> \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
>
> <configuration>
>
> * <skip>${skipTests}</skip>*
>
> <target>
>
> <mkdir dir="${project.build.directory}/native"/>
>
> Note : there are 2 occurrences, you add at both 2 occurrence
>
>
>
> And compile using “mvn clean install –DskipTests”
>
>
>
> Hope this will help to compile.. enjoy with Hadoop!!!
>
>
>
> Thanks & Regards
>
> Rohith Sharma K S
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* 10 February 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <
rohithsharmaks@huawei.com> wrote:
> There are some issues for compiling Hadoop in win32 platform. Even I am
> facing same issues. I think it is explicitly removed the support.
>
>
>
> But It is possible to compile successfully by tweaking some of the files.
> Follow the below instructions
>
> 1. Apply the patch HADOOP-9922.patch to your 2.6 version
>
> *patch –p1 < HADOOP-9922.patch*
>
> 2. Replace “Release|x64” with “Release|Win32” in
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.sln*
>
> 3. Replace “x64” with “Win32” in
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.vcxproj* and
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *libwinutils.vcxproj*
>
>
>
> If in your machine native compilation does not happen because of cmake not
> installed or any other reason then you will face issue while compiling hdfs
> project. So, for the sake of compiling you can skip native compilation at
> hdfs.
>
> 4. To skip native compilation, add “<skip>${skipTests}</skip>”
> or “<skip>true</skip>” in $HADOOP_HOME
> \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
>
> <configuration>
>
> * <skip>${skipTests}</skip>*
>
> <target>
>
> <mkdir dir="${project.build.directory}/native"/>
>
> Note : there are 2 occurrences, you add at both 2 occurrence
>
>
>
> And compile using “mvn clean install –DskipTests”
>
>
>
> Hope this will help to compile.. enjoy with Hadoop!!!
>
>
>
> Thanks & Regards
>
> Rohith Sharma K S
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* 10 February 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
Re: Error with winutils.sln
Posted by Venkat Ramakrishnan <ve...@gmail.com>.
Thank you Rohit.
Could you please point me to the documentation/information/location
related to Hadoop's 9922 patch?
Thx,
Venkat.
On Tue, Feb 10, 2015 at 4:51 PM, Rohith Sharma K S <
rohithsharmaks@huawei.com> wrote:
> There are some issues for compiling Hadoop in win32 platform. Even I am
> facing same issues. I think it is explicitly removed the support.
>
>
>
> But It is possible to compile successfully by tweaking some of the files.
> Follow the below instructions
>
> 1. Apply the patch HADOOP-9922.patch to your 2.6 version
>
> *patch –p1 < HADOOP-9922.patch*
>
> 2. Replace “Release|x64” with “Release|Win32” in
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.sln*
>
> 3. Replace “x64” with “Win32” in
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *winutils.vcxproj* and
>
> $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\
> *libwinutils.vcxproj*
>
>
>
> If in your machine native compilation does not happen because of cmake not
> installed or any other reason then you will face issue while compiling hdfs
> project. So, for the sake of compiling you can skip native compilation at
> hdfs.
>
> 4. To skip native compilation, add “<skip>${skipTests}</skip>”
> or “<skip>true</skip>” in $HADOOP_HOME
> \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
>
> <configuration>
>
> * <skip>${skipTests}</skip>*
>
> <target>
>
> <mkdir dir="${project.build.directory}/native"/>
>
> Note : there are 2 occurrences, you add at both 2 occurrence
>
>
>
> And compile using “mvn clean install –DskipTests”
>
>
>
> Hope this will help to compile.. enjoy with Hadoop!!!
>
>
>
> Thanks & Regards
>
> Rohith Sharma K S
>
>
>
> *From:* Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
> *Sent:* 10 February 2015 16:22
> *To:* user@hadoop.apache.org
> *Subject:* Error with winutils.sln
>
>
>
> Hello,
>
>
>
> I'm getting the following error while compiling with Windows 7 (32 bit). I
>
> have set the Platform as Win32. The error complains about solution
>
> configuration being different from winutils.sln:
>
> .
>
> .
>
> .
>
> .
>
> [DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from
> plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2,
> parent: sun.misc.Launcher$AppClassLoader@647e05]
>
> [DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec'
> with basic configurator -->
>
> [DEBUG] (f) arguments =
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln,
> /nologo, /p:Configuration=Release,
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/,
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/,
> /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
>
> [DEBUG] (f) basedir =
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
>
> [DEBUG] (f) classpathScope = runtime
>
> [DEBUG] (f) executable = msbuild
>
> [DEBUG] (f) longClasspath = false
>
> [DEBUG] (f) project = MavenProject:
> org.apache.hadoop:hadoop-common:2.6.0 @
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
>
> [DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72
>
> [DEBUG] (f) skip = false
>
> [DEBUG] -- end configuration --
>
> [DEBUG] Executing command line: msbuild
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln
> /nologo /p:Configuration=Release
> /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/
> /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/
> /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
>
> Build started 07-02-2015 09:55:21.
>
> Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> on node 1 (default targets).
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
> Done Building Project
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default targets) -- FAILED.
>
>
>
> Build FAILED.
>
>
>
> "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln"
> (default target) (1) ->
>
> (ValidateSolutionConfiguration target) ->
>
>
> D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj
> : error MSB4126: The specified solution configuration "Release|Win32" is
> invalid. Please specify a valid solution configuration using the
> Configuration and Platform properties (e.g. MSBuild.exe Solution.sln
> /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties
> blank to use the default solution configuration.
> [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
>
>
>
> 0 Warning(s)
>
> 1 Error(s)
>
>
>
> Time Elapsed 00:00:04.41
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Reactor Summary:
>
> [INFO]
>
> [INFO] Apache Hadoop Main ................................. SUCCESS [
> 5.314 s]
>
> [INFO] Apache Hadoop Project POM .......................... SUCCESS [
> 3.756 s]
>
> [INFO] Apache Hadoop Annotations .......................... SUCCESS [
> 7.977 s]
>
> [INFO] Apache Hadoop Assemblies ........................... SUCCESS [
> 0.312 s]
>
> [INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [
> 4.561 s]
>
> [INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [
> 10.205 s]
>
> [INFO] Apache Hadoop MiniKDC .............................. SUCCESS [
> 7.418 s]
>
> [INFO] Apache Hadoop Auth ................................. SUCCESS [
> 10.640 s]
>
> [INFO] Apache Hadoop Auth Examples ........................ SUCCESS [
> 8.438 s]
>
> [INFO] Apache Hadoop Common ............................... FAILURE [01:04
> min]
>
> [INFO] Apache Hadoop NFS .................................. SKIPPED
>
> [INFO] Apache Hadoop KMS .................................. SKIPPED
>
> [INFO] Apache Hadoop Common Project ....................... SKIPPED
>
> [INFO] Apache Hadoop HDFS ................................. SKIPPED
>
> [INFO] Apache Hadoop HttpFS ............................... SKIPPED
>
> [INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
>
> [INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
>
> [INFO] Apache Hadoop HDFS Project ......................... SKIPPED
>
> [INFO] hadoop-yarn ........................................ SKIPPED
>
> [INFO] hadoop-yarn-api .................................... SKIPPED
>
> [INFO] hadoop-yarn-common ................................. SKIPPED
>
> [INFO] hadoop-yarn-server ................................. SKIPPED
>
> [INFO] hadoop-yarn-server-common .......................... SKIPPED
>
> [INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
>
> [INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
>
> [INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
>
> [INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
>
> [INFO] hadoop-yarn-server-tests ........................... SKIPPED
>
> [INFO] hadoop-yarn-client ................................. SKIPPED
>
> [INFO] hadoop-yarn-applications ........................... SKIPPED
>
> [INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
>
> [INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
>
> [INFO] hadoop-yarn-site ................................... SKIPPED
>
> [INFO] hadoop-yarn-registry ............................... SKIPPED
>
> [INFO] hadoop-yarn-project ................................ SKIPPED
>
> [INFO] hadoop-mapreduce-client ............................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-core ....................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-common ..................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-app ........................ SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
>
> [INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
>
> [INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
>
> [INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
>
> [INFO] hadoop-mapreduce ................................... SKIPPED
>
> [INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
>
> [INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
>
> [INFO] Apache Hadoop Archives ............................. SKIPPED
>
> [INFO] Apache Hadoop Rumen ................................ SKIPPED
>
> [INFO] Apache Hadoop Gridmix .............................. SKIPPED
>
> [INFO] Apache Hadoop Data Join ............................ SKIPPED
>
> [INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
>
> [INFO] Apache Hadoop Extras ............................... SKIPPED
>
> [INFO] Apache Hadoop Pipes ................................ SKIPPED
>
> [INFO] Apache Hadoop OpenStack support .................... SKIPPED
>
> [INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
>
> [INFO] Apache Hadoop Client ............................... SKIPPED
>
> [INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
>
> [INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
>
> [INFO] Apache Hadoop Tools Dist ........................... SKIPPED
>
> [INFO] Apache Hadoop Tools ................................ SKIPPED
>
> [INFO] Apache Hadoop Distribution ......................... SKIPPED
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] BUILD FAILURE
>
> [INFO]
> ------------------------------------------------------------------------
>
> [INFO] Total time: 02:07 min
>
> [INFO] Finished at: 2015-02-07T09:55:26+05:30
>
> [INFO] Final Memory: 55M/151M
>
> [INFO]
> ------------------------------------------------------------------------
>
> [ERROR] Failed to execute goal
> org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed. Process exited with an
> error: 1(Exit value: 1) -> [Help 1]
>
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on
> project hadoop-common: Command execution failed.
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
>
> at
> org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
>
> at
> org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
>
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
>
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
>
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
>
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
>
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
>
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
> at java.lang.reflect.Method.invoke(Method.java:483)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
>
> at
> org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
>
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
>
> at
> org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
>
> at
> org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
>
> ... 19 more
>
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1(Exit value: 1)
>
> at
> org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
>
> at
> org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
>
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
>
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
>
> ... 21 more
>
> [ERROR]
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
>
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
> command
>
> [ERROR] mvn <goals> -rf :hadoop-common
>
>
>
>
>
> Can someone please tell me how to correct this error and move forward?
>
>
>
> Thanks,
>
> Venkat.
>
>
>
>
>
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
To be more precise:
1. Replace x64 with Win32 in following files
hadoop-common-project\hadoop-common\src\main\native\native.sln
hadoop-common-project\hadoop-common\src\main\native\native.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj
2. Replace “Visual Studio 10 Win64” with “Visual Studio 10” in following file
hadoop-hdfs-project\hadoop-hdfs\pom.xml
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Kiran Kumar.M.R
Sent: Tuesday, February 10, 2015 16:33
To: user@hadoop.apache.org
Subject: RE: Error with winutils.sln
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by Rohith Sharma K S <ro...@huawei.com>.
There are some issues for compiling Hadoop in win32 platform. Even I am facing same issues. I think it is explicitly removed the support.
But It is possible to compile successfully by tweaking some of the files. Follow the below instructions
1. Apply the patch HADOOP-9922.patch to your 2.6 version
patch –p1 < HADOOP-9922.patch
2. Replace “Release|x64” with “Release|Win32” in $HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln
3. Replace “x64” with “Win32” in
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\winutils.vcxproj and
$HADOOP_HOME\hadoop-common-project\hadoop-common\src\main\winutils\libwinutils.vcxproj
If in your machine native compilation does not happen because of cmake not installed or any other reason then you will face issue while compiling hdfs project. So, for the sake of compiling you can skip native compilation at hdfs.
4. To skip native compilation, add “<skip>${skipTests}</skip>” or “<skip>true</skip>” in $HADOOP_HOME \hadoop-hdfs-project\hadoop-hdfs\pom.xml.
<configuration>
<skip>${skipTests}</skip>
<target>
<mkdir dir="${project.build.directory}/native"/>
Note : there are 2 occurrences, you add at both 2 occurrence
And compile using “mvn clean install –DskipTests”
Hope this will help to compile.. enjoy with Hadoop!!!
Thanks & Regards
Rohith Sharma K S
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: 10 February 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.
RE: Error with winutils.sln
Posted by "Kiran Kumar.M.R" <Ki...@huawei.com>.
Hi,
Build files support only x64 (64 bit). You can add 32bit build as below
1. You can edit .sln files and replace x64 with Win32 and the compile.
2. Also edit pom.xml (hadoop-hdfs-project\hadoop-hdfs)
To replace “Visual Studio 10 Win64” with “Visual Studio 10”
Regards,
Kiran
__________________________________________________________________________________________________________
This e-mail and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained herein in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it!
__________________________________________________________________________________________________________
From: Venkat Ramakrishnan [mailto:venkat.architect@gmail.com]
Sent: Tuesday, February 10, 2015 16:22
To: user@hadoop.apache.org
Subject: Error with winutils.sln
Hello,
I'm getting the following error while compiling with Windows 7 (32 bit). I
have set the Platform as Win32. The error complains about solution
configuration being different from winutils.sln:
.
.
.
.
[DEBUG] Configuring mojo org.codehaus.mojo:exec-maven-plugin:1.2:exec from plugin realm ClassRealm[plugin>org.codehaus.mojo:exec-maven-plugin:1.2, parent: sun.misc.Launcher$AppClassLoader@647e05<ma...@647e05>]
[DEBUG] Configuring mojo 'org.codehaus.mojo:exec-maven-plugin:1.2:exec' with basic configurator -->
[DEBUG] (f) arguments = [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln, /nologo, /p:Configuration=Release, /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/, /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/, /p:WsceConfigDir=../etc/hadoop, /p:WsceConfigFile=wsce-site.xml]
[DEBUG] (f) basedir = D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common
[DEBUG] (f) classpathScope = runtime
[DEBUG] (f) executable = msbuild
[DEBUG] (f) longClasspath = false
[DEBUG] (f) project = MavenProject: org.apache.hadoop:hadoop-common:2.6.0 @ D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\pom.xml
[DEBUG] (f) session = org.apache.maven.execution.MavenSession@157dc72<ma...@157dc72>
[DEBUG] (f) skip = false
[DEBUG] -- end configuration --
[DEBUG] Executing command line: msbuild D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common/src/main/winutils/winutils.sln /nologo /p:Configuration=Release /p:OutDir=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/bin/ /p:IntermediateOutputPath=D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\target/winutils/ /p:WsceConfigDir=../etc/hadoop /p:WsceConfigFile=wsce-site.xml
Build started 07-02-2015 09:55:21.
Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" on node 1 (default targets).
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
Done Building Project "D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default targets) -- FAILED.
Build FAILED.
"D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln" (default target) (1) ->
(ValidateSolutionConfiguration target) ->
D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln.metaproj : error MSB4126: The specified solution configuration "Release|Win32" is invalid. Please specify a valid solution configuration using the Configuration and Platform properties (e.g. MSBuild.exe Solution.sln /p:Configuration=Debug /p:Platform="Any CPU") or leave those properties blank to use the default solution configuration. [D:\h\hadoop-2.6.0-src\hadoop-common-project\hadoop-common\src\main\winutils\winutils.sln]
0 Warning(s)
1 Error(s)
Time Elapsed 00:00:04.41
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 5.314 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 3.756 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 7.977 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.312 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 4.561 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 10.205 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 7.418 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 10.640 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 8.438 s]
[INFO] Apache Hadoop Common ............................... FAILURE [01:04 min]
[INFO] Apache Hadoop NFS .................................. SKIPPED
[INFO] Apache Hadoop KMS .................................. SKIPPED
[INFO] Apache Hadoop Common Project ....................... SKIPPED
[INFO] Apache Hadoop HDFS ................................. SKIPPED
[INFO] Apache Hadoop HttpFS ............................... SKIPPED
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SKIPPED
[INFO] Apache Hadoop HDFS-NFS ............................. SKIPPED
[INFO] Apache Hadoop HDFS Project ......................... SKIPPED
[INFO] hadoop-yarn ........................................ SKIPPED
[INFO] hadoop-yarn-api .................................... SKIPPED
[INFO] hadoop-yarn-common ................................. SKIPPED
[INFO] hadoop-yarn-server ................................. SKIPPED
[INFO] hadoop-yarn-server-common .......................... SKIPPED
[INFO] hadoop-yarn-server-nodemanager ..................... SKIPPED
[INFO] hadoop-yarn-server-web-proxy ....................... SKIPPED
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SKIPPED
[INFO] hadoop-yarn-server-resourcemanager ................. SKIPPED
[INFO] hadoop-yarn-server-tests ........................... SKIPPED
[INFO] hadoop-yarn-client ................................. SKIPPED
[INFO] hadoop-yarn-applications ........................... SKIPPED
[INFO] hadoop-yarn-applications-distributedshell .......... SKIPPED
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SKIPPED
[INFO] hadoop-yarn-site ................................... SKIPPED
[INFO] hadoop-yarn-registry ............................... SKIPPED
[INFO] hadoop-yarn-project ................................ SKIPPED
[INFO] hadoop-mapreduce-client ............................ SKIPPED
[INFO] hadoop-mapreduce-client-core ....................... SKIPPED
[INFO] hadoop-mapreduce-client-common ..................... SKIPPED
[INFO] hadoop-mapreduce-client-shuffle .................... SKIPPED
[INFO] hadoop-mapreduce-client-app ........................ SKIPPED
[INFO] hadoop-mapreduce-client-hs ......................... SKIPPED
[INFO] hadoop-mapreduce-client-jobclient .................. SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins ................. SKIPPED
[INFO] Apache Hadoop MapReduce Examples ................... SKIPPED
[INFO] hadoop-mapreduce ................................... SKIPPED
[INFO] Apache Hadoop MapReduce Streaming .................. SKIPPED
[INFO] Apache Hadoop Distributed Copy ..................... SKIPPED
[INFO] Apache Hadoop Archives ............................. SKIPPED
[INFO] Apache Hadoop Rumen ................................ SKIPPED
[INFO] Apache Hadoop Gridmix .............................. SKIPPED
[INFO] Apache Hadoop Data Join ............................ SKIPPED
[INFO] Apache Hadoop Ant Tasks ............................ SKIPPED
[INFO] Apache Hadoop Extras ............................... SKIPPED
[INFO] Apache Hadoop Pipes ................................ SKIPPED
[INFO] Apache Hadoop OpenStack support .................... SKIPPED
[INFO] Apache Hadoop Amazon Web Services support .......... SKIPPED
[INFO] Apache Hadoop Client ............................... SKIPPED
[INFO] Apache Hadoop Mini-Cluster ......................... SKIPPED
[INFO] Apache Hadoop Scheduler Load Simulator ............. SKIPPED
[INFO] Apache Hadoop Tools Dist ........................... SKIPPED
[INFO] Apache Hadoop Tools ................................ SKIPPED
[INFO] Apache Hadoop Distribution ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:07 min
[INFO] Finished at: 2015-02-07T09:55:26+05:30
[INFO] Final Memory: 55M/151M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed. Process exited with an error: 1(Exit value: 1) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (compile-ms-winutils) on project hadoop-common: Command execution failed.
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:216)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80)
at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:120)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:347)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:154)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:582)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:214)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoExecutionException: Command execution failed.
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:345)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:132)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
... 19 more
Caused by: org.apache.commons.exec.ExecuteException: Process exited with an error: 1(Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:346)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:149)
at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(ExecMojo.java:589)
at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:335)
... 21 more
[ERROR]
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hadoop-common
Can someone please tell me how to correct this error and move forward?
Thanks,
Venkat.