You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Shouheng Yi <sh...@gmail.com> on 2017/01/09 23:56:57 UTC
Failed to build REEF on Windows' Ubuntu Bash
Hi REEF devs,
I tried to build REEF on my Windows machine using Ubuntu Bash; and it
failed after I did "mvn clean install -e." Has anybody done such a thing?
Thanks!
Results :
Tests in error:
TestRuntimeStartHandler.testHttpHandlerBindingWithRuntimeClock:72 »
Runtime or...
TestRuntimeStartHandler.testRunTimeStartStopHandler:86 » Injection Could
not i...
Tests run: 47, Failures: 0, Errors: 2, Skipped: 0
[INFO]
------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] REEF .............................................. SUCCESS [10.602s]
[INFO] REEF Dot Net ...................................... SUCCESS [4.317s]
[INFO] REEF Annotations .................................. SUCCESS [6.985s]
[INFO] REEF Utils ........................................ SUCCESS [26.122s]
[INFO] REEF Tang Project ................................. SUCCESS [1.675s]
[INFO] Tang Test Jar A ................................... SUCCESS [4.831s]
[INFO] Tang Test Jar B ................................... SUCCESS [5.030s]
[INFO] Tang Test Jar AB .................................. SUCCESS [4.865s]
[INFO] Tang Test Jar B conflict A ........................ SUCCESS [0.894s]
[INFO] REEF Tang ......................................... SUCCESS [30.030s]
[INFO] REEF Wake Project ................................. SUCCESS [1.331s]
[INFO] REEF Wake ......................................... SUCCESS
[3:25.818s]
[INFO] REEF Common ....................................... SUCCESS [38.141s]
[INFO] REEF Runtime Local ................................ SUCCESS [41.855s]
[INFO] REEF Applications ................................. SUCCESS [0.914s]
[INFO] REEF Vortex ....................................... SUCCESS [14.791s]
[INFO] REEF HTTP Server .................................. FAILURE [48.582s]
[INFO] REEF Utils for Hadoop ............................. SKIPPED
[INFO] REEF Runtime for YARN ............................. SKIPPED
[INFO] REEF Runtime for HDInsight ........................ SKIPPED
[INFO] REEF IO ........................................... SKIPPED
[INFO] REEF Checkpoint ................................... SKIPPED
[INFO] REEF Bridge Java .................................. SKIPPED
[INFO] REEF Runtime for multiple runtime scenarios ....... SKIPPED
[INFO] REEF Bridge (Client) .............................. SKIPPED
[INFO] REEF Runtime Standalone ........................... SKIPPED
[INFO] REEF Runtime for Mesos ............................ SKIPPED
[INFO] REEF Poison ....................................... SKIPPED
[INFO] REEF Examples ..................................... SKIPPED
[INFO] REEF Examples CLR ................................. SKIPPED
[INFO] REEF Examples on HDInsight ........................ SKIPPED
[INFO] REEF Tang Tint .................................... SKIPPED
[INFO] REEF Tests ........................................ SKIPPED
[INFO] REEF Website ...................................... SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 7:27.365s
[INFO] Finished at: Mon Jan 09 23:54:23 GMT 2017
[INFO] Final Memory: 80M/1441M
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test)
on project reef-webserver: There are test failures.
[ERROR]
[ERROR] Please refer to
/mnt/e/reef/lang/java/reef-webserver/target/surefire-reports for the
individual test results.
[ERROR] -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test
(default-test) on project reef-webserver: There are test failures.
Please refer to
/mnt/e/reef/lang/java/reef-webserver/target/surefire-reports for the
individual test results.
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
Caused by: org.apache.maven.plugin.MojoFailureException: There are test
failures.
Please refer to
/mnt/e/reef/lang/java/reef-webserver/target/surefire-reports for the
individual test results.
at
org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:91)
at
org.apache.maven.plugin.surefire.SurefirePlugin.handleSummary(SurefirePlugin.java:320)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:892)
at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:755)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
[ERROR]
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the
command
[ERROR] mvn <goals> -rf :reef-webserver
Re: Failed to build REEF on Windows' Ubuntu Bash
Posted by Byung-Gon Chun <bg...@gmail.com>.
Welcome to REEF, Pei and Shouheng!
Best,
Gon
On Tue, Jan 10, 2017 at 10:16 AM, Pei Jiang <pe...@microsoft.com> wrote:
> Hi Markus,
>
> > > Today I managed to build REEF Java on both Ubuntu and Windows, with
> Java 8 SDK.
>
> > Great! Have you had a look at the build instructions[0]? it would be
> good to know whether those can be improved. I'm asking because the steps
> you mention seem to be a bit more involved than needed:
>
> Yes, I look at it. The instructions is rather helpful. To me the only
> ambiguity is the installation of Protocol Buffers, as I'm not sure to which
> extent it should be installed so I took the extra step to build the
> Protobuf's Java runtime. (It'd be great to mention in the instructions that
> getting the C++ engine of Protocol Buffers suffices.)
>
> > > Ubuntu 16.04 LTS
> > > 1. Install maven 3.3.9
> > > a. Download and untar it.
> > > b. Add Maven's bin/ to PATH.
>
> > Doesn't ubuntu have a Maven available via `apt-get`? That is how used it
> in the past.
>
> The version from apt-get is below the Maven 3.3+ requirement shown in the
> installation instructions.
> Of course, we can always add a PPA and get it from there but I don't think
> that would be more efficient than simply downloading it from Maven :-)
>
> Best,
> Pei
>
--
Byung-Gon Chun
RE: Failed to build REEF on Windows' Ubuntu Bash
Posted by Pei Jiang <pe...@microsoft.com>.
Hi Markus,
> > Today I managed to build REEF Java on both Ubuntu and Windows, with Java 8 SDK.
> Great! Have you had a look at the build instructions[0]? it would be good to know whether those can be improved. I'm asking because the steps you mention seem to be a bit more involved than needed:
Yes, I look at it. The instructions is rather helpful. To me the only ambiguity is the installation of Protocol Buffers, as I'm not sure to which extent it should be installed so I took the extra step to build the Protobuf's Java runtime. (It'd be great to mention in the instructions that getting the C++ engine of Protocol Buffers suffices.)
> > Ubuntu 16.04 LTS
> > 1. Install maven 3.3.9
> > a. Download and untar it.
> > b. Add Maven's bin/ to PATH.
> Doesn't ubuntu have a Maven available via `apt-get`? That is how used it in the past.
The version from apt-get is below the Maven 3.3+ requirement shown in the installation instructions.
Of course, we can always add a PPA and get it from there but I don't think that would be more efficient than simply downloading it from Maven :-)
Best,
Pei
Re: Failed to build REEF on Windows' Ubuntu Bash
Posted by Markus Weimer <ma...@weimo.de>.
On 2017-01-09 16:43, Pei Jiang wrote:
> Today I managed to build REEF Java on both Ubuntu and Windows, with Java 8 SDK.
Great! Have you had a look at the build instructions[0]? it would be
good to know whether those can be improved. I'm asking because the steps
you mention seem to be a bit more involved than needed:
> Ubuntu 16.04 LTS
> 1. Install maven 3.3.9
> a. Download and untar it.
> b. Add Maven's bin/ to PATH.
Doesn't ubuntu have a Maven available via `apt-get`? That is how used it
in the past.
> 2. Install Protocol Buffers 2.5
> a. Download the source package and untar it.
> b. Build the C++ engine. [...]
> c. Build the Java runtime.
> i. Cd into the Java folder.
> ii. mvn install
You should not need this, as our builds will download the Java version
of Protobuf automatically from maven central.
> Windows 10 (with command prompt)
> 2. Install Protocol Buffers 2.5
> a. Download the source as well as the Win 32 executable.
> b. Unzip both and put the executable protoc.exe under the unzipped src/ folder.
> c. Add the path to protoc.exe to PATH.
You should only need protoc.exe on the path. No need to download the
sources.
> d. Build the Java runtime:
> i. Cd into the Java folder.
> ii. mvn install
Same as above; protobuf is available for java directly via maven.
Markus
[0]: https://cwiki.apache.org/confluence/display/REEF/Compiling+REEF
RE: Failed to build REEF on Windows' Ubuntu Bash
Posted by Pei Jiang <pe...@microsoft.com>.
Hi Markus and Shouheng,
Today I managed to build REEF Java on both Ubuntu and Windows, with Java 8 SDK.
Steps:
Ubuntu 16.04 LTS
1. Install maven 3.3.9
a. Download and untar it.
b. Add Maven's bin/ to PATH.
2. Install Protocol Buffers 2.5
a. Download the source package and untar it.
b. Build the C++ engine.
i. sudo apt-get install autoconf automake libtool curl make g++ unzip
ii. ./autogen.sh
iii. ./configure
iv. make
v. make check
vi. sudo make install
vii. sudo ldconfig
c. Build the Java runtime.
i. Cd into the Java folder.
ii. mvn install
3. Clone REEF and run mvn clean install
Windows 10 (with command prompt)
1. Install maven 3.3.9
a. Download and unzip it.
b. Add Maven's bin/ to PATH.
2. Install Protocol Buffers 2.5
a. Download the source as well as the Win 32 executable.
b. Unzip both and put the executable protoc.exe under the unzipped src/ folder.
c. Add the path to protoc.exe to PATH.
d. Build the Java runtime:
i. Cd into the Java folder.
ii. mvn install
3. Clone REEF and run mvn clean install
In addition to the main C++ engine, I built and installed the Protocol Buffers' Java Runtime. Not sure if this is necessary.
(Intuitively REEF will at least utilize the Java interface of Protobuf. If that's the case, it'd be great to mention this in the installation guide.)
Best,
Pei
Re: Failed to build REEF on Windows' Ubuntu Bash
Posted by Markus Weimer <ma...@weimo.de>.
I don't think we have much experience with building REEF on Ubuntu on
Windows. That said: Which version of Java are you running? Last I tried,
there were issues with Java 8 on Ubuntu on Windows.
Also, can you try building with `-D skipTests` to see whether the build
without tests succeeds?
Markus