You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hudi.apache.org by Vinoth Chandar <vi...@apache.org> on 2020/06/02 18:36:22 UTC

CI/Master tests failing

Hi all,

This is PSA.. We are observing some flakiness with master and the last
three PR merges have failed. balaji is looking at the fix/issue..

But in the meantime, I'd ask committers to temporarily not merge more PRs
until this is resolved. It will help us fix this early.

Error looks something like this

[ERROR] Error occurred in starting fork, check output in log
14007[ERROR] Process Exit Code: 1
14008[ERROR] Crashed tests:
14009[ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable
14010[ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException:
The forked VM terminated without properly saying goodbye. VM crash or
System.exit called?
14011[ERROR] Command was /bin/sh -c cd
/home/travis/build/apache/hudi/hudi-client &&
/usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xmx2g -jar
/home/travis/build/apache/hudi/hudi-client/target/surefire/surefirebooter6746374343787497574.jar
/home/travis/build/apache/hudi/hudi-client/target/surefire
2020-06-02T12-27-45_220-jvmRun1 surefire6644367455247671601tmp
surefire_37399402556296347739tmp
14012[ERROR] Error occurred in starting fork, check output in log
14013[ERROR] Process Exit Code: 1
14014[ERROR] Crashed tests:
14015[ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable
14016[ERROR] 	at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:690)
14017[ERROR] 	at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:285)
14018[ERROR] 	at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:248)
14019[ERROR] 	at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1217)
14020[ERROR] 	at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1063)
14021[ERROR] 	at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:889)
14022[ERROR] 	at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
14023[ERROR] 	at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
14024[ERROR] 	at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
14025[ERROR] 	at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
14026[ERROR] 	at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
14027[ERROR] 	at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81)
14028[ERROR] 	at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
14029[ERROR] 	at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
14030[ERROR] 	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309)
14031[ERROR] 	at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194)
14032[ERROR] 	at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107)
14033[ERROR] 	at org.apache.maven.cli.MavenCli.execute(MavenCli.java:955)
14034[ERROR] 	at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:290)
14035[ERROR] 	at org.apache.maven.cli.MavenCli.main(MavenCli.java:194)
14036[ERROR] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
14037[ERROR] 	at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
14038[ERROR] 	at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
14039[ERROR] 	at java.lang.reflect.Method.invoke(Method.java:498)
14040[ERROR] 	at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
14041[ERROR] 	at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
14042[ERROR] 	at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
14043[ERROR] 	at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
14044[ERROR] -> [Help 1]
14045[ERROR]

Re: CI/Master tests failing

Posted by "vbalaji@apache.org" <vb...@apache.org>.
 
I fixed a a bunch of issues around flakiness (PR-1697) and have landed the change. There is still flakiness with CI  possibly related to leaks (HUDI-997) in unit-tests in hudi-client. At this time, I would need help to have someone take up HUDI-997 to make CI test stable. Any volunteers ?
Balaji.V 

    On Tuesday, June 2, 2020, 11:36:37 AM PDT, Vinoth Chandar <vi...@apache.org> wrote:  
 
 Hi all,

This is PSA.. We are observing some flakiness with master and the last
three PR merges have failed. balaji is looking at the fix/issue..

But in the meantime, I'd ask committers to temporarily not merge more PRs
until this is resolved. It will help us fix this early.

Error looks something like this

[ERROR] Error occurred in starting fork, check output in log
14007[ERROR] Process Exit Code: 1
14008[ERROR] Crashed tests:
14009[ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable
14010[ERROR] org.apache.maven.surefire.booter.SurefireBooterForkException:
The forked VM terminated without properly saying goodbye. VM crash or
System.exit called?
14011[ERROR] Command was /bin/sh -c cd
/home/travis/build/apache/hudi/hudi-client &&
/usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -Xmx2g -jar
/home/travis/build/apache/hudi/hudi-client/target/surefire/surefirebooter6746374343787497574.jar
/home/travis/build/apache/hudi/hudi-client/target/surefire
2020-06-02T12-27-45_220-jvmRun1 surefire6644367455247671601tmp
surefire_37399402556296347739tmp
14012[ERROR] Error occurred in starting fork, check output in log
14013[ERROR] Process Exit Code: 1
14014[ERROR] Crashed tests:
14015[ERROR] org.apache.hudi.table.TestHoodieMergeOnReadTable
14016[ERROR]     at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:690)
14017[ERROR]     at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:285)
14018[ERROR]     at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:248)
14019[ERROR]     at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1217)
14020[ERROR]     at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1063)
14021[ERROR]     at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:889)
14022[ERROR]     at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134)
14023[ERROR]     at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
14024[ERROR]     at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
14025[ERROR]     at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
14026[ERROR]     at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
14027[ERROR]     at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81)
14028[ERROR]     at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
14029[ERROR]     at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
14030[ERROR]     at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:309)
14031[ERROR]     at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:194)
14032[ERROR]     at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:107)
14033[ERROR]     at org.apache.maven.cli.MavenCli.execute(MavenCli.java:955)
14034[ERROR]     at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:290)
14035[ERROR]     at org.apache.maven.cli.MavenCli.main(MavenCli.java:194)
14036[ERROR]     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
14037[ERROR]     at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
14038[ERROR]     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
14039[ERROR]     at java.lang.reflect.Method.invoke(Method.java:498)
14040[ERROR]     at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
14041[ERROR]     at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
14042[ERROR]     at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
14043[ERROR]     at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
14044[ERROR] -> [Help 1]
14045[ERROR]