You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lens.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2016/03/03 13:20:18 UTC
[jira] [Commented] (LENS-982) lens-ml-lib build timing out on some
environments
[ https://issues.apache.org/jira/browse/LENS-982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177734#comment-15177734 ]
Amareshwari Sriramadasu commented on LENS-982:
----------------------------------------------
Seeing following target/test.log
{noformat}
03 Mar 2016 12:05:55 [main] INFO org.apache.spark.SparkContext - Running Spark version 1.3.0
03 Mar 2016 12:05:55 [main] WARN org.apache.spark.util.Utils - Your hostname, IM0822-X0 resolves to a loopback address: 127.0.0.1; using 10.14.121.41 instead (on interface en1)
03 Mar 2016 12:05:55 [main] WARN org.apache.spark.util.Utils - Set SPARK_LOCAL_IP if you need to bind to another address
03 Mar 2016 12:05:56 [main] INFO org.apache.spark.SecurityManager - Changing view acls to: amareshwari.sr
03 Mar 2016 12:05:56 [main] INFO org.apache.spark.SecurityManager - Changing modify acls to: amareshwari.sr
03 Mar 2016 12:05:56 [main] INFO org.apache.spark.SecurityManager - SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(amareshwari.sr); users with modify permissions: Set(amareshwari.sr)
03 Mar 2016 12:05:57 [sparkDriver-akka.actor.default-dispatcher-4] INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
03 Mar 2016 12:05:57 [sparkDriver-akka.actor.default-dispatcher-4] INFO Remoting - Starting remoting
03 Mar 2016 12:05:57 [sparkDriver-akka.actor.default-dispatcher-4] INFO Remoting - Remoting started; listening on addresses :[akka.tcp://sparkDriver@im0822-x0.corp.inmobi.com:54241]
03 Mar 2016 12:05:57 [main] INFO org.apache.spark.util.Utils - Successfully started service 'sparkDriver' on port 54241.
03 Mar 2016 12:05:57 [main] INFO org.apache.spark.SparkEnv - Registering MapOutputTracker
03 Mar 2016 12:05:57 [main] INFO org.apache.spark.SparkEnv - Registering BlockManagerMaster
03 Mar 2016 12:05:57 [main] INFO org.apache.spark.storage.DiskBlockManager - Created local directory at /var/folders/fp/r6j_80xs04z71t2pzw8z3y4jtv0t59/T/spark-34b16e20-45e5-4c31-85e3-dd6ec1f6e02f/blockmgr-3b67005a-7ff7-4610-9dee-2ffb32d504fb
03 Mar 2016 12:05:57 [main] INFO org.apache.spark.storage.MemoryStore - MemoryStore started with capacity 960.1 MB
03 Mar 2016 12:05:57 [main] INFO org.apache.spark.HttpFileServer - HTTP File server directory is /var/folders/fp/r6j_80xs04z71t2pzw8z3y4jtv0t59/T/spark-842f5215-1061-421d-a406-cc3b6c13061e/httpd-43d0646e-b17c-4166-81e2-f914d415c035
03 Mar 2016 12:05:57 [main] INFO org.apache.spark.HttpServer - Starting HTTP Server
03 Mar 2016 12:05:58 [main] INFO org.spark-project.jetty.server.Server - jetty-8.y.z-SNAPSHOT
03 Mar 2016 12:05:58 [main] INFO org.spark-project.jetty.server.AbstractConnector - Started SocketConnector@0.0.0.0:54243
03 Mar 2016 12:05:58 [main] INFO org.apache.spark.util.Utils - Successfully started service 'HTTP file server' on port 54243.
03 Mar 2016 12:05:58 [main] INFO org.apache.spark.SparkEnv - Registering OutputCommitCoordinator
03 Mar 2016 12:05:58 [main] ERROR org.apache.hive.service.CompositeService - Error starting services lens_services
java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s signer information does not match signer information of other classes in the same package
at java.lang.ClassLoader.checkCerts(ClassLoader.java:895) ~[na:1.8.0_66]
at java.lang.ClassLoader.preDefineClass(ClassLoader.java:665) ~[na:1.8.0_66]
at java.lang.ClassLoader.defineClass(ClassLoader.java:758) ~[na:1.8.0_66]
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) ~[na:1.8.0_66]
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467) ~[na:1.8.0_66]
at java.net.URLClassLoader.access$100(URLClassLoader.java:73) ~[na:1.8.0_66]
at java.net.URLClassLoader$1.run(URLClassLoader.java:368) ~[na:1.8.0_66]
at java.net.URLClassLoader$1.run(URLClassLoader.java:362) ~[na:1.8.0_66]
at java.security.AccessController.doPrivileged(Native Method) ~[na:1.8.0_66]
at java.net.URLClassLoader.findClass(URLClassLoader.java:361) ~[na:1.8.0_66]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[na:1.8.0_66]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) ~[na:1.8.0_66]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[na:1.8.0_66]
at org.spark-project.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:136) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.spark-project.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:129) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.spark-project.jetty.servlet.ServletContextHandler.<init>(ServletContextHandler.java:98) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:101) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.JettyUtils$.createServletHandler(JettyUtils.scala:92) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.WebUI.attachPage(WebUI.scala:67) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:60) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.WebUI$$anonfun$attachTab$1.apply(WebUI.scala:60) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) ~[scala-library-2.10.4.jar:na]
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47) ~[scala-library-2.10.4.jar:na]
at org.apache.spark.ui.WebUI.attachTab(WebUI.scala:60) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.SparkUI.initialize(SparkUI.scala:50) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:61) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:151) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.ui.SparkUI$.createLiveUI(SparkUI.scala:106) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.SparkContext.<init>(SparkContext.scala:298) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:61) ~[spark-core_2.10-1.3.0.jar:1.3.0]
at org.apache.lens.ml.algo.spark.SparkMLDriver.start(SparkMLDriver.java:194) ~[classes/:na]
at org.apache.lens.ml.impl.LensMLImpl.start(LensMLImpl.java:314) ~[classes/:na]
at org.apache.lens.ml.server.MLServiceImpl.start(MLServiceImpl.java:167) ~[classes/:na]
at org.apache.hive.service.CompositeService.start(CompositeService.java:70) ~[hive-service-0.13.3-inm.jar:0.13.3-inm]
at org.apache.lens.server.LensServices.start(LensServices.java:269) [lens-server-2.6.0-beta-SNAPSHOT-classes.jar:2.6.0-beta-SNAPSHOT]
at org.apache.lens.server.LensJerseyTest.startAll(LensJerseyTest.java:154) [lens-server-2.6.0-beta-SNAPSHOT-tests.jar:2.6.0-beta-SNAPSHOT]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_66]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_66]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_66]
at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_66]
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80) [testng-6.8.jar:na]
at org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:564) [testng-6.8.jar:na]
at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:213) [testng-6.8.jar:na]
at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:138) [testng-6.8.jar:na]
at org.testng.SuiteRunner.privateRun(SuiteRunner.java:277) [testng-6.8.jar:na]
at org.testng.SuiteRunner.run(SuiteRunner.java:240) [testng-6.8.jar:na]
at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) [testng-6.8.jar:na]
at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) [testng-6.8.jar:na]
at org.testng.TestNG.runSuitesSequentially(TestNG.java:1198) [testng-6.8.jar:na]
at org.testng.TestNG.runSuitesLocally(TestNG.java:1123) [testng-6.8.jar:na]
at org.testng.TestNG.run(TestNG.java:1031) [testng-6.8.jar:na]
at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:69) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeMulti(TestNGDirectoryTestSuite.java:181) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:99) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:113) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.15.jar:2.15]
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.15.jar:2.15]
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.15.jar:2.15]
03 Mar 2016 12:05:58 [main] WARN org.apache.lens.ml.algo.spark.SparkMLDriver - Spark driver was not started
03 Mar 2016 12:05:58 [main] INFO org.apache.hive.service.CompositeService - Error stopping ml
java.lang.NullPointerException: null
at org.apache.lens.ml.impl.LensMLImpl.stop(LensMLImpl.java:338) ~[classes/:na]
at org.apache.lens.ml.server.MLServiceImpl.stop(MLServiceImpl.java:179) ~[classes/:na]
at org.apache.hive.service.CompositeService.stop(CompositeService.java:102) [hive-service-0.13.3-inm.jar:0.13.3-inm]
at org.apache.hive.service.CompositeService.start(CompositeService.java:79) [hive-service-0.13.3-inm.jar:0.13.3-inm]
at org.apache.lens.server.LensServices.start(LensServices.java:269) [lens-server-2.6.0-beta-SNAPSHOT-classes.jar:2.6.0-beta-SNAPSHOT]
at org.apache.lens.server.LensJerseyTest.startAll(LensJerseyTest.java:154) [lens-server-2.6.0-beta-SNAPSHOT-tests.jar:2.6.0-beta-SNAPSHOT]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_66]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_66]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_66]
at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_66]
at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:80) [testng-6.8.jar:na]
at org.testng.internal.Invoker.invokeConfigurationMethod(Invoker.java:564) [testng-6.8.jar:na]
at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:213) [testng-6.8.jar:na]
at org.testng.internal.Invoker.invokeConfigurations(Invoker.java:138) [testng-6.8.jar:na]
at org.testng.SuiteRunner.privateRun(SuiteRunner.java:277) [testng-6.8.jar:na]
at org.testng.SuiteRunner.run(SuiteRunner.java:240) [testng-6.8.jar:na]
at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52) [testng-6.8.jar:na]
at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:86) [testng-6.8.jar:na]
at org.testng.TestNG.runSuitesSequentially(TestNG.java:1198) [testng-6.8.jar:na]
at org.testng.TestNG.runSuitesLocally(TestNG.java:1123) [testng-6.8.jar:na]
at org.testng.TestNG.run(TestNG.java:1031) [testng-6.8.jar:na]
at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:69) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeMulti(TestNGDirectoryTestSuite.java:181) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:99) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:113) [surefire-testng-2.15.jar:2.15]
at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) [surefire-booter-2.15.jar:2.15]
at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) [surefire-booter-2.15.jar:2.15]
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) [surefire-booter-2.15.jar:2.15]
03 Mar 2016 12:05:58 [main] INFO org.apache.hive.service.AbstractService - Service:quota is stopped.
03 Mar 2016 12:05:58 [main] INFO org.apache.hive.service.AbstractService - Service:scheduler is stopped.
03 Mar 2016 12:05:58 [main] INFO org.apache.hive.service.AbstractService - Service:metastore is stopped.
03 Mar 2016 12:05:58 [main] INFO org.apache.hive.service.AbstractService - Service:query is stopped.
{noformat}
> lens-ml-lib build timing out on some environments
> -------------------------------------------------
>
> Key: LENS-982
> URL: https://issues.apache.org/jira/browse/LENS-982
> Project: Apache Lens
> Issue Type: Bug
> Components: ml, test
> Environment: java -version
> java version "1.8.0_66"
> Java(TM) SE Runtime Environment (build 1.8.0_66-b17)
> Reporter: Amareshwari Sriramadasu
>
> Seeing the ml build stuck and times out after 40 minutes
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)