You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/12/18 21:24:29 UTC
Build failed in Jenkins:
beam_PostCommit_Java_ValidatesRunner_Gearpump #1675
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/1675/display/redirect?page=changes>
Changes:
[ccy] Update Dataflow Python container to 20181218
------------------------------------------
[...truncated 11.68 MB...]
INFO: Received RegisterActorSystem akka.tcp://master@127.0.0.1:43675 for AppMaster
Dec 18, 2018 9:24:26 PM org.apache.gearpump.util.ActorSystemBooter$Daemon$$anonfun$waitCommand$1 applyOrElse
INFO: creating actor appdaemon1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.AppMasterLauncher$$anonfun$waitForAppMasterToStart$1 applyOrElse
INFO: AppMaster is created, mission complete...
Dec 18, 2018 9:24:26 PM org.apache.gearpump.util.ActorSystemBooter$Daemon$$anonfun$waitCommand$1 applyOrElse
INFO: ActorSystem app1-executor-1 Binding life cycle with actor: Actor[akka://master/user/Worker0/$c/$a/appdaemon1#-1988520809]
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.MasterProxy$$anonfun$2 apply
INFO: Contacts point URL: akka.tcp://master@127.0.0.1:43675/user/master
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.MasterProxy <init>
INFO: Master Proxy is started...
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.MasterProxy$$anonfun$findMaster$1$$anonfun$apply$mcV$sp$1 apply
INFO: sending identity to ActorSelection[Anchor(akka://master/), Path(/user/master)]
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.MasterProxy$$anonfun$establishing$1 applyOrElse
INFO: Stashing WatchMaster
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.MasterProxy$$anonfun$establishing$1 applyOrElse
INFO: Stashing RegisterAppMaster
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.MasterProxy$$anonfun$establishing$1 applyOrElse
INFO: Connected to [akka://master/user/master]
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.AppManager$$anonfun$appMasterMessage$1 applyOrElse
INFO: Register AppMaster for app: 1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.appmaster.AppMasterRuntimeEnvironment$$anonfun$receive$1 applyOrElse
INFO: Master is connected, start AppMaster 1...
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesLists STANDARD_OUT
Submit application succeed. The application id is 1
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesLists STANDARD_ERROR
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.AppMaster <init>
INFO: AppMaster[1] is launched by jenkins, app: AppDescription(beam_gearpump_app,org.apache.gearpump.streaming.appmaster.AppMaster,org.apache.gearpump.cluster.UserConfig@230c90fa,Config(SimpleConfigObject({"akka":{"actor":{"default-dispatcher":{"fork-join-executor":{"parallelism-factor":2,"parallelism-max":4,"parallelism-min":4},"throughput":10},"default-mailbox":{"mailbox-type":"akka.dispatch.SingleConsumerOnlyUnboundedMailbox"},"kryo":{"buffer-size":4096,"classes":[],"compression":"off","idstrategy":"incremental","implicit-registration-logging":true,"kryo-reference-map":true,"kryo-trace":false,"max-buffer-size":-1,"serializer-pool-size":16,"type":"graph","use-manifests":false},"provider":"akka.cluster.ClusterActorRefProvider","warn-about-java-serializer-usage":false},"daemonic":"on","extensions":["org.apache.gearpump.transport.Express$","org.apache.gearpump.metrics.Metrics$"],"http":{"client":{"parsing":{"max-content-length":"2048m"}},"server":{"parsing":{"illegal-header-warnings":"off","max-content-length":"2048m"},"remote-address-header":"on"},"session":{"cookie":{"http-only":true,"name":"gearpump_token","path":"/","secure":false},"encrypt-data":true,"max-age":604800,"server-secret":"Please change this to a value only you know! At least 64 chars!!!"}},"io":{"tcp":{"windows-connection-abort-workaround-enabled":"off"}},"log-dead-letters":"off","log-dead-letters-during-shutdown":"off","loggers":["akka.event.slf4j.Slf4jLogger"],"logging-filter":"akka.event.slf4j.Slf4jLoggingFilter","loglevel":"INFO","remote":{"default-remote-dispatcher":{"executor":"fork-join-executor","throughput":5,"type":"Dispatcher"},"enabled-transports":["akka.remote.netty.tcp"],"log-remote-lifecycle-events":"off","netty":{"tcp":{"hostname":"127.0.0.1","maximum-frame-size":"2048000b","port":43675,"receive-buffer-size":"4096000b","send-buffer-size":"4096000b"}},"use-dispatcher":"akka.remote.default-remote-dispatcher"},"scheduler":{"tick-duration":1},"test":{"single-expect-default":"10s"}},"beamTestPipelineOptions":"[\"--runner=TestGearpumpRunner\",\"--streaming=true\"]","gearpump":{"application":{"executor-num":1,"total-retries":0},"appmaster":{"extraClasspath":"","vmargs":""},"cgroup":{"cpu-core-limit-per-executor":1,"root":"gearpump"},"cluster":{"masters":["127.0.0.1:43675"]},"executor":{"extraClasspath":"","vmargs":""},"home":"","hostname":"127.0.0.1","jarstore":{"rootpath":"jarstore/"},"log":{"application":{"dir":"logs"},"daemon":{"dir":"logs"}},"master-resource-manager-container-id":"","masterclient":{"timeout":90},"metrics":{"akka":{"max-limit-on-query":1000,"metrics-aggregator-class":{"org.apache.gearpump.streaming.metrics.ProcessorAggregator":"","org.apache.gearpump.streaming.metrics.TaskFilterAggregator":""}},"enabled":true,"graphite":{"host":"127.0.0.1","port":2003},"report-interval-ms":3000,"reporter":"akka","retainHistoryData":{"hours":72,"intervalMs":3600000},"retainRecentData":{"intervalMs":15000,"seconds":300},"sample-rate":1},"netty":{"base-sleep-ms":100,"buffer-size":5242880,"dispatcher":"gearpump.shared-thread-pool-dispatcher","flush-check-interval":5,"max-retries":30,"max-sleep-ms":1000,"message-batch-size":262144},"remote-debug-executor-jvm":false,"resource-allocation-timeout-seconds":120,"scheduling":{"scheduler-class":"org.apache.gearpump.cluster.scheduler.PriorityScheduler"},"serialization-framework":"org.apache.gearpump.serializer.FastKryoSerializationFramework","serializer":{"pool":"org.apache.gearpump.serializer.FastKryoSerializerPool"},"serializers":{"[B":"","[C":"","[D":"","[F":"","[I":"","[J":"","[Ljava.lang.String;":"","[S":"","[Z":"","akka.actor.LocalActorRef":"","scala.Array":"","scala.Tuple1":"","scala.Tuple2":"","scala.Tuple3":"","scala.Tuple4":"","scala.Tuple5":"","scala.Tuple6":"","scala.collection.immutable.$colon$colon":"","scala.collection.immutable.List":"","scala.collection.immutable.Vector":""},"services":{"config-render-option-concise":true,"host":"127.0.0.1","http":8090,"supervisor-actor-path":""},"shared-thread-pool-dispatcher":{"fork-join-executor":{"parallelism-factor":2,"parallelism-max":8,"parallelism-min":2},"mailbox-type":"akka.dispatch.SingleConsumerOnlyUnboundedMailbox","throughput":100},"single-thread-dispatcher":{"type":"PinnedDispatcher"},"start-executor-system-timeout-ms":120000,"streaming":{"ack-once-every-message-count":100,"max-pending-message-count-per-connection":1000,"register-task-timeout-ms":120000},"task-dispatcher":"gearpump.shared-thread-pool-dispatcher","transport":{"serializer":"org.apache.gearpump.streaming.task.StreamingTransportSerializer"},"ui-default-dispatcher":{"executor":"thread-pool-executor","thread-pool-executor":{"core-pool-size-factor":2,"core-pool-size-max":32,"core-pool-size-min":2},"throughput":1,"type":"Dispatcher"},"verbose-gc":false,"worker":{"executor-process-launcher":"org.apache.gearpump.cluster.worker.DefaultExecutorProcessLauncher","executor-share-same-jvm-as-worker":true,"slots":1000},"worker-resource-manager-container-id":"","yarn":{"applicationmaster":{"command":"$JAVA_HOME/bin/java -Xmx512m","memory":"512","queue":"default","vcores":"1"},"client":{"package-path":"/usr/lib/gearpump/gearpump.zip"},"master":{"command":"$JAVA_HOME/bin/java -Xmx512m","memory":"512","vcores":"1"},"services":{"enabled":true},"worker":{"command":"$JAVA_HOME/bin/java -Xmx512m","containers":"1","memory":"4096","vcores":"1"}}},"org":{"gradle":{"native":"false","test":{"worker":"1"}}}}))) xxxxxxxxxxxxxxxxx
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.AppMaster <init>
INFO: AppMaster actor path: akka.tcp://master@127.0.0.1:43675/user/Worker0/$c/$a/appdaemon1/$c/appmaster
Dec 18, 2018 9:24:26 PM org.apache.gearpump.metrics.MetricsReporterService getReporter
INFO: Metrics reporter is enabled, using akka reporter
Dec 18, 2018 9:24:26 PM org.apache.gearpump.metrics.AkkaReporter <init>
INFO: Start Metrics AkkaReporter
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.DagManager preStart
INFO: Initializing Dag Service, get stored Dag ....
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.InMemoryKVService$$anonfun$kvService$1 applyOrElse
INFO: Successfully retrived group: gearpump_kvservice_1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ClockService preStart
INFO: Initializing Clock service, get snapshotted StartClock ....
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager applicationReady
INFO: goto state ApplicationReady(dag = -1)...
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.master.InMemoryKVService$$anonfun$kvService$1 applyOrElse
INFO: Successfully retrived group: gearpump_kvservice_1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$3 applyOrElse
INFO: Broadcasting StartDynamicDag
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: Broadcast StartDynamicDag to all executors
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ClockService$$anonfun$preStart$1 apply
INFO: Start Clock Retrieved, starting ClockService, startClock: -9223372036854775808
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.JarScheduler$JarSchedulerImpl$$anonfun$waitForNewDag$1 applyOrElse
INFO: Init JarScheduler, dag version: 0, startTime: -9223372036854775808
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager dynamicDag
INFO: DynamicDag transit to dag version: 0...
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.JarScheduler$JarSchedulerImpl$$anonfun$waitForNewDag$1$$anonfun$applyOrElse$1 apply
INFO: Set DAG for TaskScheduler, count: 5
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.JarScheduler$JarSchedulerImpl$$anonfun$ready$1 applyOrElse
INFO: GetRequestDetails ResourceRequestDetail(null,[Lorg.apache.gearpump.cluster.scheduler.ResourceRequest;@71ab4c48)
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.appmaster.ExecutorSystemScheduler$$anonfun$clientCommands$1 applyOrElse
INFO: starting executor systems (ExecutorSystemConfig(ExecutorSystemJvmConfig([Ljava.lang.String;@584cbabd,[Ljava.lang.String;@17315e52,Some(null),jenkins,Config(SimpleConfigObject({"akka":{"actor":{"default-dispatcher":{"fork-join-executor":{"parallelism-factor":2,"parallelism-max":4,"parallelism-min":4},"throughput":10},"default-mailbox":{"mailbox-type":"akka.dispatch.SingleConsumerOnlyUnboundedMailbox"},"kryo":{"buffer-size":4096,"classes":[],"compression":"off","idstrategy":"incremental","implicit-registration-logging":true,"kryo-reference-map":true,"kryo-trace":false,"max-buffer-size":-1,"serializer-pool-size":16,"type":"graph","use-manifests":false},"provider":"akka.cluster.ClusterActorRefProvider","warn-about-java-serializer-usage":false},"daemonic":"on","extensions":["org.apache.gearpump.transport.Express$","org.apache.gearpump.metrics.Metrics$"],"http":{"client":{"parsing":{"max-content-length":"2048m"}},"server":{"parsing":{"illegal-header-warnings":"off","max-content-length":"2048m"},"remote-address-header":"on"},"session":{"cookie":{"http-only":true,"name":"gearpump_token","path":"/","secure":false},"encrypt-data":true,"max-age":604800,"server-secret":"Please change this to a value only you know! At least 64 chars!!!"}},"io":{"tcp":{"windows-connection-abort-workaround-enabled":"off"}},"log-dead-letters":"off","log-dead-letters-during-shutdown":"off","loggers":["akka.event.slf4j.Slf4jLogger"],"logging-filter":"akka.event.slf4j.Slf4jLoggingFilter","loglevel":"INFO","remote":{"default-remote-dispatcher":{"executor":"fork-join-executor","throughput":5,"type":"Dispatcher"},"enabled-transports":["akka.remote.netty.tcp"],"log-remote-lifecycle-events":"off","netty":{"tcp":{"hostname":"127.0.0.1","maximum-frame-size":"2048000b","port":43675,"receive-buffer-size":"4096000b","send-buffer-size":"4096000b"}},"use-dispatcher":"akka.remote.default-remote-dispatcher"},"scheduler":{"tick-duration":1},"test":{"single-expect-default":"10s"}},"beamTestPipelineOptions":"[\"--runner=TestGearpumpRunner\",\"--streaming=true\"]","gearpump":{"application":{"executor-num":1,"total-retries":0},"appmaster":{"extraClasspath":"","vmargs":""},"cgroup":{"cpu-core-limit-per-executor":1,"root":"gearpump"},"cluster":{"masters":["127.0.0.1:43675"]},"executor":{"extraClasspath":"","vmargs":""},"home":"","hostname":"127.0.0.1","jarstore":{"rootpath":"jarstore/"},"log":{"application":{"dir":"logs"},"daemon":{"dir":"logs"}},"master-resource-manager-container-id":"","masterclient":{"timeout":90},"metrics":{"akka":{"max-limit-on-query":1000,"metrics-aggregator-class":{"org.apache.gearpump.streaming.metrics.ProcessorAggregator":"","org.apache.gearpump.streaming.metrics.TaskFilterAggregator":""}},"enabled":true,"graphite":{"host":"127.0.0.1","port":2003},"report-interval-ms":3000,"reporter":"akka","retainHistoryData":{"hours":72,"intervalMs":3600000},"retainRecentData":{"intervalMs":15000,"seconds":300},"sample-rate":1},"netty":{"base-sleep-ms":100,"buffer-size":5242880,"dispatcher":"gearpump.shared-thread-pool-dispatcher","flush-check-interval":5,"max-retries":30,"max-sleep-ms":1000,"message-batch-size":262144},"remote-debug-executor-jvm":false,"resource-allocation-timeout-seconds":120,"scheduling":{"scheduler-class":"org.apache.gearpump.cluster.scheduler.PriorityScheduler"},"serialization-framework":"org.apache.gearpump.serializer.FastKryoSerializationFramework","serializer":{"pool":"org.apache.gearpump.serializer.FastKryoSerializerPool"},"serializers":{"[B":"","[C":"","[D":"","[F":"","[I":"","[J":"","[Ljava.lang.String;":"","[S":"","[Z":"","akka.actor.LocalActorRef":"","scala.Array":"","scala.Tuple1":"","scala.Tuple2":"","scala.Tuple3":"","scala.Tuple4":"","scala.Tuple5":"","scala.Tuple6":"","scala.collection.immutable.$colon$colon":"","scala.collection.immutable.List":"","scala.collection.immutable.Vector":""},"services":{"config-render-option-concise":true,"host":"127.0.0.1","http":8090,"supervisor-actor-path":""},"shared-thread-pool-dispatcher":{"fork-join-executor":{"parallelism-factor":2,"parallelism-max":8,"parallelism-min":2},"mailbox-type":"akka.dispatch.SingleConsumerOnlyUnboundedMailbox","throughput":100},"single-thread-dispatcher":{"type":"PinnedDispatcher"},"start-executor-system-timeout-ms":120000,"streaming":{"ack-once-every-message-count":100,"max-pending-message-count-per-connection":1000,"register-task-timeout-ms":120000},"task-dispatcher":"gearpump.shared-thread-pool-dispatcher","transport":{"serializer":"org.apache.gearpump.streaming.task.StreamingTransportSerializer"},"ui-default-dispatcher":{"executor":"thread-pool-executor","thread-pool-executor":{"core-pool-size-factor":2,"core-pool-size-max":32,"core-pool-size-min":2},"throughput":1,"type":"Dispatcher"},"verbose-gc":false,"worker":{"executor-process-launcher":"org.apache.gearpump.cluster.worker.DefaultExecutorProcessLauncher","executor-share-same-jvm-as-worker":true,"slots":1000},"worker-resource-manager-container-id":"","yarn":{"applicationmaster":{"command":"$JAVA_HOME/bin/java -Xmx512m","memory":"512","queue":"default","vcores":"1"},"client":{"package-path":"/usr/lib/gearpump/gearpump.zip"},"master":{"command":"$JAVA_HOME/bin/java -Xmx512m","memory":"512","vcores":"1"},"services":{"enabled":true},"worker":{"command":"$JAVA_HOME/bin/java -Xmx512m","containers":"1","memory":"4096","vcores":"1"}}},"org":{"gradle":{"native":"false","test":{"worker":"1"}}}})))), Resources(ResourceRequest(Resource(5),WorkerId(-1,0),NORMAL,ANY,1)))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.scheduler.PriorityScheduler$$anonfun$resourceRequestHandler$1 applyOrElse
INFO: Request resource: appId: 1, slots: 5, relaxation: ANY, executor number: 1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.appmaster.ExecutorSystemLauncher$$anonfun$waitForLaunchCommand$1 applyOrElse
INFO: Launching Executor ...appId: 1, executorSystemId: 0, slots: 5 on worker WorkerInfo(WorkerId(0,1545168265809),Actor[akka://master/user/Worker0#611877606])
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.worker.Worker$$anonfun$appMasterMsgHandler$1 applyOrElse
INFO: LaunchExecutor(1,0,Resource(5),ExecutorJVMConfig([Ljava.lang.String;@584cbabd,[Ljava.lang.String;@17315e52,org.apache.gearpump.util.ActorSystemBooter,[Ljava.lang.String;@5e539260,Some(null),jenkins,Config(SimpleConfigObject({"akka":{"actor":{"default-dispatcher":{"fork-join-executor":{"parallelism-factor":2,"parallelism-max":4,"parallelism-min":4},"throughput":10},"default-mailbox":{"mailbox-type":"akka.dispatch.SingleConsumerOnlyUnboundedMailbox"},"kryo":{"buffer-size":4096,"classes":[],"compression":"off","idstrategy":"incremental","implicit-registration-logging":true,"kryo-reference-map":true,"kryo-trace":false,"max-buffer-size":-1,"serializer-pool-size":16,"type":"graph","use-manifests":false},"provider":"akka.cluster.ClusterActorRefProvider","warn-about-java-serializer-usage":false},"daemonic":"on","extensions":["org.apache.gearpump.transport.Express$","org.apache.gearpump.metrics.Metrics$"],"http":{"client":{"parsing":{"max-content-length":"2048m"}},"server":{"parsing":{"illegal-header-warnings":"off","max-content-length":"2048m"},"remote-address-header":"on"},"session":{"cookie":{"http-only":true,"name":"gearpump_token","path":"/","secure":false},"encrypt-data":true,"max-age":604800,"server-secret":"Please change this to a value only you know! At least 64 chars!!!"}},"io":{"tcp":{"windows-connection-abort-workaround-enabled":"off"}},"log-dead-letters":"off","log-dead-letters-during-shutdown":"off","loggers":["akka.event.slf4j.Slf4jLogger"],"logging-filter":"akka.event.slf4j.Slf4jLoggingFilter","loglevel":"INFO","remote":{"default-remote-dispatcher":{"executor":"fork-join-executor","throughput":5,"type":"Dispatcher"},"enabled-transports":["akka.remote.netty.tcp"],"log-remote-lifecycle-events":"off","netty":{"tcp":{"hostname":"127.0.0.1","maximum-frame-size":"2048000b","port":43675,"receive-buffer-size":"4096000b","send-buffer-size":"4096000b"}},"use-dispatcher":"akka.remote.default-remote-dispatcher"},"scheduler":{"tick-duration":1},"test":{"single-expect-default":"10s"}},"beamTestPipelineOptions":"[\"--runner=TestGearpumpRunner\",\"--streaming=true\"]","gearpump":{"application":{"executor-num":1,"total-retries":0},"appmaster":{"extraClasspath":"","vmargs":""},"cgroup":{"cpu-core-limit-per-executor":1,"root":"gearpump"},"cluster":{"masters":["127.0.0.1:43675"]},"executor":{"extraClasspath":"","vmargs":""},"home":"","hostname":"127.0.0.1","jarstore":{"rootpath":"jarstore/"},"log":{"application":{"dir":"logs"},"daemon":{"dir":"logs"}},"master-resource-manager-container-id":"","masterclient":{"timeout":90},"metrics":{"akka":{"max-limit-on-query":1000,"metrics-aggregator-class":{"org.apache.gearpump.streaming.metrics.ProcessorAggregator":"","org.apache.gearpump.streaming.metrics.TaskFilterAggregator":""}},"enabled":true,"graphite":{"host":"127.0.0.1","port":2003},"report-interval-ms":3000,"reporter":"akka","retainHistoryData":{"hours":72,"intervalMs":3600000},"retainRecentData":{"intervalMs":15000,"seconds":300},"sample-rate":1},"netty":{"base-sleep-ms":100,"buffer-size":5242880,"dispatcher":"gearpump.shared-thread-pool-dispatcher","flush-check-interval":5,"max-retries":30,"max-sleep-ms":1000,"message-batch-size":262144},"remote-debug-executor-jvm":false,"resource-allocation-timeout-seconds":120,"scheduling":{"scheduler-class":"org.apache.gearpump.cluster.scheduler.PriorityScheduler"},"serialization-framework":"org.apache.gearpump.serializer.FastKryoSerializationFramework","serializer":{"pool":"org.apache.gearpump.serializer.FastKryoSerializerPool"},"serializers":{"[B":"","[C":"","[D":"","[F":"","[I":"","[J":"","[Ljava.lang.String;":"","[S":"","[Z":"","akka.actor.LocalActorRef":"","scala.Array":"","scala.Tuple1":"","scala.Tuple2":"","scala.Tuple3":"","scala.Tuple4":"","scala.Tuple5":"","scala.Tuple6":"","scala.collection.immutable.$colon$colon":"","scala.collection.immutable.List":"","scala.collection.immutable.Vector":""},"services":{"config-render-option-concise":true,"host":"127.0.0.1","http":8090,"supervisor-actor-path":""},"shared-thread-pool-dispatcher":{"fork-join-executor":{"parallelism-factor":2,"parallelism-max":8,"parallelism-min":2},"mailbox-type":"akka.dispatch.SingleConsumerOnlyUnboundedMailbox","throughput":100},"single-thread-dispatcher":{"type":"PinnedDispatcher"},"start-executor-system-timeout-ms":120000,"streaming":{"ack-once-every-message-count":100,"max-pending-message-count-per-connection":1000,"register-task-timeout-ms":120000},"task-dispatcher":"gearpump.shared-thread-pool-dispatcher","transport":{"serializer":"org.apache.gearpump.streaming.task.StreamingTransportSerializer"},"ui-default-dispatcher":{"executor":"thread-pool-executor","thread-pool-executor":{"core-pool-size-factor":2,"core-pool-size-max":32,"core-pool-size-min":2},"throughput":1,"type":"Dispatcher"},"verbose-gc":false,"worker":{"executor-process-launcher":"org.apache.gearpump.cluster.worker.DefaultExecutorProcessLauncher","executor-share-same-jvm-as-worker":true,"slots":1000},"worker-resource-manager-container-id":"","yarn":{"applicationmaster":{"command":"$JAVA_HOME/bin/java -Xmx512m","memory":"512","queue":"default","vcores":"1"},"client":{"package-path":"/usr/lib/gearpump/gearpump.zip"},"master":{"command":"$JAVA_HOME/bin/java -Xmx512m","memory":"512","vcores":"1"},"services":{"enabled":true},"worker":{"command":"$JAVA_HOME/bin/java -Xmx512m","containers":"1","memory":"4096","vcores":"1"}}},"org":{"gradle":{"native":"false","test":{"worker":"1"}}}}))))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.scheduler.Scheduler$$anonfun$handleScheduleMessage$1 applyOrElse
INFO: ResourceUpdate(Actor[akka://master/user/Worker0#611877606],WorkerId(0,1545168265809),Resource(994))...
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.worker.Worker$$anonfun$appMasterMsgHandler$1 applyOrElse
INFO: Update resource succeed
Dec 18, 2018 9:24:26 PM org.apache.gearpump.util.ActorSystemBooter$Daemon <init>
INFO: RegisterActorSystem to akka.tcp://master@127.0.0.1:43675/user/Worker0/$c/$a/appdaemon1/$b/$a/$b, current user: not_defined
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.appmaster.ExecutorSystemLauncher$$anonfun$waitForActorSystemToStart$1 applyOrElse
INFO: Received RegisterActorSystem akka.tcp://master@127.0.0.1:43675 for session Actor[akka://master/user/Worker0/$c/$a/appdaemon1/$c/appmaster/executors#746388737]
Dec 18, 2018 9:24:26 PM org.apache.gearpump.cluster.appmaster.ExecutorSystemScheduler$$anonfun$executorSystemMessageHandler$1 applyOrElse
INFO: LaunchExecutorSystemSuccess, send back to Actor[akka://master/user/Worker0/$c/$a/appdaemon1/$c/appmaster/executors#746388737]
Dec 18, 2018 9:24:26 PM org.apache.gearpump.util.ActorSystemBooter$Daemon$$anonfun$waitCommand$1 applyOrElse
INFO: ActorSystem app1system0 Binding life cycle with actor: Actor[akka://master/user/Worker0/$c/$a/appdaemon1/$b/$a#861463907]
Dec 18, 2018 9:24:26 PM org.apache.gearpump.util.ActorSystemBooter$Daemon$$anonfun$waitCommand$1 applyOrElse
INFO: ActorSystem app1system0 Binding life cycle with actor: Actor[akka://master/user/Worker0/$c/$a/appdaemon1/$c/appmaster/executors/0#830773815]
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor <init>
INFO: Executor 0 has been started, start to register itself...
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor <init>
INFO: Executor actor path: akka.tcp://master@127.0.0.1:43675/user/Worker0/$c/$a/appdaemon1/$c/appmaster/executors/0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: executor 0 has been launched
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.JarScheduler$JarSchedulerImpl$$anonfun$ready$1 applyOrElse
INFO: ScheduleTask TaskId(4,0);TaskId(3,0);TaskId(2,0);TaskId(1,0);TaskId(0,0)
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1$$anonfun$applyOrElse$5 apply
INFO: Executor ExecutorStarted(0,Resource(5),WorkerId(0,1545168265809),Some(null)) has been started, start to schedule tasks: TaskId(4,0),TaskId(3,0),TaskId(2,0),TaskId(1,0),TaskId(0,0)
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.DagManager$$anonfun$dagService$1$$anonfun$applyOrElse$2 apply
INFO: Get task launcher data for processor: 0, dagVersion: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.metrics.MetricsReporterService getReporter
INFO: Metrics reporter is enabled, using akka reporter
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.DagManager$$anonfun$dagService$1$$anonfun$applyOrElse$2 apply
INFO: Get task launcher data for processor: 1, dagVersion: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.DagManager$$anonfun$dagService$1$$anonfun$applyOrElse$2 apply
INFO: Get task launcher data for processor: 2, dagVersion: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.DagManager$$anonfun$dagService$1$$anonfun$applyOrElse$2 apply
INFO: Get task launcher data for processor: 3, dagVersion: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.DagManager$$anonfun$dagService$1$$anonfun$applyOrElse$2 apply
INFO: Get task launcher data for processor: 4, dagVersion: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.metrics.AkkaReporter <init>
INFO: Start Metrics AkkaReporter
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: Start tasks on Executor(0), tasks: List(TaskId(0,0))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: Start tasks on Executor(0), tasks: List(TaskId(1,0))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: Unicast LaunchTasks to executor 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: Start tasks on Executor(0), tasks: List(TaskId(2,0))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: Unicast LaunchTasks to executor 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: Start tasks on Executor(0), tasks: List(TaskId(3,0))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: Unicast LaunchTasks to executor 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: Start tasks on Executor(0), tasks: List(TaskId(4,0))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: Unicast LaunchTasks to executor 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: Unicast LaunchTasks to executor 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor$$anonfun$applicationReady$1 applyOrElse
INFO: received LaunchTasks(List(TaskId(0,0)),0,ProcessorDescription(0,org.apache.gearpump.streaming.source.DataSourceTask,1,source.globalWindows.flatMap,org.apache.gearpump.cluster.UserConfig@5a6c0d72,LifeTime(-9223372036854775808,9223372036854775807),null),List(Subscriber(3,PartitionerDescription(org.apache.gearpump.streaming.partitioner.PartitionerObject@5d500d4a),1,LifeTime(-9223372036854775808,9223372036854775807)))), Executor transit to dag version: 0 from current version -1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor$$anonfun$dynamicDagPhase1$1 applyOrElse
INFO: Launching Task List(TaskId(1,0)) for app: 1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor$$anonfun$dynamicDagPhase1$1 applyOrElse
INFO: Launching Task List(TaskId(2,0)) for app: 1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.transport.Express registerLocalActor
INFO: RegisterLocalActor: 4294967296, actor: processor_1_task_0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.transport.Express init$lzycompute
INFO: Start Express init ...master
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor$$anonfun$dynamicDagPhase1$1 applyOrElse
INFO: Launching Task List(TaskId(3,0)) for app: 1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.transport.Express registerLocalActor
INFO: RegisterLocalActor: 12884901888, actor: processor_3_task_0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor$$anonfun$dynamicDagPhase1$1 applyOrElse
INFO: Launching Task List(TaskId(4,0)) for app: 1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.transport.Express registerLocalActor
INFO: RegisterLocalActor: 8589934592, actor: processor_2_task_0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.transport.Express init$lzycompute
INFO: binding to netty server HostPort(127.0.0.1,42925)
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor$$anonfun$dynamicDagPhase1$1 applyOrElse
INFO: Launching Task List(TaskId(0,0)) for app: 1
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.task.TaskActor preStart
INFO: RegisterTask(TaskId(1,0),0,HostPort(127.0.0.1,42925))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.task.TaskActor preStart
INFO: RegisterTask(TaskId(2,0),0,HostPort(127.0.0.1,42925))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.task.TaskActor preStart
INFO: RegisterTask(TaskId(3,0),0,HostPort(127.0.0.1,42925))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.transport.Express registerLocalActor
INFO: RegisterLocalActor: 0, actor: processor_0_task_0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: RegisterTask(TaskId(1,0)) TaskLocation: HostPort(127.0.0.1,42925), Executor: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.task.TaskActor preStart
INFO: RegisterTask(TaskId(0,0),0,HostPort(127.0.0.1,42925))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: RegisterTask(TaskId(2,0)) TaskLocation: HostPort(127.0.0.1,42925), Executor: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: RegisterTask(TaskId(3,0)) TaskLocation: HostPort(127.0.0.1,42925), Executor: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.transport.Express registerLocalActor
INFO: RegisterLocalActor: 17179869184, actor: processor_4_task_0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.task.TaskActor preStart
INFO: RegisterTask(TaskId(4,0),0,HostPort(127.0.0.1,42925))
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: RegisterTask(TaskId(0,0)) TaskLocation: HostPort(127.0.0.1,42925), Executor: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager$$anonfun$startDag$1 applyOrElse
INFO: RegisterTask(TaskId(4,0)) TaskLocation: HostPort(127.0.0.1,42925), Executor: 0
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.TaskManager org$apache$gearpump$streaming$appmaster$TaskManager$$broadcastLocations
INFO: All tasks have been launched; send Task locations to all executors
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.appmaster.ExecutorManager$$anonfun$service$1 applyOrElse
INFO: Broadcast TaskLocationsReady to all executors
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor$$anonfun$dynamicDagPhase1$1 applyOrElse
INFO: TaskLocations Ready...
Dec 18, 2018 9:24:26 PM org.apache.gearpump.streaming.executor.Executor dynamicDagPhase2
INFO: Transit to dynamic Dag Phase2
Uncaught error from thread [master-akka.actor.default-dispatcher-4] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[master]
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:717)
at java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:957)
at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1378)
at org.jboss.netty.util.internal.DeadLockProofWorker.start(DeadLockProofWorker.java:38)
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.openSelector(AbstractNioSelector.java:349)
at org.jboss.netty.channel.socket.nio.AbstractNioSelector.<init>(AbstractNioSelector.java:100)
at org.jboss.netty.channel.socket.nio.NioClientBoss.<init>(NioClientBoss.java:63)
at org.jboss.netty.channel.socket.nio.NioClientBossPool.newBoss(NioClientBossPool.java:61)
at org.jboss.netty.channel.socket.nio.NioClientBossPool.newBoss(NioClientBossPool.java:27)
at org.jboss.netty.channel.socket.nio.AbstractNioBossPool.init(AbstractNioBossPool.java:75)
at org.jboss.netty.channel.socket.nio.NioClientBossPool.<init>(NioClientBossPool.java:45)
at org.jboss.netty.channel.socket.nio.NioClientBossPool.<init>(NioClientBossPool.java:55)
at org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory.<init>(NioClientSocketChannelFactory.java:167)
at org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory.<init>(NioClientSocketChannelFactory.java:151)
at org.jboss.netty.channel.socket.nio.NioClientSocketChannelFactory.<init>(NioClientSocketChannelFactory.java:133)
at org.apache.gearpump.transport.netty.Context.clientChannelFactory$lzycompute(Context.scala:55)
at org.apache.gearpump.transport.netty.Context.clientChannelFactory(Context.scala:51)
at org.apache.gearpump.transport.netty.Context.connect(Context.scala:89)
at org.apache.gearpump.transport.Express$$anonfun$startClients$2$$anonfun$apply$1.apply(Express.scala:82)
at org.apache.gearpump.transport.Express$$anonfun$startClients$2$$anonfun$apply$1.apply(Express.scala:80)
at scala.concurrent.stm.ccstm.NonTxn$.transformAndGetImpl(NonTxn.scala:408)
at scala.concurrent.stm.ccstm.NonTxn$.transformAndGet(NonTxn.scala:404)
at scala.concurrent.stm.ccstm.ViewOps$class.transformAndGet(ViewOps.scala:62)
at scala.concurrent.stm.ccstm.CCSTMRefs$BaseRef.transformAndGet(CCSTMRefs.scala:42)
at akka.agent.Agent$SecretAgent$$anonfun$alter$2.apply(Agent.scala:43)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at akka.util.SerializedSuspendableExecutionContext.run$1(SerializedSuspendableExecutionContext.scala:67)
at akka.util.SerializedSuspendableExecutionContext.run(SerializedSuspendableExecutionContext.scala:71)
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
org.apache.beam.sdk.transforms.FlattenTest > testFlattenIterablesLists SKIPPED
> Task :beam-runners-gearpump:validatesRunnerStreaming FAILED
:beam-runners-gearpump:validatesRunnerStreaming (Thread[Task worker for ':' Thread 3,5,main]) completed. Took 14 mins 46.619 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-gearpump:validatesRunnerStreaming'.
> Process 'Gradle Test Executor 1' finished with non-zero exit value 255
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the user guide at https://docs.gradle.org/4.10.2/userguide/java_plugin.html#sec:test_execution
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 16m 14s
36 actionable tasks: 32 executed, 4 from cache
Publishing build scan...
https://gradle.com/s/n6gihnd3hclkq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PostCommit_Java_ValidatesRunner_Gearpump #1676
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/1676/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org