You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/09/01 06:26:52 UTC

Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4036

See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4036/display/redirect?page=changes>

Changes:

[noreply] Add per-batch metrics to JdbcIO.write (#15429)


------------------------------------------
[...truncated 931.02 KB...]
	at com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)
	at org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)
	... 32 more

Sep 01, 2021 6:26:31 AM org.apache.flink.runtime.rest.handler.AbstractHandler handleException
SEVERE: Exception occurred in REST handler: Could not execute application.
Traceback (most recent call last):
  File "<string>", line 31, in <module>
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py",> line 565, in run
    return self.runner.run_pipeline(self, self._options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py",> line 45, in run_pipeline
    return super(FlinkRunner, self).run_pipeline(pipeline, options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 440, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 115, in submit
    return self.run(prepare_response.preparation_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 242, in run
    beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py",> line 120, in Run
    self._jobs[job_id].run()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 155, in run
    'entryClass': 'org.apache.beam.runners.flink.FlinkPipelineRunner'
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 138, in post
    return self.request(requests.post, path, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 130, in request
    (url, response.status_code, response.text))
RuntimeError: Request to http://localhost:38149/v1/jars/9a2e8364-bfb8-457d-ba17-910fce07ebcf_beam.jar/run failed with status 400: {"errors":["org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application.\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:108)\n\tat java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836)\n\tat java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)\n\tat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: java.util.concurrent.CompletionException: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)\n\tat java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)\n\t... 7 more\nCaused by: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:88)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:102)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)\n\t... 7 more\nCaused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)\n\tat org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)\n\tat org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)\n\t... 10 more\nCaused by: java.lang.IllegalArgumentException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)\n\tat org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)\n\tat org.apache.beam.runners.flink.FlinkPipelineRunner.main(FlinkPipelineRunner.java:194)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)\n\t... 13 more\nCaused by: com.fasterxml.jackson.databind.JsonMappingException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)\n\tat com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)\n\t... 20 more\nCaused by: org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)\n\tat com.sun.proxy.$Proxy41.populateDisplayData(Unknown Source)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)\n\tat org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)\n\t... 23 more\nCaused by: java.lang.NullPointerException\n\tat com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)\n\tat org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\t... 32 more\n"]}

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
>>> FAILURE

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession FAILED

> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession
Sep 01, 2021 6:26:29 AM org.apache.flink.client.ClientUtils executeProgram
INFO: Starting program (detached: true)
Sep 01, 2021 6:26:36 AM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Sep 01, 2021 6:26:41 AM org.apache.flink.client.deployment.application.DetachedApplicationRunner tryExecuteJobs
WARNING: Could not execute application: 
org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
	at org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)
	at org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)
	at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:102)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)
	at org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)
	at org.apache.beam.runners.flink.FlinkPipelineRunner.main(FlinkPipelineRunner.java:194)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
	... 13 more
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)
	at com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)
	at com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)
	... 20 more
Caused by: org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)
	at com.sun.proxy.$Proxy41.populateDisplayData(Unknown Source)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)
	at org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)
	... 23 more
Caused by: java.lang.NullPointerException
	at com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)
	at com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)
	at com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)
	at org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)
	... 32 more

Sep 01, 2021 6:26:41 AM org.apache.flink.runtime.rest.handler.AbstractHandler handleException
SEVERE: Exception occurred in REST handler: Could not execute application.
Traceback (most recent call last):
  File "<string>", line 31, in <module>
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py",> line 565, in run
    return self.runner.run_pipeline(self, self._options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py",> line 45, in run_pipeline
    return super(FlinkRunner, self).run_pipeline(pipeline, options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 440, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 115, in submit
    return self.run(prepare_response.preparation_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 242, in run
    beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py",> line 120, in Run
    self._jobs[job_id].run()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 155, in run
    'entryClass': 'org.apache.beam.runners.flink.FlinkPipelineRunner'
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 138, in post
    return self.request(requests.post, path, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 130, in request
    (url, response.status_code, response.text))
RuntimeError: Request to http://localhost:46865/v1/jars/69a2b9c5-ca99-4b58-97aa-cac9ef7a801d_beam.jar/run failed with status 400: {"errors":["org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application.\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:108)\n\tat java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836)\n\tat java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)\n\tat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: java.util.concurrent.CompletionException: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)\n\tat java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)\n\t... 7 more\nCaused by: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:88)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:102)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)\n\t... 7 more\nCaused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)\n\tat org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)\n\tat org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)\n\t... 10 more\nCaused by: java.lang.IllegalArgumentException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)\n\tat org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)\n\tat org.apache.beam.runners.flink.FlinkPipelineRunner.main(FlinkPipelineRunner.java:194)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)\n\t... 13 more\nCaused by: com.fasterxml.jackson.databind.JsonMappingException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)\n\tat com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)\n\t... 20 more\nCaused by: org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)\n\tat com.sun.proxy.$Proxy41.populateDisplayData(Unknown Source)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)\n\tat org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)\n\t... 23 more\nCaused by: java.lang.NullPointerException\n\tat com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)\n\tat org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\t... 32 more\n"]}

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
Sep 01, 2021 6:26:43 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Sep 01, 2021 6:26:43 AM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession FAILED

FAILURE: Build completed with 6 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

5: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

6: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 26m 10s
150 actionable tasks: 109 executed, 38 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/zkpqsop7ui6p6

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_PortableJar_Flink #4039

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4039/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4038

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4038/display/redirect?page=changes>

Changes:

[baeminbo] Fix apiclient_test unittest not to fail with no credentials

[noreply] [BEAM-10913] - Adding new Grafana dashboard to monitor GAs post-commit


------------------------------------------
[...truncated 931.02 KB...]
Sep 01, 2021 6:20:08 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
WARNING: JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
Sep 01, 2021 6:20:08 PM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO: Rest endpoint listening at 127.0.0.1:59567
Sep 01, 2021 6:20:08 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO: Proposing leadership to contender http://127.0.0.1:59567
Sep 01, 2021 6:20:08 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint startInternal
INFO: Web frontend listening at http://127.0.0.1:59567.
Sep 01, 2021 6:20:08 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint grantLeadership
INFO: http://127.0.0.1:59567 was granted leadership with leaderSessionID=4c6aaa18-c71a-4d9c-a8d2-9e401c0cff9b
Sep 01, 2021 6:20:08 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO: Received confirmation of leadership for leader http://127.0.0.1:59567 , session=4c6aaa18-c71a-4d9c-a8d2-9e401c0cff9b
Sep 01, 2021 6:20:08 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO: Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/rpc/resourcemanager_1 .
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO: Proposing leadership to contender LeaderContender: DefaultDispatcherRunner
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager onStart
INFO: Starting the resource manager.
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO: Proposing leadership to contender LeaderContender: StandaloneResourceManager
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess startInternal
INFO: Start SessionDispatcherLeaderProcess.
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager tryAcceptLeadership
INFO: ResourceManager akka://flink/user/rpc/resourcemanager_1 was granted leadership with fencing token 822893a84a485d877bc1a47556ae4b7c
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess recoverJobs
INFO: Recover all persisted job graphs.
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess recoverJobs
INFO: Successfully recovered 0 persisted job graphs.
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO: Received confirmation of leadership for leader akka://flink/user/rpc/resourcemanager_1 , session=7bc1a475-56ae-4b7c-8228-93a84a485d87
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.minicluster.MiniCluster start
INFO: Flink Mini Cluster started successfully
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO: Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_2 .
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO: Received confirmation of leadership for leader akka://flink/user/rpc/dispatcher_2 , session=cf56f1e2-aa9f-458d-8079-ecbff0243d6f
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutor connectToResourceManager
INFO: Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(822893a84a485d877bc1a47556ae4b7c).
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.registration.RetryingRegistration lambda$startRegistration$0
INFO: Resolved ResourceManager address, beginning registration
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager registerTaskExecutorInternal
INFO: Registering TaskManager with ResourceID e7d3ce67-74cd-4747-b63e-07b8c0d5114f (akka://flink/user/rpc/taskmanager_0) at ResourceManager
Sep 01, 2021 6:20:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutorToResourceManagerConnection onRegistrationSuccess
INFO: Successful registration at resource manager akka://flink/user/rpc/resourcemanager_1 under registration id 0105194ceb6ab246b90a8921b6a06a41.
INFO:apache_beam.runners.portability.abstract_job_service:Artifact server started on port 40385
INFO:apache_beam.runners.portability.abstract_job_service:Running job 'job-4b61cad4-7807-4385-89ec-1bdcfb1dea66'
Sep 01, 2021 6:20:17 PM org.apache.flink.runtime.rest.handler.util.HandlerRequestUtils fromRequestBodyOrQueryParameter
WARNING: Configuring the job submission via query parameters is deprecated. Please migrate to submitting a JSON request instead.
Sep 01, 2021 6:20:18 PM org.apache.flink.client.ClientUtils executeProgram
INFO: Starting program (detached: true)
Sep 01, 2021 6:20:19 PM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Sep 01, 2021 6:20:20 PM org.apache.flink.client.deployment.application.DetachedApplicationRunner tryExecuteJobs
WARNING: Could not execute application: 
org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
	at org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)
	at org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)
	at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:102)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)
	at org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)
	at org.apache.beam.runners.flink.FlinkPipelineRunner.main(FlinkPipelineRunner.java:194)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
	... 13 more
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)
	at com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)
	at com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)
	... 20 more
Caused by: org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)
	at com.sun.proxy.$Proxy41.populateDisplayData(Unknown Source)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)
	at org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)
	... 23 more
Caused by: java.lang.NullPointerException
	at com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)
	at com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)
	at com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)
	at org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)
	... 32 more

Sep 01, 2021 6:20:20 PM org.apache.flink.runtime.rest.handler.AbstractHandler handleException
SEVERE: Exception occurred in REST handler: Could not execute application.
Traceback (most recent call last):
  File "<string>", line 31, in <module>
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py",> line 565, in run
    return self.runner.run_pipeline(self, self._options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py",> line 45, in run_pipeline
    return super(FlinkRunner, self).run_pipeline(pipeline, options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 440, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 115, in submit
    return self.run(prepare_response.preparation_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 242, in run
    beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py",> line 120, in Run
    self._jobs[job_id].run()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 155, in run
    'entryClass': 'org.apache.beam.runners.flink.FlinkPipelineRunner'
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 138, in post
    return self.request(requests.post, path, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 130, in request
    (url, response.status_code, response.text))
RuntimeError: Request to http://localhost:59567/v1/jars/f2703449-c999-4cdc-8c9f-bc9094d08302_beam.jar/run failed with status 400: {"errors":["org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application.\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:108)\n\tat java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836)\n\tat java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)\n\tat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: java.util.concurrent.CompletionException: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)\n\tat java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)\n\t... 7 more\nCaused by: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:88)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:102)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)\n\t... 7 more\nCaused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)\n\tat org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)\n\tat org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)\n\t... 10 more\nCaused by: java.lang.IllegalArgumentException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)\n\tat org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)\n\tat org.apache.beam.runners.flink.FlinkPipelineRunner.main(FlinkPipelineRunner.java:194)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)\n\t... 13 more\nCaused by: com.fasterxml.jackson.databind.JsonMappingException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)\n\tat com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)\n\t... 20 more\nCaused by: org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)\n\tat com.sun.proxy.$Proxy41.populateDisplayData(Unknown Source)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)\n\tat org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)\n\t... 23 more\nCaused by: java.lang.NullPointerException\n\tat com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)\n\tat org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\t... 32 more\n"]}

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
Sep 01, 2021 6:20:21 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Sep 01, 2021 6:20:21 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Sep 01, 2021 6:20:21 PM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory /tmp/flink-dist-cache-3407a442-a44e-4944-8c9f-30ce51013d8b

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession FAILED

FAILURE: Build completed with 6 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

5: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

6: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 19m 49s
150 actionable tasks: 106 executed, 41 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/pmpe67z76p24e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #4037

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/4037/display/redirect>

Changes:


------------------------------------------
[...truncated 216.13 KB...]
WARNING: JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO: Rest endpoint listening at 127.0.0.1:34067
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO: Proposing leadership to contender http://127.0.0.1:34067
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint startInternal
INFO: Web frontend listening at http://127.0.0.1:34067.
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint grantLeadership
INFO: http://127.0.0.1:34067 was granted leadership with leaderSessionID=cd525aae-3af8-402b-b857-5980bdca3bec
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO: Received confirmation of leadership for leader http://127.0.0.1:34067 , session=cd525aae-3af8-402b-b857-5980bdca3bec
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO: Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/rpc/resourcemanager_1 .
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO: Proposing leadership to contender LeaderContender: DefaultDispatcherRunner
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager onStart
INFO: Starting the resource manager.
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService updateLeader
INFO: Proposing leadership to contender LeaderContender: StandaloneResourceManager
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager tryAcceptLeadership
INFO: ResourceManager akka://flink/user/rpc/resourcemanager_1 was granted leadership with fencing token ba22f7b3126ad84f5f5894fe0511479d
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.minicluster.MiniCluster start
INFO: Flink Mini Cluster started successfully
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess startInternal
INFO: Start SessionDispatcherLeaderProcess.
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess recoverJobs
INFO: Recover all persisted job graphs.
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess recoverJobs
INFO: Successfully recovered 0 persisted job graphs.
Started Flink mini cluster (1 TaskManagers with 1 task slots) with Rest API at java.util.concurrent.CompletableFuture@1144a55a[Completed normally]
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO: Received confirmation of leadership for leader akka://flink/user/rpc/resourcemanager_1 , session=5f5894fe-0511-479d-ba22-f7b3126ad84f
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutor connectToResourceManager
INFO: Connecting to ResourceManager akka://flink/user/rpc/resourcemanager_1(ba22f7b3126ad84f5f5894fe0511479d).
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO: Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_2 .
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService confirmLeader
INFO: Received confirmation of leadership for leader akka://flink/user/rpc/dispatcher_2 , session=bcd1378b-65d8-4163-8bf6-8a9886d9135b
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.registration.RetryingRegistration lambda$startRegistration$0
INFO: Resolved ResourceManager address, beginning registration
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.resourcemanager.ResourceManager registerTaskExecutorInternal
INFO: Registering TaskManager with ResourceID 1d8f0f65-8f1a-4a05-ab5f-4b634a025672 (akka://flink/user/rpc/taskmanager_0) at ResourceManager
Sep 01, 2021 12:15:09 PM org.apache.flink.runtime.taskexecutor.TaskExecutorToResourceManagerConnection onRegistrationSuccess
INFO: Successful registration at resource manager akka://flink/user/rpc/resourcemanager_1 under registration id 8aedbfd4b55e9ab20b2efbde25dc2ef3.
INFO:apache_beam.runners.portability.abstract_job_service:Artifact server started on port 38079
INFO:apache_beam.runners.portability.abstract_job_service:Running job 'job-37b5cc2f-6165-46ed-8602-274b3aed5cc2'
Sep 01, 2021 12:15:16 PM org.apache.flink.runtime.rest.handler.util.HandlerRequestUtils fromRequestBodyOrQueryParameter
WARNING: Configuring the job submission via query parameters is deprecated. Please migrate to submitting a JSON request instead.
Sep 01, 2021 12:15:16 PM org.apache.flink.client.ClientUtils executeProgram
INFO: Starting program (detached: true)
Sep 01, 2021 12:15:17 PM org.apache.beam.sdk.io.aws2.s3.DefaultS3ClientBuilderFactory createBuilder
INFO: The AWS S3 Beam extension was included in this build, but the awsRegion flag was not specified. If you don't plan to use S3, then ignore this message.
Sep 01, 2021 12:15:18 PM org.apache.flink.client.deployment.application.DetachedApplicationRunner tryExecuteJobs
WARNING: Could not execute application: 
org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
	at org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)
	at org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)
	at org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:102)
	at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalArgumentException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)
	at org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)
	at org.apache.beam.runners.flink.FlinkPipelineRunner.main(FlinkPipelineRunner.java:194)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
	... 13 more
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)
	at com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)
	at com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)
	... 20 more
Caused by: org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)
	at com.sun.proxy.$Proxy41.populateDisplayData(Unknown Source)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)
	at org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)
	at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)
	... 23 more
Caused by: java.lang.NullPointerException
	at com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)
	at com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)
	at com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)
	at com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)
	at org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)
	at org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)
	at org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)
	at org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)
	... 32 more

Sep 01, 2021 12:15:18 PM org.apache.flink.runtime.rest.handler.AbstractHandler handleException
SEVERE: Exception occurred in REST handler: Could not execute application.
Traceback (most recent call last):
  File "<string>", line 31, in <module>
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py",> line 565, in run
    return self.runner.run_pipeline(self, self._options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py",> line 45, in run_pipeline
    return super(FlinkRunner, self).run_pipeline(pipeline, options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 440, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 115, in submit
    return self.run(prepare_response.preparation_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 242, in run
    beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py",> line 120, in Run
    self._jobs[job_id].run()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 155, in run
    'entryClass': 'org.apache.beam.runners.flink.FlinkPipelineRunner'
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 138, in post
    return self.request(requests.post, path, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 130, in request
    (url, response.status_code, response.text))
RuntimeError: Request to http://localhost:34067/v1/jars/c5b762b6-79cf-45e5-8c3f-43baf8551760_beam.jar/run failed with status 400: {"errors":["org.apache.flink.runtime.rest.handler.RestHandlerException: Could not execute application.\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$1(JarRunHandler.java:108)\n\tat java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836)\n\tat java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811)\n\tat java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\n\tat java.lang.Thread.run(Thread.java:748)\nCaused by: java.util.concurrent.CompletionException: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)\n\tat java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1606)\n\t... 7 more\nCaused by: org.apache.flink.util.FlinkRuntimeException: Could not execute application.\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:88)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.run(DetachedApplicationRunner.java:70)\n\tat org.apache.flink.runtime.webmonitor.handlers.JarRunHandler.lambda$handleRequest$0(JarRunHandler.java:102)\n\tat java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1604)\n\t... 7 more\nCaused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)\n\tat org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)\n\tat org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)\n\tat org.apache.flink.client.deployment.application.DetachedApplicationRunner.tryExecuteJobs(DetachedApplicationRunner.java:84)\n\t... 10 more\nCaused by: java.lang.IllegalArgumentException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3312)\n\tat org.apache.beam.runners.core.construction.PipelineOptionsTranslation.toProto(PipelineOptionsTranslation.java:52)\n\tat org.apache.beam.runners.flink.FlinkPipelineRunner.main(FlinkPipelineRunner.java:194)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:498)\n\tat org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)\n\t... 13 more\nCaused by: com.fasterxml.jackson.databind.JsonMappingException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._wrapAsIOE(DefaultSerializerProvider.java:509)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:482)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:319)\n\tat com.fasterxml.jackson.databind.ObjectMapper.writeValue(ObjectMapper.java:3126)\n\tat com.fasterxml.jackson.databind.ObjectMapper.valueToTree(ObjectMapper.java:3307)\n\t... 20 more\nCaused by: org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder$PopulateDisplayDataException: Error while populating display data for component 'org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData': null\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:784)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.delegate(DisplayData.java:740)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:157)\n\tat com.sun.proxy.$Proxy41.populateDisplayData(Unknown Source)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.access$100(DisplayData.java:703)\n\tat org.apache.beam.sdk.transforms.display.DisplayData.from(DisplayData.java:81)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:706)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$Serializer.serialize(ProxyInvocationHandler.java:654)\n\tat com.fasterxml.jackson.databind.ser.DefaultSerializerProvider._serialize(DefaultSerializerProvider.java:480)\n\t... 23 more\nCaused by: java.lang.NullPointerException\n\tat com.fasterxml.jackson.databind.DeserializationContext.isEnabled(DeserializationContext.java:395)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._checkFromStringCoercion(StdDeserializer.java:1364)\n\tat com.fasterxml.jackson.databind.deser.std.StdDeserializer._parseIntPrimitive(StdDeserializer.java:728)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:529)\n\tat com.fasterxml.jackson.databind.deser.std.NumberDeserializers$IntegerDeserializer.deserialize(NumberDeserializers.java:506)\n\tat org.apache.beam.sdk.options.PipelineOptionsFactory.deserializeNode(PipelineOptionsFactory.java:1791)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:517)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.getValueFromJson(ProxyInvocationHandler.java:512)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler.access$400(ProxyInvocationHandler.java:93)\n\tat org.apache.beam.sdk.options.ProxyInvocationHandler$PipelineOptionsDisplayData.populateDisplayData(ProxyInvocationHandler.java:359)\n\tat org.apache.beam.sdk.transforms.display.DisplayData$InternalBuilder.include(DisplayData.java:775)\n\t... 32 more\n"]}

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
Sep 01, 2021 12:15:18 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Sep 01, 2021 12:15:18 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Sep 01, 2021 12:15:18 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession FAILED

FAILURE: Build completed with 6 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 238

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

5: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

6: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 266

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 14m 51s
150 actionable tasks: 106 executed, 41 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/jcir3bud57xyk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org