You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/07/15 18:28:12 UTC

Build failed in Jenkins: beam_PostCommit_PortableJar_Flink #3846

See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3846/display/redirect>

Changes:


------------------------------------------
[...truncated 163.56 KB...]
INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.32.0.dev" for Docker environment
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7f07e1665b70> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f07e1665bf8> ====================
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7f07e1667378> ====================
INFO:apache_beam.runners.portability.flink_runner:Adding HTTP protocol scheme to flink_master parameter: http://localhost:40011
Jul 15, 2021 6:28:05 PM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1 applyOrElse
INFO: Slf4jLogger started
Jul 15, 2021 6:28:05 PM org.apache.flink.runtime.clusterframework.BootstrapTools startActorSystem
INFO: Actor system started at akka://flink
Jul 15, 2021 6:28:05 PM org.apache.flink.runtime.clusterframework.BootstrapTools startLocalActorSystem
INFO: Trying to start local actor system
Jul 15, 2021 6:28:06 PM akka.event.slf4j.Slf4jLogger$$anonfun$receive$1 applyOrElse
INFO: Slf4jLogger started
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.clusterframework.BootstrapTools startActorSystem
INFO: Actor system started at akka://flink-metrics
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO: Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.minicluster.MiniCluster createHighAvailabilityServices
INFO: Starting high-availability services
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.BlobServer <init>
INFO: Created BLOB server storage directory /tmp/blobStore-ce693db3-e177-489a-8802-181fd03c262b
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.BlobServer <init>
INFO: Started BLOB server at 0.0.0.0:42061 - max concurrent requests: 50 - max backlog: 1000
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.AbstractBlobCache <init>
INFO: Created BLOB cache storage directory /tmp/blobStore-338c8100-a299-400a-b602-dc1afc9339e3
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.blob.AbstractBlobCache <init>
INFO: Created BLOB cache storage directory /tmp/blobStore-778f36bb-aaa1-458b-89ee-6440148e9100
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.minicluster.MiniCluster startTaskManagers
INFO: Starting 1 TaskManger(s)
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.taskexecutor.TaskManagerRunner startTaskManager
INFO: Starting TaskManager with ResourceID: 856d555c-0c3a-4da5-b81c-ddd2669f92c7
INFO:apache_beam.runners.portability.abstract_job_service:Artifact server started on port 46823
INFO:apache_beam.runners.portability.abstract_job_service:Running job 'job-24198948-0bdb-4326-ac29-986a9d26a1f1'
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.taskexecutor.TaskManagerServices checkTempDirs
INFO: Temporary file directory '/tmp': total 484 GB, usable 121 GB (25.00% usable)
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl createFiles
INFO: FileChannelManager uses directory /tmp/flink-io-9f1241ee-3784-4d7a-9fb9-d39bee55d8c3 for spill files.
Jul 15, 2021 6:28:06 PM org.apache.flink.runtime.io.disk.FileChannelManagerImpl createFiles
INFO: FileChannelManager uses directory /tmp/flink-netty-shuffle-b3cc1eae-57aa-4741-b1dc-308124edc81b for spill files.
Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.io.network.buffer.NetworkBufferPool <init>
INFO: Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768).
Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.io.network.NettyShuffleEnvironment start
INFO: Starting the network environment and its components.
Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.taskexecutor.KvStateService start
INFO: Starting the kvState service and its components.
Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.rpc.akka.AkkaRpcService startServer
INFO: Starting RPC endpoint for org.apache.flink.runtime.taskexecutor.TaskExecutor at akka://flink/user/rpc/taskmanager_0 .
Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService start
INFO: Start job leader service.
Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.filecache.FileCache <init>
INFO: User file cache uses directory /tmp/flink-dist-cache-ebf25a32-9272-4b96-92a1-277524509d56
Jul 15, 2021 6:28:07 PM org.apache.flink.configuration.Configuration loggingFallback
INFO: Config uses fallback configuration key 'rest.port' instead of key 'rest.bind-port'
Jul 15, 2021 6:28:07 PM org.apache.flink.runtime.rest.RestServerEndpoint start
INFO: Starting rest endpoint.
Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py",> line 170, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/util/connection.py",> line 96, in create_connection
    raise err
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/util/connection.py",> line 86, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connectionpool.py",> line 706, in urlopen
    chunked=chunked,
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connectionpool.py",> line 394, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py",> line 234, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/usr/lib/python3.6/http/client.py", line 1239, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1285, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1234, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.6/http/client.py", line 1026, in _send_output
    self.send(msg)
  File "/usr/lib/python3.6/http/client.py", line 964, in send
    self.connect()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py",> line 200, in connect
    conn = self._new_conn()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connection.py",> line 182, in _new_conn
    self, "Failed to establish a new connection: %s" % e
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f07e0a95630>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/adapters.py",> line 449, in send
    timeout=timeout
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/connectionpool.py",> line 756, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/urllib3/util/retry.py",> line 574, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=40011): Max retries exceeded with url: /v1/jars/upload (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07e0a95630>: Failed to establish a new connection: [Errno 111] Connection refused',))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<string>", line 31, in <module>
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/pipeline.py",> line 564, in run
    return self.runner.run_pipeline(self, self._options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner.py",> line 45, in run_pipeline
    return super(FlinkRunner, self).run_pipeline(pipeline, options)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 440, in run_pipeline
    job_service_handle.submit(proto_pipeline)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 115, in submit
    return self.run(prepare_response.preparation_id)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 242, in run
    beam_job_api_pb2.RunJobRequest(preparation_id=preparation_id))
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/abstract_job_service.py",> line 120, in Run
    self._jobs[job_id].run()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 150, in run
    files={'jarfile': ('beam.jar', jar_file)})['filename'].split('/')[-1]
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 138, in post
    return self.request(requests.post, path, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py",> line 126, in request
    response = method(url, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/api.py",> line 117, in post
    return request('post', url, data=data, json=json, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/api.py",> line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/sessions.py",> line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/sessions.py",> line 655, in send
    r = adapter.send(request, **kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/requests/adapters.py",> line 516, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=40011): Max retries exceeded with url: /v1/jars/upload (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f07e0a95630>: Failed to establish a new connection: [Errno 111] Connection refused',))
Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
WARNING: Log file environment variable 'log.file' is not set.
Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.webmonitor.WebMonitorUtils$LogFileLocation find
WARNING: JobManager log files are unavailable in the web dashboard. Log file location not found in environment variable 'log.file' or configuration key 'web.log.path'.

kill %1 || echo "Failed to shut down Flink mini cluster"

rm -rf "$ENV_DIR"
Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Jul 15, 2021 6:28:08 PM org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.

if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
  echo ">>> SUCCESS"
else
  echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE

> Task :sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession FAILED

FAILURE: Build completed with 6 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 213

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testJavaJarCreatorFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

4: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

5: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py37:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

6: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 241

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:testUberJarFlinkRunnerSaveMainSession'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 27m 38s
154 actionable tasks: 111 executed, 40 from cache, 3 up-to-date

Publishing build scan...
https://gradle.com/s/nfikqtiqwixm4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_PortableJar_Flink #3847

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_PortableJar_Flink/3847/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org