You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/06/02 18:08:43 UTC
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3791
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3791/display/redirect?page=changes>
Changes:
[noreply] [BEAM-14539] Ensure that the print stream can handle larger byte arrays
[noreply] [BEAM-10976] Fix bug with bundle finalization on SDFs (and a small doc
[noreply] Bump google.golang.org/grpc from 1.46.2 to 1.47.0 in /sdks (#17806)
------------------------------------------
[...truncated 500.99 KB...]
[0mRemoving intermediate container 93c9b07e81d9
---> 473a3e1a7cb9
Step 14/31 : RUN pip check || (echo "Container does not include required Beam dependencies or has conflicting dependencies. If Beam dependencies have changed, you need to regenerate base_image_requirements.txt files. See: https://s.apache.org/beam-python-requirements-generate" && exit 1)
---> Running in cd66ca37026c
No broken requirements found.
Removing intermediate container cd66ca37026c
---> 729736bc336d
Step 15/31 : RUN pip freeze --all
---> Running in e962126f5e70
absl-py==1.0.0
apache-beam @ file:///opt/apache/beam/tars/apache-beam.tar.gz
astunparse==1.6.3
atomicwrites==1.4.0
attrs==21.4.0
beautifulsoup4==4.11.1
bs4==0.0.1
cached-property==1.5.2
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.1.3
cloudpickle==2.0.0
crcmod==1.7
cryptography==37.0.2
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.11
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.1
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.47.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.3
google-cloud-bigquery-storage==2.13.1
google-cloud-bigtable==1.7.1
google-cloud-core==1.7.2
google-cloud-datastore==1.15.4
google-cloud-dlp==3.6.2
google-cloud-language==1.3.1
google-cloud-profiler==3.0.8
google-cloud-pubsub==2.12.0
google-cloud-pubsublite==1.4.2
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.2
google-cloud-videointelligence==1.16.2
google-cloud-vision==1.0.1
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.2
googleapis-common-protos==1.56.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.4
grpcio==1.46.0
grpcio-gcp==0.2.2
grpcio-status==1.46.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.7.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.3
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==14.0.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
nltk==3.7
nose==1.3.7
numpy==1.21.6
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.8
overrides==6.1.0
packaging==21.3
pandas==1.3.5
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.20.1
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==7.0.0
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2022.1
PyYAML==6.0
regex==2022.4.24
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.7.3
setuptools==57.5.0
six==1.16.0
soupsieve==2.3.2.post1
SQLAlchemy==1.4.36
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.25.0
termcolor==1.1.0
testcontainers==3.5.3
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.64.0
typing-utils==0.1.0
typing_extensions==4.2.0
uritemplate==4.1.1
urllib3==1.26.9
wcwidth==0.2.5
websocket-client==1.3.2
Werkzeug==2.1.2
wheel==0.37.1
wrapt==1.14.1
zipp==3.8.0
Removing intermediate container e962126f5e70
---> 1356c5fbff82
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
---> a52854812e38
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
---> 82bf4b164e6b
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
---> 6f5085b27770
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
---> 66ec63ecf518
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
---> Running in 0cd60624a33f
Removing intermediate container 0cd60624a33f
---> 050af8acfd6c
Step 21/31 : FROM beam as third_party_licenses
---> 050af8acfd6c
Step 22/31 : ARG pull_licenses
---> Running in 8faf966b62d9
Removing intermediate container 8faf966b62d9
---> 61b77cb7f8ee
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
---> 3b15bac0a051
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
---> cb0c242a99e2
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
---> Running in e99db5433ece
Removing intermediate container e99db5433ece
---> f653f8f4105d
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
---> 0b690e3ca451
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then pip install 'pip-licenses<4.0.0' pyyaml tenacity && python /tmp/license_scripts/pull_licenses_py.py ; fi
---> Running in f61b71c68599
Collecting pip-licenses<4.0.0
Downloading pip_licenses-3.5.4-py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.7/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.7/site-packages (5.1.5)
Collecting PTable
Downloading PTable-0.9.2.tar.gz (31 kB)
Preparing metadata (setup.py): started
Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.7/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
Building wheel for PTable (setup.py): started
Building wheel for PTable (setup.py): finished with status 'done'
Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=94166b5eecc5468121af0f6fc6fb93567c49f54628ae9d900af7ec87f16cb91e
Stored in directory: /root/.cache/pip/wheels/33/df/2f/674985b3f8a2de3f96357d1eadef5110f74fa91b3785e52a54
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-3.5.4
[91mWARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
[0m[91mWARNING: You are using pip version 22.0.4; however, version 22.1.2 is available.
You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command.
[0mSkip pulling license for bs4
[91mINFO:root:Successfully pulled licenses for 135 dependencies
[0mRemoving intermediate container f61b71c68599
---> 77e20618ca81
Step 28/31 : FROM beam
---> 050af8acfd6c
Step 29/31 : ARG pull_licenses
---> Running in f14a6013542e
Removing intermediate container f14a6013542e
---> 5c86a5ed888f
Step 30/31 : COPY --from=third_party_licenses /opt/apache/beam/third_party_licenses /opt/apache/beam/third_party_licenses
---> 764ce936a0b7
Step 31/31 : RUN if [ "$pull_licenses" != "true" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi
---> Running in e50024e78298
Removing intermediate container e50024e78298
---> 4d0cb2d5b24a
Successfully built 4d0cb2d5b24a
Successfully tagged apache/beam_python3.7_sdk:2.40.0.dev
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:fn-execution:compileJava'.
> java.util.ConcurrentModificationException (no error message)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 10m 18s
167 actionable tasks: 122 executed, 34 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/nsxlpuqdrjit6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_XVR_Spark #3793
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3793/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_XVR_Spark #3792
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/3792/display/redirect?page=changes>
Changes:
[dannymccormick] [BEAM-14446] Update some docs to point to GitHub issues
[dannymccormick] More doc updates
[dannymccormick] Update issueManagement fields
[dannymccormick] Fix website build
[dannymccormick] Remove extraneous comment line
[noreply] Commit message guidance
[noreply] Rename pytorch files (#17798)
[noreply] Merge pull request #17492 from [BEAM-13945] (FIX) Update Java BQ
[noreply] [BEAM-11105] Add more watermark estimation docs for go (#17785)
[noreply] [BEAM-11106] documentation for SDF truncation in Go (#17781)
------------------------------------------
[...truncated 838.48 KB...]
else:
remaining = until - time.time()
if remaining < 0:
> raise grpc.FutureTimeoutError()
E grpc.FutureTimeoutError
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:85: FutureTimeoutError
----------------------------- Captured stderr call -----------------------------
E0603 01:21:06.257331011 2126615 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:755 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '43387' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:43387'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:21:07 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:21:08 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:21:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:21:09 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:21:11 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQL:'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'SELECT COUNT(*) AS `count`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'FROM `beam`.`PCOLLECTION` AS `PCOLLECTION`'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:21:11 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: SQLPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'LogicalAggregate(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:21:11 AM org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'BeamAggregationRel(group=[{}], count=[COUNT()])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamIOSourceRel(table=[[beam, PCOLLECTION]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.40.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fbe2285e560> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fbe2285e5f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fbe2285ed40> ====================
_________________ SqlTransformTest.test_zetasql_generate_data __________________
self = <apache_beam.transforms.sql_test.SqlTransformTest testMethod=test_zetasql_generate_data>
def test_zetasql_generate_data(self):
with TestPipeline() as p:
out = p | SqlTransform(
"""SELECT
CAST(1 AS INT64) AS `int`,
CAST('foo' AS STRING) AS `str`,
CAST(3.14 AS FLOAT64) AS `flt`""",
dialect="zetasql")
> assert_that(out, equal_to([(1, "foo", 3.14)]))
apache_beam/transforms/sql_test.py:160:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/pipeline.py:596: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:114: in run
False if self.not_use_test_runner_api else test_runner_api))
apache_beam/pipeline.py:573: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/portable_runner.py:438: in run_pipeline
job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:317: in create_job_service
return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:54: in start
grpc.channel_ready_future(channel).result(timeout=self._timeout)
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:139: in result
self._block(timeout)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <grpc._utilities._ChannelReadyFuture object at 0x7fbe103e89d0>
timeout = 60
def _block(self, timeout):
until = None if timeout is None else time.time() + timeout
with self._condition:
while True:
if self._cancelled:
raise grpc.FutureCancelledError()
elif self._matured:
return
else:
if until is None:
self._condition.wait()
else:
remaining = until - time.time()
if remaining < 0:
> raise grpc.FutureTimeoutError()
E grpc.FutureTimeoutError
../../build/gradleenv/1922375555/lib/python3.7/site-packages/grpc/_utilities.py:85: FutureTimeoutError
----------------------------- Captured stderr call -----------------------------
E0603 01:22:18.303255960 2126615 fork_posix.cc:76] Other threads are currently calling into gRPC, skipping fork() handlers
------------------------------ Captured log call -------------------------------
INFO apache_beam.utils.subprocess_server:subprocess_server.py:238 Using pre-built snapshot at <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO root:external.py:755 Starting a JAR-based expansion service from JAR <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:116 Starting service with ['java' '-jar' '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar'> '43885' '--filesToStage=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.40.0-SNAPSHOT.jar']>
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Starting expansion service at localhost:43885'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:22:19 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: Registering external transforms: [beam:external:java:sql:v1, beam:transform:org.apache.beam:pubsub_read:v1, beam:transform:org.apache.beam:pubsub_write:v1, beam:transform:org.apache.beam:pubsublite_write:v1, beam:transform:org.apache.beam:pubsublite_read:v1, beam:transform:org.apache.beam:spanner_insert:v1, beam:transform:org.apache.beam:spanner_update:v1, beam:transform:org.apache.beam:spanner_replace:v1, beam:transform:org.apache.beam:spanner_insert_or_update:v1, beam:transform:org.apache.beam:spanner_delete:v1, beam:transform:org.apache.beam:spanner_read:v1, beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:sql:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@48f2bd5b'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7b2bbc3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsub_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@a1153bc'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1aafa419'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:pubsublite_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@47eaca72'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55141def'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@55182842'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_replace:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3270d194'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_insert_or_update:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@235834f2'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_delete:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@5656be13'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:spanner_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@4218d6a3'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@76505305'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@14cd1699'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@77888435'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'\tbeam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@73a1e9a9'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:22:21 AM org.apache.beam.sdk.expansion.service.ExpansionService expand'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"INFO: Expanding 'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:22:21 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:22:21 AM org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader payloadToConfig'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"WARNING: Configuration class 'org.apache.beam.sdk.extensions.sql.expansion.ExternalSqlTransformRegistrar$Configuration' has no schema registered. Attempting to construct with setter approach."
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:22:23 AM com.google.zetasql.io.grpc.NameResolverRegistry getDefaultRegistry'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'WARNING: No NameResolverProviders found via ServiceLoader, including for DNS. This is probably due to a broken build. If using ProGuard, check your configuration'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Jun 03, 2022 1:22:25 AM org.apache.beam.sdk.extensions.sql.zetasql.ZetaSQLQueryPlanner convertToBeamRelInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: BEAMPlan>'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b"BeamZetaSqlCalcRel(expr#0=[{inputs}], expr#1=[1:BIGINT], expr#2=['foo':VARCHAR], expr#3=[3.1400000000000001243E0:DOUBLE], int=[$t1], str=[$t2], flt=[$t3])"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' BeamValuesRel(tuples=[[{ 0 }]])'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b''
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:299 No image given, using default Python SDK image
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.7 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is apache/beam_python3.7_sdk:2.40.0.dev
INFO root:environments.py:304 Python SDK container image set to "apache/beam_python3.7_sdk:2.40.0.dev" for Docker environment
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function pack_combiners at 0x7fbe2285e560> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function lift_combiners at 0x7fbe2285e5f0> ====================
INFO apache_beam.runners.portability.fn_api_runner.translations:translations.py:714 ==================== <function sort_stages at 0x7fbe2285ed40> ====================
=============================== warnings summary ===============================
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/mark/structures.py>:335
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/mark/structures.py>:335
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/mark/structures.py>:335: PytestUnknownMarkWarning: Unknown pytest.mark.uses_java_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
PytestUnknownMarkWarning,
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/mark/structures.py>:335
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/build/gradleenv/1922375555/lib/python3.7/site-packages/_pytest/mark/structures.py>:335: PytestUnknownMarkWarning: Unknown pytest.mark.uses_python_expansion_service - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
PytestUnknownMarkWarning,
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> -
====== 9 failed, 1 skipped, 5602 deselected, 3 warnings in 673.66 seconds ======
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql FAILED
> Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup
> Task :runners:spark:2:job-server:sparkJobServerCleanup
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 195
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/runners/spark/2/job-server/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 35m 59s
254 actionable tasks: 174 executed, 69 from cache, 11 up-to-date
Publishing build scan...
https://gradle.com/s/bh4iir7bvzasu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org