You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/01/19 00:02:22 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #33
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/33/display/redirect>
------------------------------------------
[...truncated 18.18 KB...]
Collecting enum34>=1.0.4 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: pluggy, six, virtualenv, py, tox, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.18.0 grpcio-tools-1.3.5 pluggy-0.8.1 protobuf-3.6.1 py-1.7.0 six-1.12.0 tox-3.0.0 virtualenv-16.2.0
> Task :beam-sdks-java-core:shadowJar
> Task :beam-vendor-sdks-java-extensions-protobuf:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-vendor-sdks-java-extensions-protobuf:classes
> Task :beam-sdks-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/BeamFnDataBufferingOutboundObserver.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-fn-execution:classes
> Task :beam-sdks-java-extensions-google-cloud-platform-core:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/util/GcsUtil.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-sdks-java-extensions-google-cloud-platform-core:classes
> Task :beam-sdks-java-fn-execution:shadowJar
> Task :beam-vendor-sdks-java-extensions-protobuf:shadowJar
> Task :beam-runners-core-construction-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-construction-java:classes
> Task :beam-runners-core-construction-java:shadowJar
> Task :beam-sdks-java-extensions-google-cloud-platform-core:shadowJar
> Task :beam-runners-core-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-java:classes
> Task :beam-runners-core-java:shadowJar
> Task :beam-sdks-java-harness:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-harness:classes
> Task :beam-sdks-java-harness:jar
> Task :beam-sdks-java-harness:shadowJar
> Task :beam-runners-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/ServerFactory.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-java-fn-execution:classes
> Task :beam-runners-java-fn-execution:shadowJar
> Task :beam-runners-flink_2.11:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-flink_2.11:classes
> Task :beam-runners-flink_2.11:shadowJar
> Task :beam-runners-flink_2.11-job-server:compileJava NO-SOURCE
> Task :beam-runners-flink_2.11-job-server:classes UP-TO-DATE
> Task :beam-runners-flink_2.11-job-server:shadowJar
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.11.0.dev0)
Collecting fastavro<0.22,>=0.21.4 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/81/9ecee4b61514da16e6e11b5bfd3cc35112bc9c2846d846ec7cc1cda0b106/fastavro-0.21.16-cp27-cp27mu-manylinux1_x86_64.whl
Collecting pyarrow<0.12.0,>=0.11.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/34/65/a3cd43e1834a748d9650e962ce43083063bf0c778e634d6ae5ca6e62438c/pyarrow-0.11.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.11.0.dev0)
Collecting httplib2<=0.11.3,>=0.8 (from apache-beam==2.11.0.dev0)
Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl
Collecting oauth2client<4,>=2.0.1 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Collecting pydot<1.3,>=1.2.0 (from apache-beam==2.11.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/61/28/1d3920e4d1d50b19bc5d24398a7cd85cc7b9a75a490570d5a30c57622d34/pytz-2018.9-py2.py3-none-any.whl
Collecting pyyaml<4.0.0,>=3.12 (from apache-beam==2.11.0.dev0)
Collecting pyvcf<0.7.0,>=0.6.8 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.11.0.dev0)
Collecting dill<=0.2.8.2,>=0.2.6 (from apache-beam==2.11.0.dev0)
Collecting typing<3.7.0,>=3.6.0 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/cc/3e/29f92b7aeda5b078c86d14f550bf85cff809042e3429ace7af6193c3bc9f/typing-3.6.6-py2-none-any.whl
Collecting numpy>=1.14 (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/85/163127d3fb0573deb9eca947cfc73aa3618eaaf8656501460574471d114a/numpy-1.16.0-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Collecting requests>=2.7.0 (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl
Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/f3/04/fddc1c2dd75b256eda4d360024692231a2c19a0c61ad7f4a162407c1ab58/pbr-5.1.1-py2.py3-none-any.whl
Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl
Collecting pyasn1>=0.1.7 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.0.5 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/59/84/339c2de112d7448d7d4c500b8016783d9eac8981f89ec1d58fdd4685d97f/pyasn1_modules-0.2.3-py2.py3-none-any.whl
Collecting rsa>=3.1.4 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Collecting pyparsing>=2.1.4 (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/de/0a/001be530836743d8be6c2d85069f46fecf84ac6c18c7f5fb8125ee11d854/pyparsing-2.3.1-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/e0/accfc1b56b57e9750eba272e24c4dddeac86852c2bebd1236674d7887e8a/certifi-2018.11.29-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting urllib3<1.25,>=1.21.1 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/62/00/ee1d7de624db8ba7090d1226aebefab96a2c71cd5cfa7629d6ad3f61b79e/urllib3-1.24.1-py2.py3-none-any.whl
Installing collected packages: crcmod, fastavro, numpy, pyarrow, docopt, certifi, chardet, idna, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, pyasn1, pyasn1-modules, rsa, oauth2client, pyparsing, pydot, pytz, pyyaml, pyvcf, avro, dill, typing, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam avro-1.8.2 certifi-2018.11.29 chardet-3.0.4 crcmod-1.7 dill-0.2.8.2 docopt-0.6.2 fastavro-0.21.16 funcsigs-1.0.2 hdfs-2.2.2 httplib2-0.11.3 idna-2.8 mock-2.0.0 numpy-1.16.0 oauth2client-3.0.0 pbr-5.1.1 pyarrow-0.11.1 pyasn1-0.4.5 pyasn1-modules-0.2.3 pydot-1.2.4 pyparsing-2.3.1 pytz-2018.9 pyvcf-0.6.8 pyyaml-3.13 requests-2.21.0 rsa-4.0 typing-3.6.6 urllib3-1.24.1
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK FAILED
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.7)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.21.16)
Requirement already satisfied: pyarrow<0.12.0,>=0.11.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.1)
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.2.2)
Requirement already satisfied: httplib2<=0.11.3,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.3)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.0.0)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Requirement already satisfied: pydot<1.3,>=1.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.2.4)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2018.9)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.13)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.6.8)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Requirement already satisfied: avro<2.0.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.8.2)
Requirement already satisfied: dill<=0.2.8.2,>=0.2.6 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.2.8.2)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.6)
Requirement already satisfied: numpy>=1.14 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.16.0)
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.21.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (5.1.1)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (1.0.2)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.4.5)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.2.3)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (4.0)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0) (2.3.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2018.11.29)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (3.0.4)
Requirement already satisfied: idna<2.9,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.8)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (1.24.1)
Installing collected packages: apache-beam
Found existing installation: apache-beam 2.11.0.dev0
Not uninstalling apache-beam at <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python,> outside environment <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738>
Can't uninstall 'apache-beam'. No files were found to uninstall.
Running setup.py develop for apache-beam
Successfully installed apache-beam
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 8s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/3gjixuwzgbyim
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Flink
#57
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/57/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #56
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/56/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 22, 2019 12:05:44 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:45577} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:41341.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:46873.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
INFO:root:Creating channel for localhost:34591
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8ea137c7fa7f4dc16ee8110cd4e96d55) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8ea137c7fa7f4dc16ee8110cd4e96d55).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8ea137c7fa7f4dc16ee8110cd4e96d55) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 8ea137c7fa7f4dc16ee8110cd4e96d55.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8ea137c7fa7f4dc16ee8110cd4e96d55) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (65f98d74869e76b6bd1770a4a3667796) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (65f98d74869e76b6bd1770a4a3667796).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (65f98d74869e76b6bd1770a4a3667796) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 65f98d74869e76b6bd1770a4a3667796.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (65f98d74869e76b6bd1770a4a3667796) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4c2dada1c368e3e06eadc0e64276e910) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4c2dada1c368e3e06eadc0e64276e910).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4c2dada1c368e3e06eadc0e64276e910) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 4c2dada1c368e3e06eadc0e64276e910.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4c2dada1c368e3e06eadc0e64276e910) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (6cef32426f4bb6dffea29627f719d819) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (6cef32426f4bb6dffea29627f719d819).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (6cef32426f4bb6dffea29627f719d819) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 6cef32426f4bb6dffea29627f719d819.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (0b0c25d7cd64f85ac67d797bcd6343ad) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (0b0c25d7cd64f85ac67d797bcd6343ad).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (0b0c25d7cd64f85ac67d797bcd6343ad) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 0b0c25d7cd64f85ac67d797bcd6343ad.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (6cef32426f4bb6dffea29627f719d819) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (0b0c25d7cd64f85ac67d797bcd6343ad) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, fc09155e-17e2-4055-8b47-13fc87614418, test_windowing_1548158743.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6bc106d0578131d3c286ada47dc09d31) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6bc106d0578131d3c286ada47dc09d31).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6bc106d0578131d3c286ada47dc09d31) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548158744.969161023","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 6bc106d0578131d3c286ada47dc09d31.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548158744.969161023","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6bc106d0578131d3c286ada47dc09d31) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548158743.98 (5c751a2afdc482d8aaa53e323ddb1f18) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 5c751a2afdc482d8aaa53e323ddb1f18.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 5c751a2afdc482d8aaa53e323ddb1f18 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548158743.98(5c751a2afdc482d8aaa53e323ddb1f18).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 5c751a2afdc482d8aaa53e323ddb1f18.
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 61c0f00af1220a049dfdfaeb959b0d5c: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{e2f5d1bfe5ad5761fc43f6a2b0d325dc}, jobId: 5c751a2afdc482d8aaa53e323ddb1f18).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 5c751a2afdc482d8aaa53e323ddb1f18 from job leader monitoring.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 5c751a2afdc482d8aaa53e323ddb1f18.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 8726285ee79b2d10a87cb1da5b494f0e@akka://flink/user/jobmanager_45 for job 5c751a2afdc482d8aaa53e323ddb1f18 from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher4e738210-923c-415f-9558-a6a9ecae47bb.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher4e738210-923c-415f-9558-a6a9ecae47bb.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-6ce2a6af-532a-4a6a-8d49-cde0ff617c5d
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher4e738210-923c-415f-9558-a6a9ecae47bb.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confWO6Hxq/test-metrics.txt
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:38873
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 329 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@9ad63688
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confWO6Hxq
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548158717.3_f046ab51-3182-493b-a284-8282d5b5f72a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 40.216s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 29s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/6dziq3j2fbbaw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #55
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/55/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 22, 2019 6:05:35 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:32949} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:42225.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:45453.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:41839
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (ffd8caa53294c5ef58eb5f924538163f) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (ffd8caa53294c5ef58eb5f924538163f).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (ffd8caa53294c5ef58eb5f924538163f) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) ffd8caa53294c5ef58eb5f924538163f.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (ffd8caa53294c5ef58eb5f924538163f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (fbf16533cd8978c9199118a386b146e4) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (fbf16533cd8978c9199118a386b146e4).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (fbf16533cd8978c9199118a386b146e4) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} fbf16533cd8978c9199118a386b146e4.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (fbf16533cd8978c9199118a386b146e4) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a11c5effd4e6018688b1297644937002) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a11c5effd4e6018688b1297644937002).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a11c5effd4e6018688b1297644937002) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem a11c5effd4e6018688b1297644937002.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a11c5effd4e6018688b1297644937002) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (21453b4ec7e46c1ecd41176ee5b12b9e) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (21453b4ec7e46c1ecd41176ee5b12b9e).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (21453b4ec7e46c1ecd41176ee5b12b9e) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 21453b4ec7e46c1ecd41176ee5b12b9e.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (ca9aa558f12bff6dd0d15307ea772341) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (ca9aa558f12bff6dd0d15307ea772341).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (ca9aa558f12bff6dd0d15307ea772341) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem ca9aa558f12bff6dd0d15307ea772341.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (21453b4ec7e46c1ecd41176ee5b12b9e) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (ca9aa558f12bff6dd0d15307ea772341) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5bd417e3-bdb7-4de9-bc80-d82a106bfde5, test_windowing_1548137134.35, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a5aec2033f45dd0c9db3838bd17a7d2e) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a5aec2033f45dd0c9db3838bd17a7d2e).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a5aec2033f45dd0c9db3838bd17a7d2e) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548137135.371591794","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548137135.371591794","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} a5aec2033f45dd0c9db3838bd17a7d2e.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a5aec2033f45dd0c9db3838bd17a7d2e) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548137134.35 (aab50c34242f55a837342606a41c8b73) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job aab50c34242f55a837342606a41c8b73.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job aab50c34242f55a837342606a41c8b73 reached globally terminal state FINISHED.
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548137134.35(aab50c34242f55a837342606a41c8b73).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job aab50c34242f55a837342606a41c8b73.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection eb96def08430f578b8ddcf7e839a68dd: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 899db31898344f77225c752bb3a44911@akka://flink/user/jobmanager_45 for job aab50c34242f55a837342606a41c8b73 from the resource manager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{0f10d65f756304b17fac4b335018849c}, jobId: aab50c34242f55a837342606a41c8b73).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job aab50c34242f55a837342606a41c8b73 from job leader monitoring.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job aab50c34242f55a837342606a41c8b73.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatchercfa4ceae-7089-46c6-ab60-03cd562b8e30.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatchercfa4ceae-7089-46c6-ab60-03cd562b8e30.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-2a58b1af-5ff5-4247-9a36-c7cef0be39e3
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatchercfa4ceae-7089-46c6-ab60-03cd562b8e30.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confHomWqj/test-metrics.txt
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:37455
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 347 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@4cc829b6
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confHomWqj
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548137108.75_ed68c3d8-e838-4444-b9dd-44a3821d7409 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 37.457s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 28s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/npwblka4mnufk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #54
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/54/display/redirect?page=changes>
Changes:
[25622840+adude3141] add target to spotless, execute spotlessApply on missed files
------------------------------------------
[...truncated 4.04 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 22, 2019 4:08:42 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:43711} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:36637.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:44651.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
INFO:root:Creating channel for localhost:35289
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (158d1a2ab0637331049e8e22baf12fe2) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (158d1a2ab0637331049e8e22baf12fe2).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (158d1a2ab0637331049e8e22baf12fe2) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 158d1a2ab0637331049e8e22baf12fe2.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (158d1a2ab0637331049e8e22baf12fe2) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (cffe4205ab67dfb8b6cd68e8bf502916) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (cffe4205ab67dfb8b6cd68e8bf502916).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (cffe4205ab67dfb8b6cd68e8bf502916) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} cffe4205ab67dfb8b6cd68e8bf502916.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (cffe4205ab67dfb8b6cd68e8bf502916) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a28d791c68fc62dd1730add43c84eb5f) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a28d791c68fc62dd1730add43c84eb5f).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a28d791c68fc62dd1730add43c84eb5f) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem a28d791c68fc62dd1730add43c84eb5f.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a28d791c68fc62dd1730add43c84eb5f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce59462d5371d2d0b9ad328fd3013c25) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce59462d5371d2d0b9ad328fd3013c25).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce59462d5371d2d0b9ad328fd3013c25) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} ce59462d5371d2d0b9ad328fd3013c25.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (6a5f6a90cc35eec6aa809b7bd0ac9b71) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (6a5f6a90cc35eec6aa809b7bd0ac9b71).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (6a5f6a90cc35eec6aa809b7bd0ac9b71) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 6a5f6a90cc35eec6aa809b7bd0ac9b71.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce59462d5371d2d0b9ad328fd3013c25) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (6a5f6a90cc35eec6aa809b7bd0ac9b71) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c4dd543a-ac37-4820-97cf-c8e332ee150a, test_windowing_1548130121.86, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (fc0f162dd794c5e915e123a01f3a0511) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (fc0f162dd794c5e915e123a01f3a0511).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (fc0f162dd794c5e915e123a01f3a0511) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} fc0f162dd794c5e915e123a01f3a0511.
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548130122.807399658","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (fc0f162dd794c5e915e123a01f3a0511) switched from RUNNING to FINISHED.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548130122.807399658","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548130121.86 (fc1d18674ce54b78cd045e1e68156e23) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job fc1d18674ce54b78cd045e1e68156e23.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job fc1d18674ce54b78cd045e1e68156e23 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548130121.86(fc1d18674ce54b78cd045e1e68156e23).
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job fc1d18674ce54b78cd045e1e68156e23.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 9a18bb0461b9d749e2a5aae49505f559: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager b01ad2e7d43e3fef4e8734513ccc4176@akka://flink/user/jobmanager_45 for job fc1d18674ce54b78cd045e1e68156e23 from the resource manager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{ee2bb432a9ec64674f981033a0b6c529}, jobId: fc1d18674ce54b78cd045e1e68156e23).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job fc1d18674ce54b78cd045e1e68156e23 from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job fc1d18674ce54b78cd045e1e68156e23.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherc6747480-f970-4a79-98b7-789e6f17bb26.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherc6747480-f970-4a79-98b7-789e6f17bb26.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-69d55cdb-0967-4d4f-90f4-06785edce884
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherc6747480-f970-4a79-98b7-789e6f17bb26.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confXnSbhb/test-metrics.txt
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:33695
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 286 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@37326209
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confXnSbhb
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548130095.46_6bbc45cc-f6c0-4989-9a51-b6d9824f6b9b failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 38.230s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 42s
45 actionable tasks: 44 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/bsyhh3kuhpihi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #53
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/53/display/redirect?page=changes>
Changes:
[mxm] [BEAM-6460] Remove cached class references upon start/shutdown
------------------------------------------
[...truncated 4.01 MB...]
Jan 22, 2019 1:14:38 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:44327} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:43455.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:32815.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
INFO:root:Creating channel for localhost:36435
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (954cbf077ee9d28707b078383ef0e28f) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (954cbf077ee9d28707b078383ef0e28f).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (954cbf077ee9d28707b078383ef0e28f) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 954cbf077ee9d28707b078383ef0e28f.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (954cbf077ee9d28707b078383ef0e28f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (df10ae33cff69ff45583eca3074e0348) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (df10ae33cff69ff45583eca3074e0348).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (df10ae33cff69ff45583eca3074e0348) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} df10ae33cff69ff45583eca3074e0348.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (df10ae33cff69ff45583eca3074e0348) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (50b876be9727a27ac66887f4cc33b67e) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (50b876be9727a27ac66887f4cc33b67e).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (50b876be9727a27ac66887f4cc33b67e) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 50b876be9727a27ac66887f4cc33b67e.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (50b876be9727a27ac66887f4cc33b67e) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (fdfff2164ff0ab942974da6d99edd0fa) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (fdfff2164ff0ab942974da6d99edd0fa).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (fdfff2164ff0ab942974da6d99edd0fa) [FINISHED]
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (2f3f6b8e20e4e2d503dd12cd3d7f3db5) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} fdfff2164ff0ab942974da6d99edd0fa.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (2f3f6b8e20e4e2d503dd12cd3d7f3db5).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (2f3f6b8e20e4e2d503dd12cd3d7f3db5) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 2f3f6b8e20e4e2d503dd12cd3d7f3db5.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (fdfff2164ff0ab942974da6d99edd0fa) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (2f3f6b8e20e4e2d503dd12cd3d7f3db5) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, a744b337-ba65-439d-92e5-f773d331097e, test_windowing_1548119677.84, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d92febd8f26082798a0e79a6b0246bb4) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d92febd8f26082798a0e79a6b0246bb4).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d92febd8f26082798a0e79a6b0246bb4) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} d92febd8f26082798a0e79a6b0246bb4.
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548119678.752432809","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548119678.752432809","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (d92febd8f26082798a0e79a6b0246bb4) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548119677.84 (287aaeaaf32cc3f325d594e2d733e243) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 287aaeaaf32cc3f325d594e2d733e243.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 287aaeaaf32cc3f325d594e2d733e243 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548119677.84(287aaeaaf32cc3f325d594e2d733e243).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 287aaeaaf32cc3f325d594e2d733e243.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection d6081d75030e586035ab80bbaadcb581: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 81f00b72dacb99044f5de71b248e4a74@akka://flink/user/jobmanager_45 for job 287aaeaaf32cc3f325d594e2d733e243 from the resource manager.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job 287aaeaaf32cc3f325d594e2d733e243 with leader id 81f00b72dacb99044f5de71b248e4a74 lost leadership.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherdf87a09b-bc10-4b56-867c-a4ef4f6e0856.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{0d2be3b50c4f633f46faee2a86a8b3b4}, jobId: 287aaeaaf32cc3f325d594e2d733e243).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherdf87a09b-bc10-4b56-867c-a4ef4f6e0856.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 287aaeaaf32cc3f325d594e2d733e243 from job leader monitoring.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 287aaeaaf32cc3f325d594e2d733e243.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-b59cbeaa-6970-4e8e-82ee-aa0278bfca68
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherdf87a09b-bc10-4b56-867c-a4ef4f6e0856.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confaseiTJ/test-metrics.txt
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:35033
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 301 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@26fdc931
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confaseiTJ
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548119651.57_e0a76b14-6d1d-4edd-8960-db81175e804a failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 40.032s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 40s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/7pyu4xdvosjns
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #52
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/52/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a714050a70bceeac62f78c23db7ee736) [DEPLOYING].
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a714050a70bceeac62f78c23db7ee736) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a714050a70bceeac62f78c23db7ee736) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880)
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
INFO:root:Creating insecure control channel for localhost:45117.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:33947.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:40093
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (c94ccd12aacd6fe941684b525263d98b) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (c94ccd12aacd6fe941684b525263d98b).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (c94ccd12aacd6fe941684b525263d98b) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) c94ccd12aacd6fe941684b525263d98b.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (c94ccd12aacd6fe941684b525263d98b) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d32153c8c6df64c546edad985b038870) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d32153c8c6df64c546edad985b038870).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d32153c8c6df64c546edad985b038870) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} d32153c8c6df64c546edad985b038870.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d32153c8c6df64c546edad985b038870) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7f8d84f6a66e8a0ad307124852c7102f) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7f8d84f6a66e8a0ad307124852c7102f).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7f8d84f6a66e8a0ad307124852c7102f) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 7f8d84f6a66e8a0ad307124852c7102f.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7f8d84f6a66e8a0ad307124852c7102f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (b5c83aa3122fcea63c2418bcff35c2e7) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (b5c83aa3122fcea63c2418bcff35c2e7).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (b5c83aa3122fcea63c2418bcff35c2e7) [FINISHED]
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (06ea5e5607b954befc87e57465b4fb0a) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (06ea5e5607b954befc87e57465b4fb0a).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (06ea5e5607b954befc87e57465b4fb0a) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} b5c83aa3122fcea63c2418bcff35c2e7.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 06ea5e5607b954befc87e57465b4fb0a.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (b5c83aa3122fcea63c2418bcff35c2e7) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (06ea5e5607b954befc87e57465b4fb0a) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0130f47c-2d0a-424c-8db2-6ff9fb38d6b2, test_windowing_1548115579.98, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a714050a70bceeac62f78c23db7ee736) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a714050a70bceeac62f78c23db7ee736).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a714050a70bceeac62f78c23db7ee736) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548115581.265991934","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548115581.265991934","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} a714050a70bceeac62f78c23db7ee736.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (a714050a70bceeac62f78c23db7ee736) switched from RUNNING to FINISHED.
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548115579.98 (debddab03f40e18ede12f536b3fb45e0) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job debddab03f40e18ede12f536b3fb45e0.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job debddab03f40e18ede12f536b3fb45e0 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548115579.98(debddab03f40e18ede12f536b3fb45e0).
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 135b8992091fdcb827959751d753d070: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher8c44406d-53bb-4f4c-80fb-02b1a0622db7.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher8c44406d-53bb-4f4c-80fb-02b1a0622db7.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job debddab03f40e18ede12f536b3fb45e0.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job debddab03f40e18ede12f536b3fb45e0 with leader id a2dd4f58e79cbe5ea51912402bc341bc lost leadership.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager a2dd4f58e79cbe5ea51912402bc341bc@akka://flink/user/jobmanager_45 for job debddab03f40e18ede12f536b3fb45e0 from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{2401e2106c92d9848c15168e15226669}, jobId: debddab03f40e18ede12f536b3fb45e0).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job debddab03f40e18ede12f536b3fb45e0 from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job debddab03f40e18ede12f536b3fb45e0.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-859aaf7c-7a4f-4ae2-a444-7e88e5933197
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher8c44406d-53bb-4f4c-80fb-02b1a0622db7.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confx0muKe/test-metrics.txt
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:37623
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 454 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@e90a6817
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confx0muKe
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548115544.84_ea9ff296-5bdc-49f3-9886-00f1f54f20a6 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 51.839s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 10s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/mmnvxwigklcno
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #51
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/51/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 21, 2019 6:05:46 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:40017} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:41261.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:41893.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
INFO:root:Creating channel for localhost:37797
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7bd4563b91490a0bee07a21f8abde8d8) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7bd4563b91490a0bee07a21f8abde8d8).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7bd4563b91490a0bee07a21f8abde8d8) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 7bd4563b91490a0bee07a21f8abde8d8.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7bd4563b91490a0bee07a21f8abde8d8) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (acd710a573e129b6d31fa07691726f71) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (acd710a573e129b6d31fa07691726f71).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (acd710a573e129b6d31fa07691726f71) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} acd710a573e129b6d31fa07691726f71.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (acd710a573e129b6d31fa07691726f71) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (13d8cba60922d42cdbfaa2f07e7d32a4) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (13d8cba60922d42cdbfaa2f07e7d32a4).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (13d8cba60922d42cdbfaa2f07e7d32a4) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 13d8cba60922d42cdbfaa2f07e7d32a4.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (13d8cba60922d42cdbfaa2f07e7d32a4) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (1c061f3a744e5150a6aed400f1b68dd9) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (1c061f3a744e5150a6aed400f1b68dd9).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (1c061f3a744e5150a6aed400f1b68dd9) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 1c061f3a744e5150a6aed400f1b68dd9.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (88420b2ea206964aeab13c12c8b4955e) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (88420b2ea206964aeab13c12c8b4955e).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (88420b2ea206964aeab13c12c8b4955e) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 88420b2ea206964aeab13c12c8b4955e.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (1c061f3a744e5150a6aed400f1b68dd9) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (88420b2ea206964aeab13c12c8b4955e) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, f9387024-4536-4e57-b360-0bcd105533ef, test_windowing_1548093946.0, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6802b03930cefd5bed6fc95f0f256957) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6802b03930cefd5bed6fc95f0f256957).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6802b03930cefd5bed6fc95f0f256957) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548093947.031239743","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 6802b03930cefd5bed6fc95f0f256957.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548093947.031239743","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (6802b03930cefd5bed6fc95f0f256957) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548093946.0 (8e822b5a1f564730010a485e9fdd3280) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 8e822b5a1f564730010a485e9fdd3280.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 8e822b5a1f564730010a485e9fdd3280 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548093946.0(8e822b5a1f564730010a485e9fdd3280).
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 8e822b5a1f564730010a485e9fdd3280.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection fbdbd362d300c2dd271c4ecd911c5d4a: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager aae2d9f7366fce89b2bcd5e1f76e4b34@akka://flink/user/jobmanager_45 for job 8e822b5a1f564730010a485e9fdd3280 from the resource manager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{4588a8c451b18eadeded3a7d051813ce}, jobId: 8e822b5a1f564730010a485e9fdd3280).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 8e822b5a1f564730010a485e9fdd3280 from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 8e822b5a1f564730010a485e9fdd3280.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher2211f673-787e-4509-9fd7-5a5ed7c94a85.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher2211f673-787e-4509-9fd7-5a5ed7c94a85.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-8cb25183-3dee-4b23-a09f-424146cd1751
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher2211f673-787e-4509-9fd7-5a5ed7c94a85.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-conf0YSwQZ/test-metrics.txt
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:44031
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 356 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@b0056666
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-conf0YSwQZ
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548093919.57_f7be30d0-3f61-4391-9bee-220f851beb89 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 40.246s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 35s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/tvgtp6pnaimqs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #50
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/50/display/redirect>
------------------------------------------
[...truncated 4.06 MB...]
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
INFO:root:Creating insecure control channel for localhost:34583.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:45209.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
INFO:root:Creating channel for localhost:36519
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8bc048a093f10e01b8a68330203f47c3) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8bc048a093f10e01b8a68330203f47c3).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8bc048a093f10e01b8a68330203f47c3) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 8bc048a093f10e01b8a68330203f47c3.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (8bc048a093f10e01b8a68330203f47c3) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (432cbe62edd8069a746c7e5540550c89) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (432cbe62edd8069a746c7e5540550c89).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (432cbe62edd8069a746c7e5540550c89) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 432cbe62edd8069a746c7e5540550c89.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (432cbe62edd8069a746c7e5540550c89) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (c03b6d924041e917bd461fa0d1cdfcce) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (c03b6d924041e917bd461fa0d1cdfcce).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (c03b6d924041e917bd461fa0d1cdfcce) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem c03b6d924041e917bd461fa0d1cdfcce.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (c03b6d924041e917bd461fa0d1cdfcce) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce87adba744bba8490f1d869b32fae33) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce87adba744bba8490f1d869b32fae33).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce87adba744bba8490f1d869b32fae33) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} ce87adba744bba8490f1d869b32fae33.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (c650de7d7e9be8721c463239ddf0bc80) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (c650de7d7e9be8721c463239ddf0bc80).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (c650de7d7e9be8721c463239ddf0bc80) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem c650de7d7e9be8721c463239ddf0bc80.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ce87adba744bba8490f1d869b32fae33) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (c650de7d7e9be8721c463239ddf0bc80) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4acb901a-6d10-4c59-b5d5-2bd19dc5934e, test_windowing_1548072337.19, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (833a0fbee6e1b22b39630429729446e4) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (833a0fbee6e1b22b39630429729446e4).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (833a0fbee6e1b22b39630429729446e4) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548072338.232236218","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 833a0fbee6e1b22b39630429729446e4.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548072338.232236218","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (833a0fbee6e1b22b39630429729446e4) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548072337.19 (c131e88182113cb1789d653c45c826d6) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job c131e88182113cb1789d653c45c826d6.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job c131e88182113cb1789d653c45c826d6 reached globally terminal state FINISHED.INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548072337.19(c131e88182113cb1789d653c45c826d6).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job c131e88182113cb1789d653c45c826d6.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher9c9f35f2-28a8-4457-a2bb-db37bdb8c2d2.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher9c9f35f2-28a8-4457-a2bb-db37bdb8c2d2.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 4bb76c8e5817f5d539fef403417635e0: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 9b397ac9b75492800caa43dbcf9545d6@akka://flink/user/jobmanager_45 for job c131e88182113cb1789d653c45c826d6 from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Could not resolve JobManager address akka://flink/user/jobmanager_45, retrying in 10000 ms: Could not connect to rpc endpoint under address akka://flink/user/jobmanager_45..
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job c131e88182113cb1789d653c45c826d6 with leader id 9b397ac9b75492800caa43dbcf9545d6 lost leadership.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{16290b028bc369572a8d58af8424e850}, jobId: c131e88182113cb1789d653c45c826d6).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job c131e88182113cb1789d653c45c826d6 from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job c131e88182113cb1789d653c45c826d6.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-3852a9c2-0219-44c5-8cd4-421c3a299923
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher9c9f35f2-28a8-4457-a2bb-db37bdb8c2d2.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confWO6m_r/test-metrics.txt
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:39913
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 345 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@88b11859
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confWO6m_r
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548072311.44_94c8663a-3050-4968-b293-8597853b3578 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 37.443s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 25s
45 actionable tasks: 36 executed, 9 from cache
Publishing build scan...
https://gradle.com/s/4c6odfst3zxmo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #49
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/49/display/redirect?page=changes>
Changes:
[github] Correct trivial documentation bug
------------------------------------------
[...truncated 4.01 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 21, 2019 11:18:31 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:34351} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:37943.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:35219.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:43337
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (406f883cf20dace9d4d264753795a582) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (406f883cf20dace9d4d264753795a582).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (406f883cf20dace9d4d264753795a582) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 406f883cf20dace9d4d264753795a582.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (406f883cf20dace9d4d264753795a582) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (38c16977b62fdc9c1a4f5e13f9791f1c) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (38c16977b62fdc9c1a4f5e13f9791f1c).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (38c16977b62fdc9c1a4f5e13f9791f1c) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 38c16977b62fdc9c1a4f5e13f9791f1c.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (38c16977b62fdc9c1a4f5e13f9791f1c) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a8233823f5003d22c29989a43a45be6f) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a8233823f5003d22c29989a43a45be6f).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a8233823f5003d22c29989a43a45be6f) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem a8233823f5003d22c29989a43a45be6f.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a8233823f5003d22c29989a43a45be6f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (e3a06c9e8a1e38e1bf84e898578229d3) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (e3a06c9e8a1e38e1bf84e898578229d3).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (e3a06c9e8a1e38e1bf84e898578229d3) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} e3a06c9e8a1e38e1bf84e898578229d3.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (3dcb01c9e661647501aa2c8577e45ef2) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (3dcb01c9e661647501aa2c8577e45ef2).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (3dcb01c9e661647501aa2c8577e45ef2) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 3dcb01c9e661647501aa2c8577e45ef2.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (e3a06c9e8a1e38e1bf84e898578229d3) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (3dcb01c9e661647501aa2c8577e45ef2) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 4bbb2893-d587-4dfa-aa3a-c5154fc1561f, test_windowing_1548069511.38, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (5422d6b70725d2f236b21ece3e45b3f5) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (5422d6b70725d2f236b21ece3e45b3f5).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (5422d6b70725d2f236b21ece3e45b3f5) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548069512.200555582","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 5422d6b70725d2f236b21ece3e45b3f5.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548069512.200555582","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (5422d6b70725d2f236b21ece3e45b3f5) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548069511.38 (05afa6bfb1256ac87b1397593621b91a) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 05afa6bfb1256ac87b1397593621b91a.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 05afa6bfb1256ac87b1397593621b91a reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548069511.38(05afa6bfb1256ac87b1397593621b91a).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 05afa6bfb1256ac87b1397593621b91a.
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection f03fde3b23f04a679e361ef6c7e9e7be: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{cb08fb69d50b73c382aa351db0b76902}, jobId: 05afa6bfb1256ac87b1397593621b91a).
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager a9ce96f6a571a9b708b5c40cd1074181@akka://flink/user/jobmanager_45 for job 05afa6bfb1256ac87b1397593621b91a from the resource manager.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 05afa6bfb1256ac87b1397593621b91a from job leader monitoring.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 05afa6bfb1256ac87b1397593621b91a.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher365d3cc5-0048-4db7-8601-548f539c686f.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher365d3cc5-0048-4db7-8601-548f539c686f.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-d4523249-7fda-4737-a683-0f3e20e4cf55
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher365d3cc5-0048-4db7-8601-548f539c686f.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confNKVKyQ/test-metrics.txt
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:46501
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 248 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@8315ce30
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confNKVKyQ
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548069489.55_711fb2ba-7bdc-4dd6-9cf0-3619b995a237 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 32.575s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 13s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/ic3x574rin7kk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #48
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/48/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 21, 2019 6:05:46 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:35375} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:42417.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:35879.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
INFO:root:Creating channel for localhost:34167
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (172d48b398c051716808163d90e218ec) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (172d48b398c051716808163d90e218ec).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (172d48b398c051716808163d90e218ec) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 172d48b398c051716808163d90e218ec.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (172d48b398c051716808163d90e218ec) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bce9adfbdb0b54f6a287d5c8e37a4b85) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bce9adfbdb0b54f6a287d5c8e37a4b85).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bce9adfbdb0b54f6a287d5c8e37a4b85) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} bce9adfbdb0b54f6a287d5c8e37a4b85.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bce9adfbdb0b54f6a287d5c8e37a4b85) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (1d3d09a8b717679b67b4ff409abbd21f) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (1d3d09a8b717679b67b4ff409abbd21f).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (1d3d09a8b717679b67b4ff409abbd21f) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 1d3d09a8b717679b67b4ff409abbd21f.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (1d3d09a8b717679b67b4ff409abbd21f) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef959a44832ddc83202494247d75202d) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef959a44832ddc83202494247d75202d).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef959a44832ddc83202494247d75202d) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} ef959a44832ddc83202494247d75202d.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (86b23a5d6ec60c846013bb93e60e07f7) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (86b23a5d6ec60c846013bb93e60e07f7).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (86b23a5d6ec60c846013bb93e60e07f7) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 86b23a5d6ec60c846013bb93e60e07f7.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef959a44832ddc83202494247d75202d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (86b23a5d6ec60c846013bb93e60e07f7) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 2d145d72-4e56-4e31-91ac-2dc3dec5565c, test_windowing_1548050746.03, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e262d9fd3727835a7c1256e18ce889dd) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e262d9fd3727835a7c1256e18ce889dd).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e262d9fd3727835a7c1256e18ce889dd) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} e262d9fd3727835a7c1256e18ce889dd.
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548050747.058200127","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e262d9fd3727835a7c1256e18ce889dd) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548050746.03 (07e99b4566215ed5c387021b335a8a80) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 07e99b4566215ed5c387021b335a8a80.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548050747.058200127","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 07e99b4566215ed5c387021b335a8a80 reached globally terminal state FINISHED.
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548050746.03(07e99b4566215ed5c387021b335a8a80).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 07e99b4566215ed5c387021b335a8a80.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 3134f845a1b1e8c1f0b718296db9c512: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherc0db0ef5-b389-4d80-9676-553f54bb1ea1.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherc0db0ef5-b389-4d80-9676-553f54bb1ea1.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager b5bb9bf39e00230d58e32d3241744d26@akka://flink/user/jobmanager_45 for job 07e99b4566215ed5c387021b335a8a80 from the resource manager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{01f786f33626d926c6cb21f3b423c524}, jobId: 07e99b4566215ed5c387021b335a8a80).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 07e99b4566215ed5c387021b335a8a80 from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 07e99b4566215ed5c387021b335a8a80.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-cf45d388-e3ea-4a46-8058-abc8f6dfad17
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherc0db0ef5-b389-4d80-9676-553f54bb1ea1.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confFCSnKe/test-metrics.txt
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:37601
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 374 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@7b2e5f1c
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confFCSnKe
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548050718.84_c3237d94-dba6-479a-91fc-f42f6ca54da9 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 39.307s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 39s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/vzd2beoknnfa6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #47
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/47/display/redirect?page=changes>
Changes:
[mxm] [BEAM-5396] Assign portable operator uids
[mxm] [BEAM-6440] Ensure state backend key is set for timer deduplication
------------------------------------------
[...truncated 4.02 MB...]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 21, 2019 2:40:23 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:40461} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:40565.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:39915.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:42913
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (69423f2d6376fe11fb3c544ebb9baf39) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (69423f2d6376fe11fb3c544ebb9baf39).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (69423f2d6376fe11fb3c544ebb9baf39) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 69423f2d6376fe11fb3c544ebb9baf39.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (69423f2d6376fe11fb3c544ebb9baf39) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (3da24f79b830bc89a1a7b24e4c734834) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (3da24f79b830bc89a1a7b24e4c734834).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (3da24f79b830bc89a1a7b24e4c734834) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 3da24f79b830bc89a1a7b24e4c734834.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (3da24f79b830bc89a1a7b24e4c734834) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (bc2490edcbedbab2126f1ac7d1a7d277) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (bc2490edcbedbab2126f1ac7d1a7d277).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (bc2490edcbedbab2126f1ac7d1a7d277) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem bc2490edcbedbab2126f1ac7d1a7d277.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (bc2490edcbedbab2126f1ac7d1a7d277) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (3c38116944b8a428ff960a53e2c9baae) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (3c38116944b8a428ff960a53e2c9baae).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (3c38116944b8a428ff960a53e2c9baae) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 3c38116944b8a428ff960a53e2c9baae.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (d1360dd1013fc138c5836e2c0a23bb5a) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (d1360dd1013fc138c5836e2c0a23bb5a).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (d1360dd1013fc138c5836e2c0a23bb5a) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem d1360dd1013fc138c5836e2c0a23bb5a.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (3c38116944b8a428ff960a53e2c9baae) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (d1360dd1013fc138c5836e2c0a23bb5a) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, bfd86b20-297f-46a2-b98f-ab311a3e9585, test_windowing_1548038422.7, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:SDK Harness waiting for in-flight requests to complete
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548038423.679700526","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (7ee2cad022bf87061414f35f4f70f140) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (7ee2cad022bf87061414f35f4f70f140).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (7ee2cad022bf87061414f35f4f70f140) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 7ee2cad022bf87061414f35f4f70f140.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548038423.679700526","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (7ee2cad022bf87061414f35f4f70f140) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548038422.7 (a609a008a12009b4476eb0194c8cff6a) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job a609a008a12009b4476eb0194c8cff6a.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job a609a008a12009b4476eb0194c8cff6a reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548038422.7(a609a008a12009b4476eb0194c8cff6a).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job a609a008a12009b4476eb0194c8cff6a.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 3878aa9627f50251a50c459e4b36ec93: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherdeca4c19-d1bd-419c-8fd9-ca84dbc97f4d.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherdeca4c19-d1bd-419c-8fd9-ca84dbc97f4d.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager bc979d01bb04814a2b0e2ffa29c74707@akka://flink/user/jobmanager_45 for job a609a008a12009b4476eb0194c8cff6a from the resource manager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{fc80c6c6ead3331ee15182e09337611f}, jobId: a609a008a12009b4476eb0194c8cff6a).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job a609a008a12009b4476eb0194c8cff6a from job leader monitoring.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job a609a008a12009b4476eb0194c8cff6a.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-270329d0-b371-450b-bb54-e15044e0b57f
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherdeca4c19-d1bd-419c-8fd9-ca84dbc97f4d.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confFXuLbE/test-metrics.txt
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:34369
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 331 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@18c9b7a3
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confFXuLbE
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548038395.41_8313ea90-aa4c-4bfd-82b2-71b0b34819ea failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 38.994s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 349
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 57s
45 actionable tasks: 34 executed, 11 from cache
Publishing build scan...
https://gradle.com/s/gd5uufkk6bl26
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #46
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/46/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 21, 2019 12:05:48 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:45129} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:45895.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:42165.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
INFO:root:Creating channel for localhost:44547
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (dd6579fcc8f003ad9845122886226b5b) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (dd6579fcc8f003ad9845122886226b5b).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (dd6579fcc8f003ad9845122886226b5b) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) dd6579fcc8f003ad9845122886226b5b.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (dd6579fcc8f003ad9845122886226b5b) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d857cc0e6dfd391a8bcc807db5e77542) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d857cc0e6dfd391a8bcc807db5e77542).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d857cc0e6dfd391a8bcc807db5e77542) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} d857cc0e6dfd391a8bcc807db5e77542.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (d857cc0e6dfd391a8bcc807db5e77542) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7367478f6b3a928cc289bd15aac96706) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7367478f6b3a928cc289bd15aac96706).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7367478f6b3a928cc289bd15aac96706) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 7367478f6b3a928cc289bd15aac96706.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (7367478f6b3a928cc289bd15aac96706) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4e8411d95698d671c63d75876125d70e) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4e8411d95698d671c63d75876125d70e).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4e8411d95698d671c63d75876125d70e) [FINISHED]
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (122618e3954c91087bb00aa6bd60c7b2) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 4e8411d95698d671c63d75876125d70e.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (122618e3954c91087bb00aa6bd60c7b2).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (122618e3954c91087bb00aa6bd60c7b2) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 122618e3954c91087bb00aa6bd60c7b2.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4e8411d95698d671c63d75876125d70e) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (122618e3954c91087bb00aa6bd60c7b2) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 1c270bb3-837b-40a5-816e-c88799f92885, test_windowing_1548029147.81, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (03e310283658809771140a275a795a10) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (03e310283658809771140a275a795a10).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (03e310283658809771140a275a795a10) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548029148.817728782","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548029148.817728782","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 03e310283658809771140a275a795a10.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (03e310283658809771140a275a795a10) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548029147.81 (8968b9636880de0f8ea21aa3251718fa) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 8968b9636880de0f8ea21aa3251718fa.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 8968b9636880de0f8ea21aa3251718fa reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548029147.81(8968b9636880de0f8ea21aa3251718fa).INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 8968b9636880de0f8ea21aa3251718fa.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 4adbf50c8f9d915ec401ff564a44425c: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager a4413267110a784a536455ac57e44463@akka://flink/user/jobmanager_45 for job 8968b9636880de0f8ea21aa3251718fa from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
INFO:root:Done consuming work.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{5f65ec792e963f671a421c42e6a593cb}, jobId: 8968b9636880de0f8ea21aa3251718fa).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 8968b9636880de0f8ea21aa3251718fa from job leader monitoring.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 8968b9636880de0f8ea21aa3251718fa.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherb7e383a3-44c8-4e81-9836-77e8af5f96c3.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherb7e383a3-44c8-4e81-9836-77e8af5f96c3.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-5c45d742-3f01-4052-b0a1-1c45f4daab87
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherb7e383a3-44c8-4e81-9836-77e8af5f96c3.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confVTjVhj/test-metrics.txt
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:35729
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 337 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@42cbcb9d
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confVTjVhj
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548029121.38_0ec96838-1a48-4d11-9e24-d73efac295c1 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 39.917s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 40s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/jns7h2h6sw5ys
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #45
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/45/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 20, 2019 6:05:43 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:43215} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:42163.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:41797.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
INFO:root:Creating channel for localhost:43899
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7f1d980afe4e094e3fb66336bbe7b37a) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7f1d980afe4e094e3fb66336bbe7b37a).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7f1d980afe4e094e3fb66336bbe7b37a) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 7f1d980afe4e094e3fb66336bbe7b37a.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (7f1d980afe4e094e3fb66336bbe7b37a) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f9dbb333aeaa080c77ad0fa3fe05af7f) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f9dbb333aeaa080c77ad0fa3fe05af7f).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f9dbb333aeaa080c77ad0fa3fe05af7f) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} f9dbb333aeaa080c77ad0fa3fe05af7f.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (f9dbb333aeaa080c77ad0fa3fe05af7f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (da99ee952a421d1ea0a57beaa7daf6a5) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (da99ee952a421d1ea0a57beaa7daf6a5).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (da99ee952a421d1ea0a57beaa7daf6a5) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem da99ee952a421d1ea0a57beaa7daf6a5.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (da99ee952a421d1ea0a57beaa7daf6a5) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (c0ac6166672afe973cf169bad67ef0ce) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (c0ac6166672afe973cf169bad67ef0ce).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (c0ac6166672afe973cf169bad67ef0ce) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} c0ac6166672afe973cf169bad67ef0ce.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (467824e3dd36d63b0470966637c282b2) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (467824e3dd36d63b0470966637c282b2).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (467824e3dd36d63b0470966637c282b2) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 467824e3dd36d63b0470966637c282b2.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (c0ac6166672afe973cf169bad67ef0ce) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (467824e3dd36d63b0470966637c282b2) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 5d99e441-c14a-4505-ace6-8c8ae5565d37, test_windowing_1548007542.46, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548007543.448336539","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (588bc9648d0ddaa96cbf39a155514b1c) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (588bc9648d0ddaa96cbf39a155514b1c).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (588bc9648d0ddaa96cbf39a155514b1c) [FINISHED]
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1548007543.448336539","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 588bc9648d0ddaa96cbf39a155514b1c.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (588bc9648d0ddaa96cbf39a155514b1c) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1548007542.46 (19ad22cc9643695df51887b2846eff58) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 19ad22cc9643695df51887b2846eff58.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 19ad22cc9643695df51887b2846eff58 reached globally terminal state FINISHED.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1548007542.46(19ad22cc9643695df51887b2846eff58).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 19ad22cc9643695df51887b2846eff58.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection aac7748ca537da056a0a3a66683ff667: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher77f71a2f-6a8a-45ce-abcc-e9ed51eedcf9.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher77f71a2f-6a8a-45ce-abcc-e9ed51eedcf9.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{a5db897068ae41cf22526cfdacfbdef3}, jobId: 19ad22cc9643695df51887b2846eff58).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager bbbcd0abf9f4d60c644fa0c6b3744c43@akka://flink/user/jobmanager_45 for job 19ad22cc9643695df51887b2846eff58 from the resource manager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 19ad22cc9643695df51887b2846eff58 from job leader monitoring.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 19ad22cc9643695df51887b2846eff58.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-8fa091e5-a381-49b7-b283-cb9c72d74e81
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher77f71a2f-6a8a-45ce-abcc-e9ed51eedcf9.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confj4WNzs/test-metrics.txt
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:40751
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 347 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@72ff105
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confj4WNzs
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1548007516.35_ab6c8f41-57de-4e60-90b7-679f78e2ff9d failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 40.461s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 35s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/qvfmpaw6vb3vk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #44
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/44/display/redirect>
------------------------------------------
[...truncated 4.01 MB...]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 20, 2019 12:05:49 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:33269} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:40375.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:35339.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:37011
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (e9f38a76df108448e1ae1950e6fa1b11) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (e9f38a76df108448e1ae1950e6fa1b11).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (e9f38a76df108448e1ae1950e6fa1b11) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) e9f38a76df108448e1ae1950e6fa1b11.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (e9f38a76df108448e1ae1950e6fa1b11) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (974e125327c81f2ac176914c0b4e60a4) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (974e125327c81f2ac176914c0b4e60a4).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (974e125327c81f2ac176914c0b4e60a4) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 974e125327c81f2ac176914c0b4e60a4.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (974e125327c81f2ac176914c0b4e60a4) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (349db80be9df11a2f7b4456d4abf49bd) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (349db80be9df11a2f7b4456d4abf49bd).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (349db80be9df11a2f7b4456d4abf49bd) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 349db80be9df11a2f7b4456d4abf49bd.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (349db80be9df11a2f7b4456d4abf49bd) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4616a35776dd64fbba249caa0f519a9f) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4616a35776dd64fbba249caa0f519a9f).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4616a35776dd64fbba249caa0f519a9f) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 4616a35776dd64fbba249caa0f519a9f.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (164eb08f1f6064557b267d37f6d45f85) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (164eb08f1f6064557b267d37f6d45f85).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (164eb08f1f6064557b267d37f6d45f85) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 164eb08f1f6064557b267d37f6d45f85.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (4616a35776dd64fbba249caa0f519a9f) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (164eb08f1f6064557b267d37f6d45f85) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 644db081-161f-4a48-a48d-832b0a8b4d26, test_windowing_1547985948.41, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (80948460b3af2e5156faf1232e074d09) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (80948460b3af2e5156faf1232e074d09).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (80948460b3af2e5156faf1232e074d09) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547985949.463344525","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 80948460b3af2e5156faf1232e074d09.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547985949.463344525","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (80948460b3af2e5156faf1232e074d09) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1547985948.41 (1384ea1808cce969bed3338b5f1eb0a0) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 1384ea1808cce969bed3338b5f1eb0a0.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 1384ea1808cce969bed3338b5f1eb0a0 reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1547985948.41(1384ea1808cce969bed3338b5f1eb0a0).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1384ea1808cce969bed3338b5f1eb0a0.
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher02e7f03e-31b8-4cc3-959f-b194fc7cb292.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher02e7f03e-31b8-4cc3-959f-b194fc7cb292.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 7e3a09af5a0c42395a74535c2a86422c: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{483ac2ba0afbd7c3402611cc0af38d9d}, jobId: 1384ea1808cce969bed3338b5f1eb0a0).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 1384ea1808cce969bed3338b5f1eb0a0 from job leader monitoring.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1384ea1808cce969bed3338b5f1eb0a0.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager a3c041dea43b812ef122a923ff6b4224@akka://flink/user/jobmanager_45 for job 1384ea1808cce969bed3338b5f1eb0a0 from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-1c0dd901-0c55-40cf-a475-ac0ec6bc950a
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher02e7f03e-31b8-4cc3-959f-b194fc7cb292.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confdkcZ6k/test-metrics.txt
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:43259
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 351 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@d96ae896
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confdkcZ6k
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1547985921.01_d4d8d753-56e4-4a63-9295-ee41964b05d4 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 39.088s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 40s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/ontx5tgxhd7te
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #43
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/43/display/redirect>
------------------------------------------
[...truncated 4.01 MB...]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 20, 2019 6:05:48 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:41869} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:44177.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:39395.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:46453
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (d127e6da6583478bb519efd50bae8305) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (d127e6da6583478bb519efd50bae8305).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (d127e6da6583478bb519efd50bae8305) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) d127e6da6583478bb519efd50bae8305.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (d127e6da6583478bb519efd50bae8305) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (572ae26343fc5c0fe6f93be5b77a6c40) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (572ae26343fc5c0fe6f93be5b77a6c40).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (572ae26343fc5c0fe6f93be5b77a6c40) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 572ae26343fc5c0fe6f93be5b77a6c40.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (572ae26343fc5c0fe6f93be5b77a6c40) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a13833b4c5293b38026862524d264585) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a13833b4c5293b38026862524d264585).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a13833b4c5293b38026862524d264585) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem a13833b4c5293b38026862524d264585.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a13833b4c5293b38026862524d264585) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (9a4be5523cd1073f736ce1be3c41491a) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (9a4be5523cd1073f736ce1be3c41491a).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (9a4be5523cd1073f736ce1be3c41491a) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 9a4be5523cd1073f736ce1be3c41491a.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (fbf6d1b3f3dca53fbcb50be5365088c8) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (fbf6d1b3f3dca53fbcb50be5365088c8).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (fbf6d1b3f3dca53fbcb50be5365088c8) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem fbf6d1b3f3dca53fbcb50be5365088c8.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (9a4be5523cd1073f736ce1be3c41491a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (fbf6d1b3f3dca53fbcb50be5365088c8) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 0b643f90-49cc-4759-8982-f4d4164a698a, test_windowing_1547964348.01, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (be919e22c3be75539861fd6d5d51e705) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (be919e22c3be75539861fd6d5d51e705).
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547964348.998373002","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (be919e22c3be75539861fd6d5d51e705) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} be919e22c3be75539861fd6d5d51e705.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547964348.998373002","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (be919e22c3be75539861fd6d5d51e705) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1547964348.01 (59eba45c70c090892c070de2bdccae5c) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 59eba45c70c090892c070de2bdccae5c.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 59eba45c70c090892c070de2bdccae5c reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1547964348.01(59eba45c70c090892c070de2bdccae5c).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 59eba45c70c090892c070de2bdccae5c.
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 186147cdfff6e1048e416490ac62b230: JobManager is shutting down..
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{99e548a1a62d5b105cb3b48221e4d9df}, jobId: 59eba45c70c090892c070de2bdccae5c).
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatchereb7f9644-c638-49c0-9807-137a946555ce.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatchereb7f9644-c638-49c0-9807-137a946555ce.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 59eba45c70c090892c070de2bdccae5c from job leader monitoring.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 59eba45c70c090892c070de2bdccae5c.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 9aca52fe81961bf0edd95a163dba46e5@akka://flink/user/jobmanager_45 for job 59eba45c70c090892c070de2bdccae5c from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-37c5de15-5866-4146-bc89-c1e477a8e828
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatchereb7f9644-c638-49c0-9807-137a946555ce.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-conf0fD5rM/test-metrics.txt
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:43887
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 331 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@aa4a4dfa
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-conf0fD5rM
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1547964321.06_80e311c9-7352-4170-90a8-37e0a898ac70 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 39.275s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 33s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/eemgqjn7evjzk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #42
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/42/display/redirect?page=changes>
Changes:
[tweise] [BEAM-6418] Lower memory consumption of Flink integration tests (#7512)
------------------------------------------
[...truncated 4.02 MB...]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 20, 2019 12:51:00 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:34705} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:39307.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:36583.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
INFO:root:Creating channel for localhost:39815
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (82a9624ac078944fb9361728d73ad64c) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (82a9624ac078944fb9361728d73ad64c).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (82a9624ac078944fb9361728d73ad64c) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 82a9624ac078944fb9361728d73ad64c.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (82a9624ac078944fb9361728d73ad64c) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (9612837c531e989508108b1186e01621) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (9612837c531e989508108b1186e01621).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (9612837c531e989508108b1186e01621) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 9612837c531e989508108b1186e01621.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (9612837c531e989508108b1186e01621) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (9f19281cf36d09a6fa172917974f3c6f) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (9f19281cf36d09a6fa172917974f3c6f).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (9f19281cf36d09a6fa172917974f3c6f) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 9f19281cf36d09a6fa172917974f3c6f.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (9f19281cf36d09a6fa172917974f3c6f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef47913560890b127284df33f7739565) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef47913560890b127284df33f7739565).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef47913560890b127284df33f7739565) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} ef47913560890b127284df33f7739565.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (6b285dfe3552949286e946b0dfa2d7f5) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (6b285dfe3552949286e946b0dfa2d7f5).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (6b285dfe3552949286e946b0dfa2d7f5) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 6b285dfe3552949286e946b0dfa2d7f5.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ef47913560890b127284df33f7739565) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (6b285dfe3552949286e946b0dfa2d7f5) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 86818d5d-2b83-40c6-9c23-9b45629dfde0, test_windowing_1547945459.94, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (cdce4b92d3c3a60fc81a26da087b1b2d) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (cdce4b92d3c3a60fc81a26da087b1b2d).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (cdce4b92d3c3a60fc81a26da087b1b2d) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547945460.946045084","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} cdce4b92d3c3a60fc81a26da087b1b2d.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547945460.946045084","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (cdce4b92d3c3a60fc81a26da087b1b2d) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1547945459.94 (c811d313fa7e57a5729a36199dc0f467) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job c811d313fa7e57a5729a36199dc0f467.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job c811d313fa7e57a5729a36199dc0f467 reached globally terminal state FINISHED.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1547945459.94(c811d313fa7e57a5729a36199dc0f467).
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job c811d313fa7e57a5729a36199dc0f467.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection eacabe2291d3158e2277f7779950e421: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher370bbc51-8efe-4829-86e8-2e232c85642c.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher370bbc51-8efe-4829-86e8-2e232c85642c.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{a4a360aa8a83aea451abe27a77ed70b1}, jobId: c811d313fa7e57a5729a36199dc0f467).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 84e0c3290c954d0a83af2e7f328844c6@akka://flink/user/jobmanager_45 for job c811d313fa7e57a5729a36199dc0f467 from the resource manager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job c811d313fa7e57a5729a36199dc0f467 from job leader monitoring.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job c811d313fa7e57a5729a36199dc0f467 with leader id 84e0c3290c954d0a83af2e7f328844c6 lost leadership.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job c811d313fa7e57a5729a36199dc0f467.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-3c6efe5e-7f0d-4e41-8021-7c736989b59f
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher370bbc51-8efe-4829-86e8-2e232c85642c.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confXZ9sj7/test-metrics.txt
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:43339
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 337 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@3cb79c43
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confXZ9sj7
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1547945433.65_cba857ac-0417-4d1c-b95b-c9f5602533cb failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 38.122s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 40s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/wllferddimedo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #41
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/41/display/redirect?page=changes>
Changes:
[relax] Add field-specifier notation.
[relax] Revert changes to BeamModulePlugin.
[relax] vendor stuff
[relax] Fix vendored includes.
[relax] Fix CheckStyle and FindBugs.
[relax] Fix CheckSTyle.
------------------------------------------
[...truncated 4.02 MB...]
Jan 20, 2019 12:11:14 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:42039} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:35251.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:45953.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
INFO:root:Creating channel for localhost:33471
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (9c0bc5ac974c2c07c371be29f9b173d0) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (9c0bc5ac974c2c07c371be29f9b173d0).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (9c0bc5ac974c2c07c371be29f9b173d0) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 9c0bc5ac974c2c07c371be29f9b173d0.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (9c0bc5ac974c2c07c371be29f9b173d0) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (0b563c514ec16631a078f45f52f88cf4) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (0b563c514ec16631a078f45f52f88cf4).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (0b563c514ec16631a078f45f52f88cf4) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 0b563c514ec16631a078f45f52f88cf4.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (0b563c514ec16631a078f45f52f88cf4) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (d31f8c0995b3c667ba7fe8ff82e91cf5) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (d31f8c0995b3c667ba7fe8ff82e91cf5).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (d31f8c0995b3c667ba7fe8ff82e91cf5) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem d31f8c0995b3c667ba7fe8ff82e91cf5.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (d31f8c0995b3c667ba7fe8ff82e91cf5) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ca05065b8e72c3755b182f49156acc65) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ca05065b8e72c3755b182f49156acc65).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ca05065b8e72c3755b182f49156acc65) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} ca05065b8e72c3755b182f49156acc65.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (d8550d9f54407669579b8969d5c079b6) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (d8550d9f54407669579b8969d5c079b6).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (d8550d9f54407669579b8969d5c079b6) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem d8550d9f54407669579b8969d5c079b6.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (ca05065b8e72c3755b182f49156acc65) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (d8550d9f54407669579b8969d5c079b6) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, c0c6e61a-848d-4f66-a4a7-acc9156f2dbd, test_windowing_1547943073.53, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e82fb3e5352a0b5507ba52a361f582e8) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e82fb3e5352a0b5507ba52a361f582e8).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e82fb3e5352a0b5507ba52a361f582e8) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} e82fb3e5352a0b5507ba52a361f582e8.
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547943074.531592312","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547943074.531592312","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e82fb3e5352a0b5507ba52a361f582e8) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1547943073.53 (00b6e0358c74d7d0ab80e2b7c166ddfd) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 00b6e0358c74d7d0ab80e2b7c166ddfd.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 00b6e0358c74d7d0ab80e2b7c166ddfd reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1547943073.53(00b6e0358c74d7d0ab80e2b7c166ddfd).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 00b6e0358c74d7d0ab80e2b7c166ddfd.
INFO:root:Done consuming work.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection dd18fabb7769cf0013c45bd301b6ee55: JobManager is shutting down..
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcher0487f960-d6f5-4c29-abd0-8c4f06839b08.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 84e30a604ad5fbc3bf027a834330438f@akka://flink/user/jobmanager_45 for job 00b6e0358c74d7d0ab80e2b7c166ddfd from the resource manager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcher0487f960-d6f5-4c29-abd0-8c4f06839b08.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - JobManager for job 00b6e0358c74d7d0ab80e2b7c166ddfd with leader id 84e30a604ad5fbc3bf027a834330438f lost leadership.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{c0739a6b29207ad6cd1d53af59c0caca}, jobId: 00b6e0358c74d7d0ab80e2b7c166ddfd).
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 00b6e0358c74d7d0ab80e2b7c166ddfd from job leader monitoring.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 00b6e0358c74d7d0ab80e2b7c166ddfd.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-4ab7d011-ce05-4536-9525-75bc7e64bc35
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcher0487f960-d6f5-4c29-abd0-8c4f06839b08.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confqBJOnL/test-metrics.txt
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:45527
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 358 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@892786e2
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confqBJOnL
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1547943046.94_366771f8-0e27-4ba6-9080-208dc7f24e97 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 38.628s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 22s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/fl6uwquuhsjq4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #40
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/40/display/redirect>
------------------------------------------
[...truncated 4.02 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 20, 2019 12:05:42 AM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:39309} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:42377.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:35545.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
INFO:root:Creating channel for localhost:43823
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (70c53fed7fdb955bfcfc4852d59a344f) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (70c53fed7fdb955bfcfc4852d59a344f).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (70c53fed7fdb955bfcfc4852d59a344f) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 70c53fed7fdb955bfcfc4852d59a344f.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (70c53fed7fdb955bfcfc4852d59a344f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (6181fdc7e3f6a763a210445f315921b4) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (6181fdc7e3f6a763a210445f315921b4).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (6181fdc7e3f6a763a210445f315921b4) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 6181fdc7e3f6a763a210445f315921b4.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (6181fdc7e3f6a763a210445f315921b4) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (f22cf46e0d68bb89c457d1419a13ed92) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (f22cf46e0d68bb89c457d1419a13ed92).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (f22cf46e0d68bb89c457d1419a13ed92) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem f22cf46e0d68bb89c457d1419a13ed92.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (f22cf46e0d68bb89c457d1419a13ed92) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a77ae69314d0f3aa3ffdde879c5e2e79) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a77ae69314d0f3aa3ffdde879c5e2e79).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a77ae69314d0f3aa3ffdde879c5e2e79) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} a77ae69314d0f3aa3ffdde879c5e2e79.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (84b50c70274912da8a28b6ddf8e3a14b) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (84b50c70274912da8a28b6ddf8e3a14b).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (84b50c70274912da8a28b6ddf8e3a14b) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 84b50c70274912da8a28b6ddf8e3a14b.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a77ae69314d0f3aa3ffdde879c5e2e79) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (84b50c70274912da8a28b6ddf8e3a14b) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 068fd607-3561-4e24-a3c0-1e20e4da1a21, test_windowing_1547942741.9, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e14b0a16ae0e580a82afc2dccb82a2b4) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e14b0a16ae0e580a82afc2dccb82a2b4).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e14b0a16ae0e580a82afc2dccb82a2b4) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547942742.893071406","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} e14b0a16ae0e580a82afc2dccb82a2b4.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547942742.893071406","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (e14b0a16ae0e580a82afc2dccb82a2b4) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1547942741.9 (407924340b436f9d4342eee0b444ef2f) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 407924340b436f9d4342eee0b444ef2f.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 407924340b436f9d4342eee0b444ef2f reached globally terminal state FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1547942741.9(407924340b436f9d4342eee0b444ef2f).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 407924340b436f9d4342eee0b444ef2f.
INFO:root:Closing all cached gRPC state handlers.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 7f4b145398891729ac50794fe42ac353: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{cdf53f379a9b1bc9501f4107f98fdfb6}, jobId: 407924340b436f9d4342eee0b444ef2f).
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 8b01228767f0f466640d29102caa4f94@akka://flink/user/jobmanager_45 for job 407924340b436f9d4342eee0b444ef2f from the resource manager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 407924340b436f9d4342eee0b444ef2f from job leader monitoring.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 407924340b436f9d4342eee0b444ef2f.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-7d2d8a4f-67c9-4a40-b95f-81c5c956d13a
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherd7692093-be4a-414c-afd5-acfa188b67a1.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherd7692093-be4a-414c-afd5-acfa188b67a1.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherd7692093-be4a-414c-afd5-acfa188b67a1.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-conf5NApo7/test-metrics.txt
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:37229
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 326 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@ecf74645
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-conf5NApo7
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1547942714.41_d00112e1-5a09-4523-8bfe-836a1084ce91 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 39.286s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 35s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/czqsu2fpyxrsk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #39
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/39/display/redirect>
------------------------------------------
[...truncated 4.03 MB...]
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task ToKeyedWorkItem (1/1).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from CREATED to DEPLOYING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) [DEPLOYING]
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) [DEPLOYING].
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - The operator name [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} exceeded the 80 characters length limit and was truncated.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) [DEPLOYING].
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (006aa08460b3b13bcf216c958760ca71) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (006aa08460b3b13bcf216c958760ca71) switched from DEPLOYING to RUNNING.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) switched from CREATED to DEPLOYING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) [DEPLOYING]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880)
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) [DEPLOYING].
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880)
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) [DEPLOYING].
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) switched from DEPLOYING to RUNNING.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default (Memory / JobManager) MemoryStateBackend (data in heap memory / checkpoints to JobManager) (checkpoints: 'null', savepoints: 'null', asynchronous: TRUE, maxStateSize: 5242880)
INFO:root:Creating insecure control channel for localhost:34885.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:41219.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
INFO:root:Creating channel for localhost:41075
[grpc-default-executor-0] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (fa079aa815ec448bf90941d3a02ee13f) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (fa079aa815ec448bf90941d3a02ee13f).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (fa079aa815ec448bf90941d3a02ee13f) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) fa079aa815ec448bf90941d3a02ee13f.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (fa079aa815ec448bf90941d3a02ee13f) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bb7104545f6de0aeea5a53c3e3088eaa) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bb7104545f6de0aeea5a53c3e3088eaa).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bb7104545f6de0aeea5a53c3e3088eaa) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} bb7104545f6de0aeea5a53c3e3088eaa.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (bb7104545f6de0aeea5a53c3e3088eaa) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a5773c59aed557a37f68eda356b716ed) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a5773c59aed557a37f68eda356b716ed).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a5773c59aed557a37f68eda356b716ed) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem a5773c59aed557a37f68eda356b716ed.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (a5773c59aed557a37f68eda356b716ed) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (006aa08460b3b13bcf216c958760ca71) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (006aa08460b3b13bcf216c958760ca71).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (006aa08460b3b13bcf216c958760ca71) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} 006aa08460b3b13bcf216c958760ca71.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) [FINISHED]
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 20fe71c08cf703995f5ebf8aec662211.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (006aa08460b3b13bcf216c958760ca71) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (20fe71c08cf703995f5ebf8aec662211) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 40f37092-d269-4254-a7b2-e683de2f4b2d, test_windowing_1547921189.24, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547921190.441273251","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547921190.441273251","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 4cb462184bcbb5ade3368e21d707e243.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (4cb462184bcbb5ade3368e21d707e243) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1547921189.24 (1d73f29a157ed63792549044848493e6) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 1d73f29a157ed63792549044848493e6.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 1d73f29a157ed63792549044848493e6 reached globally terminal state FINISHED.
INFO:root:Closing all cached gRPC state handlers.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1547921189.24(1d73f29a157ed63792549044848493e6).INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1d73f29a157ed63792549044848493e6.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection b1c697ea173a2e238ac3cef6602ab090: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{8815e97cb15d8529578de5358d85b58e}, jobId: 1d73f29a157ed63792549044848493e6).
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 9968acb355a45dbdffbcc398b0ef4b85@akka://flink/user/jobmanager_45 for job 1d73f29a157ed63792549044848493e6 from the resource manager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 1d73f29a157ed63792549044848493e6 from job leader monitoring.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 1d73f29a157ed63792549044848493e6.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherb6ff28ec-1f01-484d-8b37-fcb436362343.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherb6ff28ec-1f01-484d-8b37-fcb436362343.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-59cbcf7d-e4c5-4fee-b9ef-6ac016e49c95
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-2] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherb6ff28ec-1f01-484d-8b37-fcb436362343.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-conf45Pr96/test-metrics.txt
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:40555
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 426 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@d96ae896
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-conf45Pr96
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1547921155.06_707080ba-f43a-419b-8d2c-223dc2c39d75 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 51.161s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 20s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/5l6l4mjrytoc2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #38
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/38/display/redirect?page=changes>
Changes:
[github] Install Beam test dependencies in Flink compatibility tests
------------------------------------------
[...truncated 4.01 MB...]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.state.heap.HeapKeyedStateBackend - Initializing heap keyed state backend with stream factory.
Jan 19, 2019 3:42:00 PM org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference cleanQueue
SEVERE: *~*~*~ Channel ManagedChannelImpl{logId=553, target=localhost:34169} was not shutdown properly!!! ~*~*~*
Make sure to call shutdown()/shutdownNow() and wait until awaitTermination() returns true.
java.lang.RuntimeException: ManagedChannel allocation site
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper$ManagedChannelReference.<init>(ManagedChannelOrphanWrapper.java:103)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:53)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.ManagedChannelOrphanWrapper.<init>(ManagedChannelOrphanWrapper.java:44)
at org.apache.beam.vendor.grpc.v1p13p1.io.grpc.internal.AbstractManagedChannelImplBuilder.build(AbstractManagedChannelImplBuilder.java:410)
at org.apache.beam.sdk.fn.channel.ManagedChannelFactory.forDescriptor(ManagedChannelFactory.java:44)
at org.apache.beam.runners.fnexecution.environment.ExternalEnvironmentFactory.createEnvironment(ExternalEnvironmentFactory.java:108)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$new$0(DefaultJobBundleFactory.java:104)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:149)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$1.load(DefaultJobBundleFactory.java:145)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3628)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2336)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2295)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2208)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.get(LocalCache.java:4053)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4057)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4986)
at org.apache.beam.vendor.guava.v20_0.com.google.common.cache.LocalCache$LocalLoadingCache.getUnchecked(LocalCache.java:4992)
at org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.forStage(DefaultJobBundleFactory.java:157)
at org.apache.beam.runners.flink.translation.functions.FlinkDefaultExecutableStageContext.getStageBundleFactory(FlinkDefaultExecutableStageContext.java:70)
at org.apache.beam.runners.flink.translation.functions.ReferenceCountingFlinkExecutableStageContextFactory$WrappedContext.getStageBundleFactory(ReferenceCountingFlinkExecutableStageContextFactory.java:203)
at org.apache.beam.runners.flink.translation.wrappers.streaming.ExecutableStageDoFnOperator.open(ExecutableStageDoFnOperator.java:184)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:420)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:296)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:712)
at java.lang.Thread.run(Thread.java:748)
INFO:root:Creating insecure control channel for localhost:38925.
INFO:root:Control channel established.
INFO:root:Initializing SDKHarness with 12 workers.
[grpc-default-executor-2] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 1
INFO:root:Creating insecure state channel for localhost:41517.
INFO:root:State channel established.
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:0:0
INFO:root:Creating channel for localhost:34353
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_2:0
[grpc-default-executor-1] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_1:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [1]Create/FlatMap(<lambda at core.py:2049>), 0]
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_17:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [4]assert_that/{Create, Group}, 0]
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [4]assert_that/{Create, Group}, 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_12:0
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (59ea5dcbd24f022b7a6c6666a5d1fd54) switched from RUNNING to FINISHED.
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (59ea5dcbd24f022b7a6c6666a5d1fd54).
[Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (59ea5dcbd24f022b7a6c6666a5d1fd54) [FINISHED]
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) 59ea5dcbd24f022b7a6c6666a5d1fd54.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [1]Create/FlatMap(<lambda at core.py:2049>) (1/1) (59ea5dcbd24f022b7a6c6666a5d1fd54) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_9:0
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn), 0]
WARNING:root:No unique name set for transform fn/write/ref_PCollection_PCollection_24:1:0
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (5229311fae42a171712aa7680a6aae17) switched from RUNNING to FINISHED.
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (5229311fae42a171712aa7680a6aae17).
[Source: Impulse -> [4]assert_that/{Create, Group} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (5229311fae42a171712aa7680a6aae17) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task Source: Impulse -> [4]assert_that/{Create, Group} 5229311fae42a171712aa7680a6aae17.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: Impulse -> [4]assert_that/{Create, Group} (1/1) (5229311fae42a171712aa7680a6aae17) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4528fafee4228ecec5ca57e61badac00) switched from RUNNING to FINISHED.
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4528fafee4228ecec5ca57e61badac00).
[[3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4528fafee4228ecec5ca57e61badac00) [FINISHED]
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem 4528fafee4228ecec5ca57e61badac00.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - [3]{Create, Map(<lambda at fn_api_runner_test.py:402>), WindowInto(WindowIntoFn)} -> ToKeyedWorkItem (1/1) (4528fafee4228ecec5ca57e61badac00) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_15:0
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that}, 0]
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a92bd8b40bf1cec8030a65bf51d10f52) switched from RUNNING to FINISHED.
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a92bd8b40bf1cec8030a65bf51d10f52).
[GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a92bd8b40bf1cec8030a65bf51d10f52) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} a92bd8b40bf1cec8030a65bf51d10f52.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - ToKeyedWorkItem (1/1) (62120a3c9325e4896a61029ff7734994) switched from RUNNING to FINISHED.
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for ToKeyedWorkItem (1/1) (62120a3c9325e4896a61029ff7734994).
[ToKeyedWorkItem (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task ToKeyedWorkItem (1/1) (62120a3c9325e4896a61029ff7734994) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task ToKeyedWorkItem 62120a3c9325e4896a61029ff7734994.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupByKey -> [5]{Map(<lambda at fn_api_runner_test.py:405>), assert_that} (1/1) (a92bd8b40bf1cec8030a65bf51d10f52) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - ToKeyedWorkItem (1/1) (62120a3c9325e4896a61029ff7734994) switched from RUNNING to FINISHED.
WARNING:root:No unique name set for transform fn/read/ref_PCollection_PCollection_27:0
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:start_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:process_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:ptransform_execution_time:total_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:element_count:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]assert_that/{Group, Unkey, Match}, 0]
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.flink.metrics.MetricGroup - Name collision: Group already contains a Metric with the name 'beam.metric:pardo_execution_time:finish_bundle_msecs:v1'. Metric will not be reported.[localhost, taskmanager, 12d3eaa4-6daa-4643-bf6a-06c5fda2f3f4, test_windowing_1547912519.42, [3]assert_that/{Group, Unkey, Match}, 0]
INFO:root:No more requests from control plane
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint.
INFO:root:SDK Harness waiting for in-flight requests to complete
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (197c4ba7e3b50a2ec23d4cdcba5c4f5a) switched from RUNNING to FINISHED.
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (197c4ba7e3b50a2ec23d4cdcba5c4f5a).
[assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (197c4ba7e3b50a2ec23d4cdcba5c4f5a) [FINISHED]
ERROR:root:Failed to read inputs in the data plane
Traceback (most recent call last):
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547912520.420819601","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and sending final execution state FINISHED to JobManager for task assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} 197c4ba7e3b50a2ec23d4cdcba5c4f5a.
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "apache_beam/runners/worker/data_plane.py", line 282, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "apache_beam/runners/worker/data_plane.py", line 269, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 367, in next
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/local/lib/python2.7/site-packages/grpc/_channel.py",> line 358, in _next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with:
status = StatusCode.CANCELLED
details = "Multiplexer hanging up"
debug_error_string = "{"created":"@1547912520.420819601","description":"Error received from peer","file":"src/core/lib/surface/call.cc","file_line":1036,"grpc_message":"Multiplexer hanging up","grpc_status":1}"
>
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - assert_that/Group/GroupByKey -> [3]assert_that/{Group, Unkey, Match} (1/1) (197c4ba7e3b50a2ec23d4cdcba5c4f5a) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job test_windowing_1547912519.42 (6ab3b1bf465c916bec79be059a6d9298) switched from state RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator - Stopping checkpoint coordinator for job 6ab3b1bf465c916bec79be059a6d9298.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore - Shutting down
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Job 6ab3b1bf465c916bec79be059a6d9298 reached globally terminal state FINISHED.
INFO:root:Closing all cached grpc data channels.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Stopping the JobMaster for job test_windowing_1547912519.42(6ab3b1bf465c916bec79be059a6d9298).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 6ab3b1bf465c916bec79be059a6d9298.
INFO:root:Closing all cached gRPC state handlers.
[flink-runner-job-server] INFO org.apache.flink.runtime.minicluster.MiniCluster - Shutting down Flink Mini Cluster
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Suspending SlotPool.
INFO:root:Done consuming work.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmaster.JobMaster - Close ResourceManager connection 8985b4205c9de20011f21794b166f589: JobManager is shutting down..
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{cpuCores=1.0, heapMemoryInMB=42, directMemoryInMB=0, nativeMemoryInMB=0, networkMemoryInMB=0}, allocationId: AllocationID{e596be2d8694d45663f0327063fd1be1}, jobId: 6ab3b1bf465c916bec79be059a6d9298).
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Remove job 6ab3b1bf465c916bec79be059a6d9298 from job leader monitoring.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcActor - The rpc endpoint org.apache.flink.runtime.jobmaster.slotpool.SlotPool has not been started yet. Discarding message org.apache.flink.runtime.rpc.messages.LocalRpcInvocation until processing is started.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Close JobManager connection for job 6ab3b1bf465c916bec79be059a6d9298.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Disconnect job manager 8b85166cd377dc5f37d252bf977342e4@akka://flink/user/jobmanager_45 for job 6ab3b1bf465c916bec79be059a6d9298 from the resource manager.
[flink-runner-job-server] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shutting down rest endpoint.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopping TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager - Shutting down TaskExecutorLocalStateStoresManager.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmaster.slotpool.SlotPool - Stopping SlotPool.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping dispatcher akka://flink/user/dispatcherd425710e-dfea-462b-a05e-c8150c72120d.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopping all currently running jobs of dispatcher akka://flink/user/dispatcherd425710e-dfea-462b-a05e-c8150c72120d.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Closing the SlotManager.
[flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager - Suspending the SlotManager.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-3bcd1271-68b5-4318-91fe-385975272b8c
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Shutting down the network environment and its components.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.JobLeaderService - Stop job leader service.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rest.handler.legacy.backpressure.StackTraceSampleCoordinator - Shutting down stack trace sample coordinator.
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Removing cache directory /tmp/flink-web-ui
[ForkJoinPool.commonPool-worker-9] INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint - Shut down complete.
[flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskexecutor.TaskExecutor - Stopped TaskExecutor akka://flink/user/taskmanager_44.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher - Stopped dispatcher akka://flink/user/dispatcherd425710e-dfea-462b-a05e-c8150c72120d.
[flink-akka.actor.default-dispatcher-2] INFO org.apache.beam.runners.flink.metrics.FileReporter - wrote metrics to /tmp/flinktest-confTw0Syv/test-metrics.txt
[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:33191
[flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Execution finished in 337 msecs
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - Final accumulator values:
[flink-runner-job-server] INFO org.apache.beam.runners.flink.FlinkRunner - __metricscontainers : org.apache.beam.runners.core.metrics.MetricsContainerStepMap@fee79adb
INFO:root:Job state changed to DONE
.INFO:root:removing conf dir: /tmp/flinktest-confTw0Syv
======================================================================
ERROR: test_flattened_side_input (__main__.FlinkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner_test.py", line 205, in test_flattened_side_input
label='CheckFlattenOfSideInput')
File "apache_beam/pipeline.py", line 425, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 349, in wait_until_finish
self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline test_flattened_side_input_1547912493.33_3f338bc9-d229-456e-8568-45e651c85c38 failed in state FAILED: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_12, PCollection=unique_name: "17side3/Map(decode).None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: BOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced
----------------------------------------------------------------------
Ran 28 tests in 40.483s
FAILED (errors=1, skipped=6)
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 49s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/ytdkzu4tncuyg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #37
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/37/display/redirect>
------------------------------------------
[...truncated 18.65 KB...]
Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: pluggy, six, virtualenv, py, tox, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.18.0 grpcio-tools-1.3.5 pluggy-0.8.1 protobuf-3.6.1 py-1.7.0 six-1.12.0 tox-3.0.0 virtualenv-16.2.0
> Task :beam-sdks-java-core:shadowJar
> Task :beam-vendor-sdks-java-extensions-protobuf:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-vendor-sdks-java-extensions-protobuf:classes
> Task :beam-sdks-java-extensions-google-cloud-platform-core:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/util/GcsUtil.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-sdks-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/BeamFnDataBufferingOutboundObserver.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-fn-execution:classes
> Task :beam-sdks-java-fn-execution:shadowJar
> Task :beam-sdks-java-extensions-google-cloud-platform-core:classes
> Task :beam-vendor-sdks-java-extensions-protobuf:shadowJar
> Task :beam-sdks-java-extensions-google-cloud-platform-core:shadowJar
> Task :beam-runners-core-construction-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-construction-java:classes
> Task :beam-runners-core-construction-java:shadowJar
> Task :beam-runners-core-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-java:classes
> Task :beam-runners-core-java:shadowJar
> Task :beam-sdks-java-harness:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-harness:classes
> Task :beam-sdks-java-harness:jar
> Task :beam-sdks-java-harness:shadowJar
> Task :beam-runners-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/ServerFactory.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-java-fn-execution:classes
> Task :beam-runners-java-fn-execution:shadowJar
> Task :beam-runners-flink_2.11:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-flink_2.11:classes
> Task :beam-runners-flink_2.11:shadowJar
> Task :beam-runners-flink_2.11-job-server:compileJava NO-SOURCE
> Task :beam-runners-flink_2.11-job-server:classes UP-TO-DATE
> Task :beam-runners-flink_2.11-job-server:shadowJar
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.11.0.dev0)
Collecting fastavro<0.22,>=0.21.4 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/81/9ecee4b61514da16e6e11b5bfd3cc35112bc9c2846d846ec7cc1cda0b106/fastavro-0.21.16-cp27-cp27mu-manylinux1_x86_64.whl
Collecting pyarrow<0.12.0,>=0.11.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/34/65/a3cd43e1834a748d9650e962ce43083063bf0c778e634d6ae5ca6e62438c/pyarrow-0.11.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.11.0.dev0)
Collecting httplib2<=0.11.3,>=0.8 (from apache-beam==2.11.0.dev0)
Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl
Collecting oauth2client<4,>=2.0.1 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Collecting pydot<1.3,>=1.2.0 (from apache-beam==2.11.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/61/28/1d3920e4d1d50b19bc5d24398a7cd85cc7b9a75a490570d5a30c57622d34/pytz-2018.9-py2.py3-none-any.whl
Collecting pyyaml<4.0.0,>=3.12 (from apache-beam==2.11.0.dev0)
Collecting pyvcf<0.7.0,>=0.6.8 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.11.0.dev0)
Collecting dill<=0.2.8.2,>=0.2.6 (from apache-beam==2.11.0.dev0)
Collecting typing<3.7.0,>=3.6.0 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/cc/3e/29f92b7aeda5b078c86d14f550bf85cff809042e3429ace7af6193c3bc9f/typing-3.6.6-py2-none-any.whl
Collecting numpy>=1.14 (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/85/163127d3fb0573deb9eca947cfc73aa3618eaaf8656501460574471d114a/numpy-1.16.0-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Collecting requests>=2.7.0 (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl
Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/f3/04/fddc1c2dd75b256eda4d360024692231a2c19a0c61ad7f4a162407c1ab58/pbr-5.1.1-py2.py3-none-any.whl
Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl
Collecting pyasn1>=0.1.7 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.0.5 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/59/84/339c2de112d7448d7d4c500b8016783d9eac8981f89ec1d58fdd4685d97f/pyasn1_modules-0.2.3-py2.py3-none-any.whl
Collecting rsa>=3.1.4 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Collecting pyparsing>=2.1.4 (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/de/0a/001be530836743d8be6c2d85069f46fecf84ac6c18c7f5fb8125ee11d854/pyparsing-2.3.1-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/e0/accfc1b56b57e9750eba272e24c4dddeac86852c2bebd1236674d7887e8a/certifi-2018.11.29-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting urllib3<1.25,>=1.21.1 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/62/00/ee1d7de624db8ba7090d1226aebefab96a2c71cd5cfa7629d6ad3f61b79e/urllib3-1.24.1-py2.py3-none-any.whl
Installing collected packages: crcmod, fastavro, numpy, pyarrow, docopt, certifi, chardet, idna, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, pyasn1, pyasn1-modules, rsa, oauth2client, pyparsing, pydot, pytz, pyyaml, pyvcf, avro, dill, typing, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam avro-1.8.2 certifi-2018.11.29 chardet-3.0.4 crcmod-1.7 dill-0.2.8.2 docopt-0.6.2 fastavro-0.21.16 funcsigs-1.0.2 hdfs-2.2.2 httplib2-0.11.3 idna-2.8 mock-2.0.0 numpy-1.16.0 oauth2client-3.0.0 pbr-5.1.1 pyarrow-0.11.1 pyasn1-0.4.5 pyasn1-modules-0.2.3 pydot-1.2.4 pyparsing-2.3.1 pytz-2018.9 pyvcf-0.6.8 pyyaml-3.13 requests-2.21.0 rsa-4.0 typing-3.6.6 urllib3-1.24.1
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK FAILED
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.7)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.21.16)
Requirement already satisfied: pyarrow<0.12.0,>=0.11.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.1)
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.2.2)
Requirement already satisfied: httplib2<=0.11.3,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.3)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.0.0)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Requirement already satisfied: pydot<1.3,>=1.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.2.4)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2018.9)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.13)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.6.8)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Requirement already satisfied: avro<2.0.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.8.2)
Requirement already satisfied: dill<=0.2.8.2,>=0.2.6 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.2.8.2)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.6)
Requirement already satisfied: numpy>=1.14 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.16.0)
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.21.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (5.1.1)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (1.0.2)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.4.5)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.2.3)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (4.0)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0) (2.3.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2018.11.29)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (3.0.4)
Requirement already satisfied: idna<2.9,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.8)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (1.24.1)
Installing collected packages: apache-beam
Found existing installation: apache-beam 2.11.0.dev0
Not uninstalling apache-beam at <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python,> outside environment <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738>
Can't uninstall 'apache-beam'. No files were found to uninstall.
Running setup.py develop for apache-beam
Successfully installed apache-beam
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 32s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/ukn5pvh5j2vsq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #36
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/36/display/redirect>
------------------------------------------
[...truncated 18.41 KB...]
Collecting enum34>=1.0.4 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: pluggy, six, virtualenv, py, tox, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.18.0 grpcio-tools-1.3.5 pluggy-0.8.1 protobuf-3.6.1 py-1.7.0 six-1.12.0 tox-3.0.0 virtualenv-16.2.0
> Task :beam-sdks-java-core:shadowJar
> Task :beam-vendor-sdks-java-extensions-protobuf:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-vendor-sdks-java-extensions-protobuf:classes
> Task :beam-sdks-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/BeamFnDataBufferingOutboundObserver.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-fn-execution:classes
> Task :beam-sdks-java-fn-execution:shadowJar
> Task :beam-sdks-java-extensions-google-cloud-platform-core:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/util/GcsUtil.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-sdks-java-extensions-google-cloud-platform-core:classes
> Task :beam-vendor-sdks-java-extensions-protobuf:shadowJar
> Task :beam-sdks-java-extensions-google-cloud-platform-core:shadowJar
> Task :beam-runners-core-construction-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-construction-java:classes
> Task :beam-runners-core-construction-java:shadowJar
> Task :beam-runners-core-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-java:classes
> Task :beam-runners-core-java:shadowJar
> Task :beam-sdks-java-harness:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-harness:classes
> Task :beam-sdks-java-harness:jar
> Task :beam-sdks-java-harness:shadowJar
> Task :beam-runners-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/ServerFactory.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-java-fn-execution:classes
> Task :beam-runners-java-fn-execution:shadowJar
> Task :beam-runners-flink_2.11:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-flink_2.11:classes
> Task :beam-runners-flink_2.11:shadowJar
> Task :beam-runners-flink_2.11-job-server:compileJava NO-SOURCE
> Task :beam-runners-flink_2.11-job-server:classes UP-TO-DATE
> Task :beam-runners-flink_2.11-job-server:shadowJar
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.11.0.dev0)
Collecting fastavro<0.22,>=0.21.4 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/81/9ecee4b61514da16e6e11b5bfd3cc35112bc9c2846d846ec7cc1cda0b106/fastavro-0.21.16-cp27-cp27mu-manylinux1_x86_64.whl
Collecting pyarrow<0.12.0,>=0.11.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/34/65/a3cd43e1834a748d9650e962ce43083063bf0c778e634d6ae5ca6e62438c/pyarrow-0.11.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.11.0.dev0)
Collecting httplib2<=0.11.3,>=0.8 (from apache-beam==2.11.0.dev0)
Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl
Collecting oauth2client<4,>=2.0.1 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Collecting pydot<1.3,>=1.2.0 (from apache-beam==2.11.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/61/28/1d3920e4d1d50b19bc5d24398a7cd85cc7b9a75a490570d5a30c57622d34/pytz-2018.9-py2.py3-none-any.whl
Collecting pyyaml<4.0.0,>=3.12 (from apache-beam==2.11.0.dev0)
Collecting pyvcf<0.7.0,>=0.6.8 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.11.0.dev0)
Collecting dill<=0.2.8.2,>=0.2.6 (from apache-beam==2.11.0.dev0)
Collecting typing<3.7.0,>=3.6.0 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/cc/3e/29f92b7aeda5b078c86d14f550bf85cff809042e3429ace7af6193c3bc9f/typing-3.6.6-py2-none-any.whl
Collecting numpy>=1.14 (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/85/163127d3fb0573deb9eca947cfc73aa3618eaaf8656501460574471d114a/numpy-1.16.0-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Collecting requests>=2.7.0 (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl
Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/f3/04/fddc1c2dd75b256eda4d360024692231a2c19a0c61ad7f4a162407c1ab58/pbr-5.1.1-py2.py3-none-any.whl
Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl
Collecting pyasn1>=0.1.7 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.0.5 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/59/84/339c2de112d7448d7d4c500b8016783d9eac8981f89ec1d58fdd4685d97f/pyasn1_modules-0.2.3-py2.py3-none-any.whl
Collecting rsa>=3.1.4 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Collecting pyparsing>=2.1.4 (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/de/0a/001be530836743d8be6c2d85069f46fecf84ac6c18c7f5fb8125ee11d854/pyparsing-2.3.1-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/e0/accfc1b56b57e9750eba272e24c4dddeac86852c2bebd1236674d7887e8a/certifi-2018.11.29-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting urllib3<1.25,>=1.21.1 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/62/00/ee1d7de624db8ba7090d1226aebefab96a2c71cd5cfa7629d6ad3f61b79e/urllib3-1.24.1-py2.py3-none-any.whl
Installing collected packages: crcmod, fastavro, numpy, pyarrow, docopt, certifi, chardet, idna, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, pyasn1, pyasn1-modules, rsa, oauth2client, pyparsing, pydot, pytz, pyyaml, pyvcf, avro, dill, typing, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam avro-1.8.2 certifi-2018.11.29 chardet-3.0.4 crcmod-1.7 dill-0.2.8.2 docopt-0.6.2 fastavro-0.21.16 funcsigs-1.0.2 hdfs-2.2.2 httplib2-0.11.3 idna-2.8 mock-2.0.0 numpy-1.16.0 oauth2client-3.0.0 pbr-5.1.1 pyarrow-0.11.1 pyasn1-0.4.5 pyasn1-modules-0.2.3 pydot-1.2.4 pyparsing-2.3.1 pytz-2018.9 pyvcf-0.6.8 pyyaml-3.13 requests-2.21.0 rsa-4.0 typing-3.6.6 urllib3-1.24.1
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK FAILED
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.7)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.21.16)
Requirement already satisfied: pyarrow<0.12.0,>=0.11.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.1)
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.2.2)
Requirement already satisfied: httplib2<=0.11.3,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.3)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.0.0)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Requirement already satisfied: pydot<1.3,>=1.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.2.4)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2018.9)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.13)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.6.8)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Requirement already satisfied: avro<2.0.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.8.2)
Requirement already satisfied: dill<=0.2.8.2,>=0.2.6 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.2.8.2)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.6)
Requirement already satisfied: numpy>=1.14 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.16.0)
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.21.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (5.1.1)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (1.0.2)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.4.5)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.2.3)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (4.0)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0) (2.3.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2018.11.29)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (3.0.4)
Requirement already satisfied: idna<2.9,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.8)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (1.24.1)
Installing collected packages: apache-beam
Found existing installation: apache-beam 2.11.0.dev0
Not uninstalling apache-beam at <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python,> outside environment <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738>
Can't uninstall 'apache-beam'. No files were found to uninstall.
Running setup.py develop for apache-beam
Successfully installed apache-beam
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 39s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/7qfdsnfpptmfi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #35
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/35/display/redirect?page=changes>
Changes:
[relax] Remove generated code from srcSets.
------------------------------------------
[...truncated 17.02 KB...]
> Task :beam-sdks-python:setupVirtualenv
Collecting tox==3.0.0
Using cached https://files.pythonhosted.org/packages/e6/41/4dcfd713282bf3213b0384320fa8841e4db032ddcb80bc08a540159d42a8/tox-3.0.0-py2.py3-none-any.whl
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Collecting pluggy<1.0,>=0.3.0 (from tox==3.0.0)
Using cached https://files.pythonhosted.org/packages/2d/60/f58d9e8197f911f9405bf7e02227b43a2acc2c2f1a8cbb1be5ecf6bfd0b8/pluggy-0.8.1-py2.py3-none-any.whl
Collecting six (from tox==3.0.0)
Using cached https://files.pythonhosted.org/packages/73/fb/00a976f728d0d1fecfe898238ce23f502a721c0ac0ecfedb80e0d88c64e9/six-1.12.0-py2.py3-none-any.whl
Collecting virtualenv>=1.11.2 (from tox==3.0.0)
Using cached https://files.pythonhosted.org/packages/6a/d1/e0d142ce7b8a5c76adbfad01d853bca84c7c0240e35577498e20bc2ade7d/virtualenv-16.2.0-py2.py3-none-any.whl
Collecting py>=1.4.17 (from tox==3.0.0)
Using cached https://files.pythonhosted.org/packages/3e/c7/3da685ef117d42ac8d71af525208759742dd235f8094221fdaafcd3dba8f/py-1.7.0-py2.py3-none-any.whl
Collecting grpcio>=1.3.5 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/ab/13/b4f3d8551e0663ad1a6ba8539057ecd0715bcdf3f2eea235f67b248f37cb/grpcio-1.18.0-cp27-cp27mu-manylinux1_x86_64.whl
Collecting protobuf>=3.2.0 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/b8/c2/b7f587c0aaf8bf2201405e8162323037fe8d17aa21d3c7dda811b8d01469/protobuf-3.6.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: setuptools>=18.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from virtualenv>=1.11.2->tox==3.0.0) (40.6.3)
Collecting enum34>=1.0.4 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: pluggy, six, virtualenv, py, tox, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.18.0 grpcio-tools-1.3.5 pluggy-0.8.1 protobuf-3.6.1 py-1.7.0 six-1.12.0 tox-3.0.0 virtualenv-16.2.0
> Task :beam-sdks-java-core:shadowJar
> Task :beam-sdks-java-extensions-google-cloud-platform-core:compileJava FROM-CACHE
> Task :beam-sdks-java-extensions-google-cloud-platform-core:classes UP-TO-DATE
> Task :beam-vendor-sdks-java-extensions-protobuf:compileJava FROM-CACHE
> Task :beam-vendor-sdks-java-extensions-protobuf:classes UP-TO-DATE
> Task :beam-sdks-java-fn-execution:compileJava FROM-CACHE
> Task :beam-sdks-java-fn-execution:classes UP-TO-DATE
> Task :beam-runners-core-construction-java:compileJava FROM-CACHE
> Task :beam-runners-core-construction-java:classes UP-TO-DATE
> Task :beam-sdks-java-fn-execution:shadowJar
> Task :beam-runners-core-construction-java:shadowJar
> Task :beam-vendor-sdks-java-extensions-protobuf:shadowJar
> Task :beam-sdks-java-extensions-google-cloud-platform-core:shadowJar
> Task :beam-runners-core-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-java:classes
> Task :beam-runners-core-java:shadowJar
> Task :beam-sdks-java-harness:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-harness:classes
> Task :beam-sdks-java-harness:jar
> Task :beam-sdks-java-harness:shadowJar
> Task :beam-runners-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/ServerFactory.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-java-fn-execution:classes
> Task :beam-runners-java-fn-execution:shadowJar
> Task :beam-runners-flink_2.11:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-flink_2.11:classes
> Task :beam-runners-flink_2.11:shadowJar
> Task :beam-runners-flink_2.11-job-server:compileJava NO-SOURCE
> Task :beam-runners-flink_2.11-job-server:classes UP-TO-DATE
> Task :beam-runners-flink_2.11-job-server:shadowJar
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.11.0.dev0)
Collecting fastavro<0.22,>=0.21.4 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/81/9ecee4b61514da16e6e11b5bfd3cc35112bc9c2846d846ec7cc1cda0b106/fastavro-0.21.16-cp27-cp27mu-manylinux1_x86_64.whl
Collecting pyarrow<0.12.0,>=0.11.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/34/65/a3cd43e1834a748d9650e962ce43083063bf0c778e634d6ae5ca6e62438c/pyarrow-0.11.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.11.0.dev0)
Collecting httplib2<=0.11.3,>=0.8 (from apache-beam==2.11.0.dev0)
Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl
Collecting oauth2client<4,>=2.0.1 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Collecting pydot<1.3,>=1.2.0 (from apache-beam==2.11.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/61/28/1d3920e4d1d50b19bc5d24398a7cd85cc7b9a75a490570d5a30c57622d34/pytz-2018.9-py2.py3-none-any.whl
Collecting pyyaml<4.0.0,>=3.12 (from apache-beam==2.11.0.dev0)
Collecting pyvcf<0.7.0,>=0.6.8 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.11.0.dev0)
Collecting dill<=0.2.8.2,>=0.2.6 (from apache-beam==2.11.0.dev0)
Collecting typing<3.7.0,>=3.6.0 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/cc/3e/29f92b7aeda5b078c86d14f550bf85cff809042e3429ace7af6193c3bc9f/typing-3.6.6-py2-none-any.whl
Collecting numpy>=1.14 (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/85/163127d3fb0573deb9eca947cfc73aa3618eaaf8656501460574471d114a/numpy-1.16.0-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Collecting requests>=2.7.0 (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl
Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/f3/04/fddc1c2dd75b256eda4d360024692231a2c19a0c61ad7f4a162407c1ab58/pbr-5.1.1-py2.py3-none-any.whl
Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl
Collecting pyasn1>=0.1.7 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.0.5 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/59/84/339c2de112d7448d7d4c500b8016783d9eac8981f89ec1d58fdd4685d97f/pyasn1_modules-0.2.3-py2.py3-none-any.whl
Collecting rsa>=3.1.4 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Collecting pyparsing>=2.1.4 (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/de/0a/001be530836743d8be6c2d85069f46fecf84ac6c18c7f5fb8125ee11d854/pyparsing-2.3.1-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/e0/accfc1b56b57e9750eba272e24c4dddeac86852c2bebd1236674d7887e8a/certifi-2018.11.29-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting urllib3<1.25,>=1.21.1 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/62/00/ee1d7de624db8ba7090d1226aebefab96a2c71cd5cfa7629d6ad3f61b79e/urllib3-1.24.1-py2.py3-none-any.whl
Installing collected packages: crcmod, fastavro, numpy, pyarrow, docopt, certifi, chardet, idna, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, pyasn1, pyasn1-modules, rsa, oauth2client, pyparsing, pydot, pytz, pyyaml, pyvcf, avro, dill, typing, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam avro-1.8.2 certifi-2018.11.29 chardet-3.0.4 crcmod-1.7 dill-0.2.8.2 docopt-0.6.2 fastavro-0.21.16 funcsigs-1.0.2 hdfs-2.2.2 httplib2-0.11.3 idna-2.8 mock-2.0.0 numpy-1.16.0 oauth2client-3.0.0 pbr-5.1.1 pyarrow-0.11.1 pyasn1-0.4.5 pyasn1-modules-0.2.3 pydot-1.2.4 pyparsing-2.3.1 pytz-2018.9 pyvcf-0.6.8 pyyaml-3.13 requests-2.21.0 rsa-4.0 typing-3.6.6 urllib3-1.24.1
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK FAILED
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.7)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.21.16)
Requirement already satisfied: pyarrow<0.12.0,>=0.11.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.1)
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.2.2)
Requirement already satisfied: httplib2<=0.11.3,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.3)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.0.0)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Requirement already satisfied: pydot<1.3,>=1.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.2.4)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2018.9)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.13)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.6.8)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Requirement already satisfied: avro<2.0.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.8.2)
Requirement already satisfied: dill<=0.2.8.2,>=0.2.6 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.2.8.2)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.6)
Requirement already satisfied: numpy>=1.14 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.16.0)
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.21.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (5.1.1)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (1.0.2)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.4.5)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.2.3)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (4.0)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0) (2.3.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2018.11.29)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (3.0.4)
Requirement already satisfied: idna<2.9,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.8)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (1.24.1)
Installing collected packages: apache-beam
Found existing installation: apache-beam 2.11.0.dev0
Not uninstalling apache-beam at <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python,> outside environment <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738>
Can't uninstall 'apache-beam'. No files were found to uninstall.
Running setup.py develop for apache-beam
Successfully installed apache-beam
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 28s
45 actionable tasks: 36 executed, 9 from cache
Publishing build scan...
https://gradle.com/s/yo6mrkrhs223u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #34
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/34/display/redirect?page=changes>
Changes:
[ankurgoenka] [BEAM-6471] Make pip location configurable
[ankurgoenka] [BEAM-6471] set pip location when using process worker
------------------------------------------
[...truncated 18.73 KB...]
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: pluggy, six, virtualenv, py, tox, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.18.0 grpcio-tools-1.3.5 pluggy-0.8.1 protobuf-3.6.1 py-1.7.0 six-1.12.0 tox-3.0.0 virtualenv-16.2.0
> Task :beam-sdks-java-core:shadowJar
> Task :beam-vendor-sdks-java-extensions-protobuf:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-vendor-sdks-java-extensions-protobuf:classes
> Task :beam-sdks-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/fn-execution/src/main/java/org/apache/beam/sdk/fn/data/BeamFnDataBufferingOutboundObserver.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-fn-execution:classes
> Task :beam-sdks-java-extensions-google-cloud-platform-core:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/util/GcsUtil.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
> Task :beam-sdks-java-extensions-google-cloud-platform-core:classes
> Task :beam-sdks-java-fn-execution:shadowJar
> Task :beam-vendor-sdks-java-extensions-protobuf:shadowJar
> Task :beam-runners-core-construction-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-construction-java:classes
> Task :beam-sdks-java-extensions-google-cloud-platform-core:shadowJar
> Task :beam-runners-core-construction-java:shadowJar
> Task :beam-runners-core-java:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-core-java:classes
> Task :beam-runners-core-java:shadowJar
> Task :beam-sdks-java-harness:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-sdks-java-harness:classes
> Task :beam-sdks-java-harness:jar
> Task :beam-sdks-java-harness:shadowJar
> Task :beam-runners-java-fn-execution:compileJava
Note: <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/ServerFactory.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-java-fn-execution:classes
> Task :beam-runners-java-fn-execution:shadowJar
> Task :beam-runners-flink_2.11:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
> Task :beam-runners-flink_2.11:classes
> Task :beam-runners-flink_2.11:shadowJar
> Task :beam-runners-flink_2.11-job-server:compileJava NO-SOURCE
> Task :beam-runners-flink_2.11-job-server:classes UP-TO-DATE
> Task :beam-runners-flink_2.11-job-server:shadowJar
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Collecting crcmod<2.0,>=1.7 (from apache-beam==2.11.0.dev0)
Collecting fastavro<0.22,>=0.21.4 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/81/9ecee4b61514da16e6e11b5bfd3cc35112bc9c2846d846ec7cc1cda0b106/fastavro-0.21.16-cp27-cp27mu-manylinux1_x86_64.whl
Collecting pyarrow<0.12.0,>=0.11.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/34/65/a3cd43e1834a748d9650e962ce43083063bf0c778e634d6ae5ca6e62438c/pyarrow-0.11.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.11.0.dev0)
Collecting httplib2<=0.11.3,>=0.8 (from apache-beam==2.11.0.dev0)
Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/e6/35/f187bdf23be87092bd0f1200d43d23076cee4d0dec109f195173fd3ebc79/mock-2.0.0-py2.py3-none-any.whl
Collecting oauth2client<4,>=2.0.1 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Collecting pydot<1.3,>=1.2.0 (from apache-beam==2.11.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/61/28/1d3920e4d1d50b19bc5d24398a7cd85cc7b9a75a490570d5a30c57622d34/pytz-2018.9-py2.py3-none-any.whl
Collecting pyyaml<4.0.0,>=3.12 (from apache-beam==2.11.0.dev0)
Collecting pyvcf<0.7.0,>=0.6.8 (from apache-beam==2.11.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.11.0.dev0)
Collecting dill<=0.2.8.2,>=0.2.6 (from apache-beam==2.11.0.dev0)
Collecting typing<3.7.0,>=3.6.0 (from apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/cc/3e/29f92b7aeda5b078c86d14f550bf85cff809042e3429ace7af6193c3bc9f/typing-3.6.6-py2-none-any.whl
Collecting numpy>=1.14 (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/85/163127d3fb0573deb9eca947cfc73aa3618eaaf8656501460574471d114a/numpy-1.16.0-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Collecting docopt (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Collecting requests>=2.7.0 (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7d/e3/20f3d364d6c8e5d2353c72a67778eb189176f08e873c9900e10c0287b84b/requests-2.21.0-py2.py3-none-any.whl
Collecting pbr>=0.11 (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/f3/04/fddc1c2dd75b256eda4d360024692231a2c19a0c61ad7f4a162407c1ab58/pbr-5.1.1-py2.py3-none-any.whl
Collecting funcsigs>=1; python_version < "3.3" (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/69/cb/f5be453359271714c01b9bd06126eaf2e368f1fddfff30818754b5ac2328/funcsigs-1.0.2-py2.py3-none-any.whl
Collecting pyasn1>=0.1.7 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/7b/7c/c9386b82a25115cccf1903441bba3cbadcfae7b678a20167347fa8ded34c/pyasn1-0.4.5-py2.py3-none-any.whl
Collecting pyasn1-modules>=0.0.5 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/59/84/339c2de112d7448d7d4c500b8016783d9eac8981f89ec1d58fdd4685d97f/pyasn1_modules-0.2.3-py2.py3-none-any.whl
Collecting rsa>=3.1.4 (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/02/e5/38518af393f7c214357079ce67a317307936896e961e35450b70fad2a9cf/rsa-4.0-py2.py3-none-any.whl
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Collecting pyparsing>=2.1.4 (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/de/0a/001be530836743d8be6c2d85069f46fecf84ac6c18c7f5fb8125ee11d854/pyparsing-2.3.1-py2.py3-none-any.whl
Collecting certifi>=2017.4.17 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/9f/e0/accfc1b56b57e9750eba272e24c4dddeac86852c2bebd1236674d7887e8a/certifi-2018.11.29-py2.py3-none-any.whl
Collecting chardet<3.1.0,>=3.0.2 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl
Collecting idna<2.9,>=2.5 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl
Collecting urllib3<1.25,>=1.21.1 (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0)
Using cached https://files.pythonhosted.org/packages/62/00/ee1d7de624db8ba7090d1226aebefab96a2c71cd5cfa7629d6ad3f61b79e/urllib3-1.24.1-py2.py3-none-any.whl
Installing collected packages: crcmod, fastavro, numpy, pyarrow, docopt, certifi, chardet, idna, urllib3, requests, hdfs, httplib2, pbr, funcsigs, mock, pyasn1, pyasn1-modules, rsa, oauth2client, pyparsing, pydot, pytz, pyyaml, pyvcf, avro, dill, typing, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam avro-1.8.2 certifi-2018.11.29 chardet-3.0.4 crcmod-1.7 dill-0.2.8.2 docopt-0.6.2 fastavro-0.21.16 funcsigs-1.0.2 hdfs-2.2.2 httplib2-0.11.3 idna-2.8 mock-2.0.0 numpy-1.16.0 oauth2client-3.0.0 pbr-5.1.1 pyarrow-0.11.1 pyasn1-0.4.5 pyasn1-modules-0.2.3 pydot-1.2.4 pyparsing-2.3.1 pytz-2018.9 pyvcf-0.6.8 pyyaml-3.13 requests-2.21.0 rsa-4.0 typing-3.6.6 urllib3-1.24.1
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK FAILED
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK
Obtaining file://<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python>
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.7)
Requirement already satisfied: fastavro<0.22,>=0.21.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.21.16)
Requirement already satisfied: pyarrow<0.12.0,>=0.11.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.1)
Requirement already satisfied: grpcio<2,>=1.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.18.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.2.2)
Requirement already satisfied: httplib2<=0.11.3,>=0.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.11.3)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2.0.0)
Requirement already satisfied: oauth2client<4,>=2.0.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.0.0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.1)
Requirement already satisfied: pydot<1.3,>=1.2.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.2.4)
Requirement already satisfied: pytz>=2018.3 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (2018.9)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.13)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.6.8)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.2.0)
Requirement already satisfied: future<1.0.0,>=0.16.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.16.0)
Requirement already satisfied: avro<2.0.0,>=1.8.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (1.8.2)
Requirement already satisfied: dill<=0.2.8.2,>=0.2.6 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (0.2.8.2)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from apache-beam==2.11.0.dev0) (3.6.6)
Requirement already satisfied: numpy>=1.14 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.16.0)
Requirement already satisfied: six>=1.0.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pyarrow<0.12.0,>=0.11.1->apache-beam==2.11.0.dev0) (1.12.0)
Requirement already satisfied: enum34>=1.0.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from grpcio<2,>=1.8->apache-beam==2.11.0.dev0) (1.1.6)
Requirement already satisfied: docopt in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (0.6.2)
Requirement already satisfied: requests>=2.7.0 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.21.0)
Requirement already satisfied: pbr>=0.11 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (5.1.1)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from mock<3.0.0,>=1.0.1->apache-beam==2.11.0.dev0) (1.0.2)
Requirement already satisfied: pyasn1>=0.1.7 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.4.5)
Requirement already satisfied: pyasn1-modules>=0.0.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (0.2.3)
Requirement already satisfied: rsa>=3.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from oauth2client<4,>=2.0.1->apache-beam==2.11.0.dev0) (4.0)
Requirement already satisfied: setuptools in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from protobuf<4,>=3.5.0.post1->apache-beam==2.11.0.dev0) (40.6.3)
Requirement already satisfied: pyparsing>=2.1.4 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from pydot<1.3,>=1.2.0->apache-beam==2.11.0.dev0) (2.3.1)
Requirement already satisfied: certifi>=2017.4.17 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2018.11.29)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (3.0.4)
Requirement already satisfied: idna<2.9,>=2.5 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (2.8)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738/lib/python2.7/site-packages> (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.11.0.dev0) (1.24.1)
Installing collected packages: apache-beam
Found existing installation: apache-beam 2.11.0.dev0
Not uninstalling apache-beam at <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python,> outside environment <https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/build/gradleenv/1327086738>
Can't uninstall 'apache-beam'. No files were found to uninstall.
Running setup.py develop for apache-beam
Successfully installed apache-beam
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/apache_beam/runners/portability/flink_runner_test.py",> line 37, in <module>
from apache_beam.runners.portability import portable_runner_test
File "apache_beam/runners/portability/portable_runner_test.py", line 42, in <module>
from apache_beam.runners.portability import fn_api_runner_test
File "apache_beam/runners/portability/fn_api_runner_test.py", line 29, in <module>
from tenacity import retry
ImportError: No module named tenacity
> Task :beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixBatchLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/build.gradle'> line: 347
* What went wrong:
Execution failed for task ':beam-sdks-python:flinkCompatibilityMatrixStreamingLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 36s
45 actionable tasks: 40 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/ugv7knviishcg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org