You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/04/11 18:17:56 UTC
Build failed in Jenkins: beam_PerformanceTests_XmlIOIT #1586
See <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/1586/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-6935] Spark portable runner: implement side inputs
[robinyqiu] Update the spec for extract_output and make it clear the input
[jbonofre] [BEAM-7041] Let the user control if he wants to wrap the provided
[lcwik] Update dataflow worker container version (#8275)
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9893e2c52ee8a0c1e83de043af628c1a09b39892 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9893e2c52ee8a0c1e83de043af628c1a09b39892
Commit message: "Update dataflow worker container version (#8275)"
> git rev-list --no-walk 120394be6ca979892bce98bdea6ca01439b22476 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_XmlIOIT] $ /bin/bash -xe /tmp/jenkins1135977339582407057.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker>
[beam_PerformanceTests_XmlIOIT] $ /bin/bash -xe /tmp/jenkins4626196621925156546.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/env/.perfkit_env>
[beam_PerformanceTests_XmlIOIT] $ /bin/bash -xe /tmp/jenkins2754850861815390762.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_XmlIOIT] $ /bin/bash -xe /tmp/jenkins5584313171578581156.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_XmlIOIT] $ /bin/bash -xe /tmp/jenkins296026099414654804.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_XmlIOIT] $ /bin/bash -xe /tmp/jenkins5633825140852023602.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-aahytpiy/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PerformanceTests_XmlIOIT
#1588
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/1588/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_XmlIOIT #1587
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/1587/display/redirect?page=changes>
Changes:
[lukasz.gajowy] [BEAM-6677] Pulling job server in beam init action
[lukasz.gajowy] [BEAM-6677] Quickfix: Prevent not finding nodes during Flink
[lukasz.gajowy] [BEAM-6677] Add GCLOUD_ZONE and DATAPROC_VERSION for easier
[lukasz.gajowy] [BEAM-6677] Add JobServer support to create_flink_cluster.sh
[robbe.sneyders] Add Python 3.6 and 3.7 test suites
[robbe.sneyders] Skip tests failing on Python 3.7
[robbe.sneyders] Deactivate Python 3.6 and 3.7 cython test suites.
[ajamato] [BEAM-4374] Add Beam Distribution Accumulator to use in python's counter
[github] Refactoring code from direct runner, and adding unit test for processing
[kcweaver] [BEAM-7053] prevent errors in Spark options
------------------------------------------
[...truncated 295.64 KB...]
INFO: 2019-04-12T00:19:29.770Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Read ranges into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:29.808Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:29.845Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:29.893Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Gather bundles into Write xml files/WriteFiles/GatherTempFileResults/Drop key/Values/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:29.942Z: Fusing consumer Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key into Write xml files/WriteFiles/FinalizeTempFileBundles/Finalize
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:29.976Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.018Z: Fusing consumer Gather write end time into Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.068Z: Fusing consumer Write xml files/WriteFiles/FinalizeTempFileBundles/Finalize into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.101Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.134Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign into Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.182Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.223Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.269Z: Fusing consumer Gather read start time into Read matched files/ParDo(ToReadableFile)
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.316Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.364Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.411Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key into Read xml files/ReadAllViaFileBasedSource/Split into ranges
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.466Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.511Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Split into ranges into Gather read start time
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.562Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.600Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.648Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.697Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into Find files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.743Z: Fusing consumer Read matched files/ParDo(ToReadableFile) into Find files/Reshuffle.ViaRandomKey/Values/Values/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.789Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.829Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key into Write xml files/WriteFiles/GatherTempFileResults/Gather bundles
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.874Z: Fusing consumer Find files/Reshuffle.ViaRandomKey/Pair with random key into Find files/Match filepatterns
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.921Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Drop key/Values/Map into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.956Z: Unzipping flatten s8 for input s4.writtenRecords
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:30.999Z: Fusing unzipped copy of Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map, through flatten Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/Flatten.PCollections, into producer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.045Z: Fusing consumer Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify into Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.087Z: Fusing consumer Get file names/Values/Map into Gather write end time
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.130Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable into Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.179Z: Fusing consumer Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.215Z: Fusing consumer Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map into Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.250Z: Fusing consumer Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.301Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.349Z: Fusing consumer Gather write start time into Create xml records/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.395Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.429Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles into Gather write start time
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.479Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.528Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.576Z: Fusing consumer Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow into Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.625Z: Fusing consumer Create xml records/Map into Generate sequence/Read(BoundedCountingSource)
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.672Z: Fusing consumer PAssert$0/GroupGlobally/Window.Into()/Window.Assign into Calculate hashcode/ProduceDefault
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.718Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map into Calculate hashcode/ProduceDefault
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.757Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.798Z: Fusing consumer View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify into View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.841Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign into PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.888Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write into PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.939Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous) into PAssert$0/GroupGlobally/Window.Into()/Window.Assign
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:31.982Z: Fusing consumer PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify into PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.022Z: Fusing consumer Calculate hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.069Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Reify into PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.112Z: Fusing consumer PAssert$0/GroupGlobally/GroupDummyAndContents/Write into PAssert$0/GroupGlobally/GroupDummyAndContents/Reify
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.158Z: Fusing consumer PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign into PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.722Z: Executing operation Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.773Z: Executing operation Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.821Z: Starting 1 workers in us-central1-b...
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.822Z: Executing operation Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.868Z: Executing operation Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.912Z: Executing operation Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:32.966Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:33.010Z: Executing operation Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:33.055Z: Executing operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:33.088Z: Executing operation PAssert$0/GroupGlobally/GroupDummyAndContents/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:33.126Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:33.178Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:33.739Z: Executing operation Generate sequence/Read(BoundedCountingSource)+Create xml records/Map+Gather write start time+Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write+Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Apr 12, 2019 12:19:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:33.786Z: Executing operation PAssert$0/GroupGlobally/Create.Values/Read(CreateSource)+PAssert$0/GroupGlobally/WindowIntoDummy/Window.Assign+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
Apr 12, 2019 12:19:51 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:19:49.488Z: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
Apr 12, 2019 12:20:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:20:35.155Z: Workers have started successfully.
Apr 12, 2019 12:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:21:00.622Z: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
Apr 12, 2019 12:21:03 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:21:00.654Z: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
Apr 12, 2019 12:21:08 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:21:06.513Z: Workers have started successfully.
Apr 12, 2019 12:23:29 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:23:28.008Z: Autoscaling: Resizing worker pool from 1 to 2.
Apr 12, 2019 12:24:23 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:24:23.083Z: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
Apr 12, 2019 12:26:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:21.105Z: Executing operation Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Apr 12, 2019 12:26:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:21.206Z: Executing operation Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+Write xml files/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+Write xml files/WriteFiles/GatherTempFileResults/Add void key/AddKeys/Map+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/Window.Into()/Window.Assign+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Reify+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Write
Apr 12, 2019 12:26:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:21.698Z: Executing operation Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Close
Apr 12, 2019 12:26:21 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:21.797Z: Executing operation Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/Read+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/GroupByKey/GroupByWindow+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle/ExpandIterable+Write xml files/WriteFiles/GatherTempFileResults/Drop key/Values/Map+Write xml files/WriteFiles/GatherTempFileResults/Gather bundles+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Pair with random key+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Apr 12, 2019 12:26:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:23.991Z: Executing operation Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Apr 12, 2019 12:26:24 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:24.090Z: Executing operation Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write xml files/WriteFiles/GatherTempFileResults/Reshuffle.ViaRandomKey/Values/Values/Map+Write xml files/WriteFiles/FinalizeTempFileBundles/Finalize+Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Pair with random key+Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Apr 12, 2019 12:26:26 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:26.519Z: Executing operation Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Apr 12, 2019 12:26:27 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:26.622Z: Executing operation Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Write xml files/WriteFiles/FinalizeTempFileBundles/Reshuffle.ViaRandomKey/Values/Values/Map+Gather write end time+Get file names/Values/Map+Find files/Match filepatterns+Find files/Reshuffle.ViaRandomKey/Pair with random key+Find files/Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Apr 12, 2019 12:26:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:30.506Z: Executing operation Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Apr 12, 2019 12:26:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:30.605Z: Executing operation Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Find files/Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Find files/Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Find files/Reshuffle.ViaRandomKey/Values/Values/Map+Read matched files/ParDo(ToReadableFile)+Gather read start time+Read xml files/ReadAllViaFileBasedSource/Split into ranges+Read xml files/ReadAllViaFileBasedSource/Reshuffle/Pair with random key+Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/Window.Into()/Window.Assign+Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Reify+Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Write
Apr 12, 2019 12:26:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:32.000Z: Executing operation Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Close
Apr 12, 2019 12:26:33 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:26:32.115Z: Executing operation Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/Read+Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/GroupByKey/GroupByWindow+Read xml files/ReadAllViaFileBasedSource/Reshuffle/Reshuffle/ExpandIterable+Read xml files/ReadAllViaFileBasedSource/Reshuffle/Values/Values/Map+Read xml files/ReadAllViaFileBasedSource/Read ranges+Gather read end time+Map xml records to strings/Map+Calculate hashcode/WithKeys/AddKeys/Map+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Write
Apr 12, 2019 12:29:30 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:29:27.664Z: Autoscaling: Resizing worker pool from 2 to 3.
Apr 12, 2019 12:30:22 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:30:22.501Z: Autoscaling: Raised the number of workers to 3 based on the rate of progress in the currently running step(s).
Apr 12, 2019 12:31:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:35.140Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Close
Apr 12, 2019 12:31:36 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:35.234Z: Executing operation Calculate hashcode/Combine.perKey(Hashing)/GroupByKey/Read+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues+Calculate hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Calculate hashcode/Values/Values/Map+Calculate hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/Window.Into()/Window.Assign+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write+PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Apr 12, 2019 12:31:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:38.688Z: Executing operation Calculate hashcode/View.AsIterable/CreateDataflowView
Apr 12, 2019 12:31:39 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:38.899Z: Executing operation Calculate hashcode/CreateVoid/Read(CreateSource)+Calculate hashcode/ProduceDefault+PAssert$0/GroupGlobally/Window.Into()/Window.Assign+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write+PAssert$0/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)+PAssert$0/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map+PAssert$0/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Reify+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Write
Apr 12, 2019 12:31:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:40.517Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Apr 12, 2019 12:31:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:40.629Z: Executing operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Close
Apr 12, 2019 12:31:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:40.688Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Apr 12, 2019 12:31:41 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:40.753Z: Executing operation PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/Read+PAssert$0/GroupGlobally/GatherAllOutputs/GroupByKey/GroupByWindow+PAssert$0/GroupGlobally/GatherAllOutputs/Values/Values/Map+PAssert$0/GroupGlobally/RewindowActuals/Window.Assign+PAssert$0/GroupGlobally/KeyForDummy/AddKeys/Map+PAssert$0/GroupGlobally/GroupDummyAndContents/Reify+PAssert$0/GroupGlobally/GroupDummyAndContents/Write
Apr 12, 2019 12:31:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:41.117Z: Executing operation PAssert$0/GroupGlobally/GroupDummyAndContents/Close
Apr 12, 2019 12:31:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:41.206Z: Executing operation PAssert$0/GroupGlobally/GroupDummyAndContents/Read+PAssert$0/GroupGlobally/GroupDummyAndContents/GroupByWindow+PAssert$0/GroupGlobally/Values/Values/Map+PAssert$0/GroupGlobally/ParDo(Concat)+PAssert$0/GetPane/Map+PAssert$0/RunChecks+PAssert$0/VerifyAssertions/ParDo(DefaultConclude)
Apr 12, 2019 12:31:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:41.969Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Apr 12, 2019 12:31:42 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:42.100Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Apr 12, 2019 12:31:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:45.189Z: Executing operation View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Apr 12, 2019 12:31:46 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:45.430Z: Executing operation Delete test files
Apr 12, 2019 12:31:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:47.620Z: Cleaning up.
Apr 12, 2019 12:31:49 AM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2019-04-12T00:31:47.751Z: Stopping worker pool...
STDERR:
2019-04-12 00:37:58,415 e5830d0d MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 754, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 605, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-04-12 00:37:58,417 e5830d0d MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2019-04-12 00:37:58,420 e5830d0d MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 897, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 754, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 605, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 160, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2019-04-12 00:37:58,421 e5830d0d MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2019-04-12 00:37:58,422 e5830d0d MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2019-04-12 00:37:58,422 e5830d0d MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/runs/e5830d0d/pkb.log>
2019-04-12 00:37:58,422 e5830d0d MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_XmlIOIT/ws/runs/e5830d0d/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org