You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/11/05 12:55:00 UTC
Build failed in Jenkins: beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11 #503
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/503/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Move logging to its own module.
[Robert Bradshaw] Cleanup worker logging.
[Robert Bradshaw] Add basic counter setting and getting to the typescript SDK.
[Robert Bradshaw] Support metrics over the portability API.
[Robert Bradshaw] Add distribution metric type.
[Robert Bradshaw] old prettier change
[noreply] Immediately truncate full restriction on drain of periodic impulse
[noreply] [Task]: PR Bot will push commits only if they are non-empty (#23937)
[noreply] Bump cloud.google.com/go/datastore from 1.8.0 to 1.9.0 in /sdks (#23916)
[Robert Bradshaw] Remove obsolete TODO.
[Robert Bradshaw] Only report counters that were actually used.
[noreply] Add custom inference fn suport to the sklearn model handlers (#23642)
[noreply] removed trailing whitespace (#23987)
[noreply] Beam starter projects blog post (#23964)
[noreply] Enable more portable-runner requiring tests. (#23970)
[noreply] Website add and update logos (#23899)
------------------------------------------
[...truncated 177.80 KB...]
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:58.856Z: Fusing consumer Step: 116/ParMultiDo(CounterOperation) into Step: 115/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:58.888Z: Fusing consumer Step: 117/ParMultiDo(CounterOperation) into Step: 116/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:58.924Z: Fusing consumer Step: 118/ParMultiDo(CounterOperation) into Step: 117/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:58.958Z: Fusing consumer Step: 119/ParMultiDo(CounterOperation) into Step: 118/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:58.995Z: Fusing consumer Step: 120/ParMultiDo(CounterOperation) into Step: 119/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.027Z: Fusing consumer Step: 121/ParMultiDo(CounterOperation) into Step: 120/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.060Z: Fusing consumer Step: 122/ParMultiDo(CounterOperation) into Step: 121/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.093Z: Fusing consumer Step: 123/ParMultiDo(CounterOperation) into Step: 122/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.128Z: Fusing consumer Step: 124/ParMultiDo(CounterOperation) into Step: 123/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.152Z: Fusing consumer Step: 125/ParMultiDo(CounterOperation) into Step: 124/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.185Z: Fusing consumer Step: 126/ParMultiDo(CounterOperation) into Step: 125/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.218Z: Fusing consumer Step: 127/ParMultiDo(CounterOperation) into Step: 126/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.253Z: Fusing consumer Step: 128/ParMultiDo(CounterOperation) into Step: 127/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.286Z: Fusing consumer Step: 129/ParMultiDo(CounterOperation) into Step: 128/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.319Z: Fusing consumer Step: 130/ParMultiDo(CounterOperation) into Step: 129/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.351Z: Fusing consumer Step: 131/ParMultiDo(CounterOperation) into Step: 130/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.383Z: Fusing consumer Step: 132/ParMultiDo(CounterOperation) into Step: 131/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.413Z: Fusing consumer Step: 133/ParMultiDo(CounterOperation) into Step: 132/ParMultiDo(CounterOperation)
Nov 05, 2022 12:48:59 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.438Z: Fusing consumer Step: 134/ParMultiDo(CounterOperation) into Step: 133/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.474Z: Fusing consumer Step: 135/ParMultiDo(CounterOperation) into Step: 134/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.510Z: Fusing consumer Step: 136/ParMultiDo(CounterOperation) into Step: 135/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.543Z: Fusing consumer Step: 137/ParMultiDo(CounterOperation) into Step: 136/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.577Z: Fusing consumer Step: 138/ParMultiDo(CounterOperation) into Step: 137/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.610Z: Fusing consumer Step: 139/ParMultiDo(CounterOperation) into Step: 138/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.635Z: Fusing consumer Step: 140/ParMultiDo(CounterOperation) into Step: 139/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.667Z: Fusing consumer Step: 141/ParMultiDo(CounterOperation) into Step: 140/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.695Z: Fusing consumer Step: 142/ParMultiDo(CounterOperation) into Step: 141/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.721Z: Fusing consumer Step: 143/ParMultiDo(CounterOperation) into Step: 142/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.754Z: Fusing consumer Step: 144/ParMultiDo(CounterOperation) into Step: 143/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.790Z: Fusing consumer Step: 145/ParMultiDo(CounterOperation) into Step: 144/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.817Z: Fusing consumer Step: 146/ParMultiDo(CounterOperation) into Step: 145/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.842Z: Fusing consumer Step: 147/ParMultiDo(CounterOperation) into Step: 146/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.875Z: Fusing consumer Step: 148/ParMultiDo(CounterOperation) into Step: 147/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.900Z: Fusing consumer Step: 149/ParMultiDo(CounterOperation) into Step: 148/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.933Z: Fusing consumer Step: 150/ParMultiDo(CounterOperation) into Step: 149/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.967Z: Fusing consumer Step: 151/ParMultiDo(CounterOperation) into Step: 150/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:48:59.994Z: Fusing consumer Step: 152/ParMultiDo(CounterOperation) into Step: 151/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.024Z: Fusing consumer Step: 153/ParMultiDo(CounterOperation) into Step: 152/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.046Z: Fusing consumer Step: 154/ParMultiDo(CounterOperation) into Step: 153/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.077Z: Fusing consumer Step: 155/ParMultiDo(CounterOperation) into Step: 154/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.111Z: Fusing consumer Step: 156/ParMultiDo(CounterOperation) into Step: 155/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.133Z: Fusing consumer Step: 157/ParMultiDo(CounterOperation) into Step: 156/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.163Z: Fusing consumer Step: 158/ParMultiDo(CounterOperation) into Step: 157/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.197Z: Fusing consumer Step: 159/ParMultiDo(CounterOperation) into Step: 158/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.234Z: Fusing consumer Step: 160/ParMultiDo(CounterOperation) into Step: 159/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.268Z: Fusing consumer Step: 161/ParMultiDo(CounterOperation) into Step: 160/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.301Z: Fusing consumer Step: 162/ParMultiDo(CounterOperation) into Step: 161/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.333Z: Fusing consumer Step: 163/ParMultiDo(CounterOperation) into Step: 162/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.360Z: Fusing consumer Step: 164/ParMultiDo(CounterOperation) into Step: 163/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.402Z: Fusing consumer Step: 165/ParMultiDo(CounterOperation) into Step: 164/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.430Z: Fusing consumer Step: 166/ParMultiDo(CounterOperation) into Step: 165/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.461Z: Fusing consumer Step: 167/ParMultiDo(CounterOperation) into Step: 166/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.493Z: Fusing consumer Step: 168/ParMultiDo(CounterOperation) into Step: 167/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.526Z: Fusing consumer Step: 169/ParMultiDo(CounterOperation) into Step: 168/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.573Z: Fusing consumer Step: 170/ParMultiDo(CounterOperation) into Step: 169/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.601Z: Fusing consumer Step: 171/ParMultiDo(CounterOperation) into Step: 170/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.624Z: Fusing consumer Step: 172/ParMultiDo(CounterOperation) into Step: 171/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.656Z: Fusing consumer Step: 173/ParMultiDo(CounterOperation) into Step: 172/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.680Z: Fusing consumer Step: 174/ParMultiDo(CounterOperation) into Step: 173/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.713Z: Fusing consumer Step: 175/ParMultiDo(CounterOperation) into Step: 174/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.740Z: Fusing consumer Step: 176/ParMultiDo(CounterOperation) into Step: 175/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.770Z: Fusing consumer Step: 177/ParMultiDo(CounterOperation) into Step: 176/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.812Z: Fusing consumer Step: 178/ParMultiDo(CounterOperation) into Step: 177/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.834Z: Fusing consumer Step: 179/ParMultiDo(CounterOperation) into Step: 178/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.866Z: Fusing consumer Step: 180/ParMultiDo(CounterOperation) into Step: 179/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.905Z: Fusing consumer Step: 181/ParMultiDo(CounterOperation) into Step: 180/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.930Z: Fusing consumer Step: 182/ParMultiDo(CounterOperation) into Step: 181/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.968Z: Fusing consumer Step: 183/ParMultiDo(CounterOperation) into Step: 182/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:00.999Z: Fusing consumer Step: 184/ParMultiDo(CounterOperation) into Step: 183/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.045Z: Fusing consumer Step: 185/ParMultiDo(CounterOperation) into Step: 184/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.079Z: Fusing consumer Step: 186/ParMultiDo(CounterOperation) into Step: 185/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.107Z: Fusing consumer Step: 187/ParMultiDo(CounterOperation) into Step: 186/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.130Z: Fusing consumer Step: 188/ParMultiDo(CounterOperation) into Step: 187/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.151Z: Fusing consumer Step: 189/ParMultiDo(CounterOperation) into Step: 188/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.191Z: Fusing consumer Step: 190/ParMultiDo(CounterOperation) into Step: 189/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:01 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.216Z: Fusing consumer Step: 191/ParMultiDo(CounterOperation) into Step: 190/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.244Z: Fusing consumer Step: 192/ParMultiDo(CounterOperation) into Step: 191/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.278Z: Fusing consumer Step: 193/ParMultiDo(CounterOperation) into Step: 192/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.327Z: Fusing consumer Step: 194/ParMultiDo(CounterOperation) into Step: 193/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.361Z: Fusing consumer Step: 195/ParMultiDo(CounterOperation) into Step: 194/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.388Z: Fusing consumer Step: 196/ParMultiDo(CounterOperation) into Step: 195/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.420Z: Fusing consumer Step: 197/ParMultiDo(CounterOperation) into Step: 196/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.469Z: Fusing consumer Step: 198/ParMultiDo(CounterOperation) into Step: 197/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.497Z: Fusing consumer Step: 199/ParMultiDo(CounterOperation) into Step: 198/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.530Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 199/ParMultiDo(CounterOperation)
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:01.931Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Nov 05, 2022 12:49:03 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:02.005Z: Starting 5 ****s in us-central1-b...
Nov 05, 2022 12:49:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:24.793Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Nov 05, 2022 12:49:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:49:45.534Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s).
Nov 05, 2022 12:50:52 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:50:52.291Z: Workers have started successfully.
Nov 05, 2022 12:51:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:51:14.507Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Nov 05, 2022 12:51:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:51:14.633Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor)
Nov 05, 2022 12:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:52:25.178Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+Step: 10/ParMultiDo(CounterOperation)+Step: 11/ParMultiDo(CounterOperation)+Step: 12/ParMultiDo(CounterOperation)+Step: 13/ParMultiDo(CounterOperation)+Step: 14/ParMultiDo(CounterOperation)+Step: 15/ParMultiDo(CounterOperation)+Step: 16/ParMultiDo(CounterOperation)+Step: 17/ParMultiDo(CounterOperation)+Step: 18/ParMultiDo(CounterOperation)+Step: 19/ParMultiDo(CounterOperation)+Step: 20/ParMultiDo(CounterOperation)+Step: 21/ParMultiDo(CounterOperation)+Step: 22/ParMultiDo(CounterOperation)+Step: 23/ParMultiDo(CounterOperation)+Step: 24/ParMultiDo(CounterOperation)+Step: 25/ParMultiDo(CounterOperation)+Step: 26/ParMultiDo(CounterOperation)+Step: 27/ParMultiDo(CounterOperation)+Step: 28/ParMultiDo(CounterOperation)+Step: 29/ParMultiDo(CounterOperation)+Step: 30/ParMultiDo(CounterOperation)+Step: 31/ParMultiDo(CounterOperation)+Step: 32/ParMultiDo(CounterOperation)+Step: 33/ParMultiDo(CounterOperation)+Step: 34/ParMultiDo(CounterOperation)+Step: 35/ParMultiDo(CounterOperation)+Step: 36/ParMultiDo(CounterOperation)+Step: 37/ParMultiDo(CounterOperation)+Step: 38/ParMultiDo(CounterOperation)+Step: 39/ParMultiDo(CounterOperation)+Step: 40/ParMultiDo(CounterOperation)+Step: 41/ParMultiDo(CounterOperation)+Step: 42/ParMultiDo(CounterOperation)+Step: 43/ParMultiDo(CounterOperation)+Step: 44/ParMultiDo(CounterOperation)+Step: 45/ParMultiDo(CounterOperation)+Step: 46/ParMultiDo(CounterOperation)+Step: 47/ParMultiDo(CounterOperation)+Step: 48/ParMultiDo(CounterOperation)+Step: 49/ParMultiDo(CounterOperation)+Step: 50/ParMultiDo(CounterOperation)+Step: 51/ParMultiDo(CounterOperation)+Step: 52/ParMultiDo(CounterOperation)+Step: 53/ParMultiDo(CounterOperation)+Step: 54/ParMultiDo(CounterOperation)+Step: 55/ParMultiDo(CounterOperation)+Step: 56/ParMultiDo(CounterOperation)+Step: 57/ParMultiDo(CounterOperation)+Step: 58/ParMultiDo(CounterOperation)+Step: 59/ParMultiDo(CounterOperation)+Step: 60/ParMultiDo(CounterOperation)+Step: 61/ParMultiDo(CounterOperation)+Step: 62/ParMultiDo(CounterOperation)+Step: 63/ParMultiDo(CounterOperation)+Step: 64/ParMultiDo(CounterOperation)+Step: 65/ParMultiDo(CounterOperation)+Step: 66/ParMultiDo(CounterOperation)+Step: 67/ParMultiDo(CounterOperation)+Step: 68/ParMultiDo(CounterOperation)+Step: 69/ParMultiDo(CounterOperation)+Step: 70/ParMultiDo(CounterOperation)+Step: 71/ParMultiDo(CounterOperation)+Step: 72/ParMultiDo(CounterOperation)+Step: 73/ParMultiDo(CounterOperation)+Step: 74/ParMultiDo(CounterOperation)+Step: 75/ParMultiDo(CounterOperation)+Step: 76/ParMultiDo(CounterOperation)+Step: 77/ParMultiDo(CounterOperation)+Step: 78/ParMultiDo(CounterOperation)+Step: 79/ParMultiDo(CounterOperation)+Step: 80/ParMultiDo(CounterOperation)+Step: 81/ParMultiDo(CounterOperation)+Step: 82/ParMultiDo(CounterOperation)+Step: 83/ParMultiDo(CounterOperation)+Step: 84/ParMultiDo(CounterOperation)+Step: 85/ParMultiDo(CounterOperation)+Step: 86/ParMultiDo(CounterOperation)+Step: 87/ParMultiDo(CounterOperation)+Step: 88/ParMultiDo(CounterOperation)+Step: 89/ParMultiDo(CounterOperation)+Step: 90/ParMultiDo(CounterOperation)+Step: 91/ParMultiDo(CounterOperation)+Step: 92/ParMultiDo(CounterOperation)+Step: 93/ParMultiDo(CounterOperation)+Step: 94/ParMultiDo(CounterOperation)+Step: 95/ParMultiDo(CounterOperation)+Step: 96/ParMultiDo(CounterOperation)+Step: 97/ParMultiDo(CounterOperation)+Step: 98/ParMultiDo(CounterOperation)+Step: 99/ParMultiDo(CounterOperation)+Step: 100/ParMultiDo(CounterOperation)+Step: 101/ParMultiDo(CounterOperation)+Step: 102/ParMultiDo(CounterOperation)+Step: 103/ParMultiDo(CounterOperation)+Step: 104/ParMultiDo(CounterOperation)+Step: 105/ParMultiDo(CounterOperation)+Step: 106/ParMultiDo(CounterOperation)+Step: 107/ParMultiDo(CounterOperation)+Step: 108/ParMultiDo(CounterOperation)+Step: 109/ParMultiDo(CounterOperation)+Step: 110/ParMultiDo(CounterOperation)+Step: 111/ParMultiDo(CounterOperation)+Step: 112/ParMultiDo(CounterOperation)+Step: 113/ParMultiDo(CounterOperation)+Step: 114/ParMultiDo(CounterOperation)+Step: 115/ParMultiDo(CounterOperation)+Step: 116/ParMultiDo(CounterOperation)+Step: 117/ParMultiDo(CounterOperation)+Step: 118/ParMultiDo(CounterOperation)+Step: 119/ParMultiDo(CounterOperation)+Step: 120/ParMultiDo(CounterOperation)+Step: 121/ParMultiDo(CounterOperation)+Step: 122/ParMultiDo(CounterOperation)+Step: 123/ParMultiDo(CounterOperation)+Step: 124/ParMultiDo(CounterOperation)+Step: 125/ParMultiDo(CounterOperation)+Step: 126/ParMultiDo(CounterOperation)+Step: 127/ParMultiDo(CounterOperation)+Step: 128/ParMultiDo(CounterOperation)+Step: 129/ParMultiDo(CounterOperation)+Step: 130/ParMultiDo(CounterOperation)+Step: 131/ParMultiDo(CounterOperation)+Step: 132/ParMultiDo(CounterOperation)+Step: 133/ParMultiDo(CounterOperation)+Step: 134/ParMultiDo(CounterOperation)+Step: 135/ParMultiDo(CounterOperation)+Step: 136/ParMultiDo(CounterOperation)+Step: 137/ParMultiDo(CounterOperation)+Step: 138/ParMultiDo(CounterOperation)+Step: 139/ParMultiDo(CounterOperation)+Step: 140/ParMultiDo(CounterOperation)+Step: 141/ParMultiDo(CounterOperation)+Step: 142/ParMultiDo(CounterOperation)+Step: 143/ParMultiDo(CounterOperation)+Step: 144/ParMultiDo(CounterOperation)+Step: 145/ParMultiDo(CounterOperation)+Step: 146/ParMultiDo(CounterOperation)+Step: 147/ParMultiDo(CounterOperation)+Step: 148/ParMultiDo(CounterOperation)+Step: 149/ParMultiDo(CounterOperation)+Step: 150/ParMultiDo(CounterOperation)+Step: 151/ParMultiDo(CounterOperation)+Step: 152/ParMultiDo(CounterOperation)+Step: 153/ParMultiDo(CounterOperation)+Step: 154/ParMultiDo(CounterOperation)+Step: 155/ParMultiDo(CounterOperation)+Step: 156/ParMultiDo(CounterOperation)+Step: 157/ParMultiDo(CounterOperation)+Step: 158/ParMultiDo(CounterOperation)+Step: 159/ParMultiDo(CounterOperation)+Step: 160/ParMultiDo(CounterOperation)+Step: 161/ParMultiDo(CounterOperation)+Step: 162/ParMultiDo(CounterOperation)+Step: 163/ParMultiDo(CounterOperation)+Step: 164/ParMultiDo(CounterOperation)+Step: 165/ParMultiDo(CounterOperation)+Step: 166/ParMultiDo(CounterOperation)+Step: 167/ParMultiDo(CounterOperation)+Step: 168/ParMultiDo(CounterOperation)+Step: 169/ParMultiDo(CounterOperation)+Step: 170/ParMultiDo(CounterOperation)+Step: 171/ParMultiDo(CounterOperation)+Step: 172/ParMultiDo(CounterOperation)+Step: 173/ParMultiDo(CounterOperation)+Step: 174/ParMultiDo(CounterOperation)+Step: 175/ParMultiDo(CounterOperation)+Step: 176/ParMultiDo(CounterOperation)+Step: 177/ParMultiDo(CounterOperation)+Step: 178/ParMultiDo(CounterOperation)+Step: 179/ParMultiDo(CounterOperation)+Step: 180/ParMultiDo(CounterOperation)+Step: 181/ParMultiDo(CounterOperation)+Step: 182/ParMultiDo(CounterOperation)+Step: 183/ParMultiDo(CounterOperation)+Step: 184/ParMultiDo(CounterOperation)+Step: 185/ParMultiDo(CounterOperation)+Step: 186/ParMultiDo(CounterOperation)+Step: 187/ParMultiDo(CounterOperation)+Step: 188/ParMultiDo(CounterOperation)+Step: 189/ParMultiDo(CounterOperation)+Step: 190/ParMultiDo(CounterOperation)+Step: 191/ParMultiDo(CounterOperation)+Step: 192/ParMultiDo(CounterOperation)+Step: 193/ParMultiDo(CounterOperation)+Step: 194/ParMultiDo(CounterOperation)+Step: 195/ParMultiDo(CounterOperation)+Step: 196/ParMultiDo(CounterOperation)+Step: 197/ParMultiDo(CounterOperation)+Step: 198/ParMultiDo(CounterOperation)+Step: 199/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor)
Nov 05, 2022 12:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:52:25.336Z: Cleaning up.
Nov 05, 2022 12:52:26 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:52:25.416Z: Stopping **** pool...
Nov 05, 2022 12:54:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:54:41.949Z: Autoscaling: Resized **** pool from 5 to 0.
Nov 05, 2022 12:54:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-05T12:54:41.994Z: Worker pool stopped.
Nov 05, 2022 12:54:53 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-11-05_05_48_45-17081102429661737479 finished with status DONE.
Load test results for test (ID): f2bc3cac-841c-4b95-92d0-1af6eaf5d153 and timestamp: 2022-11-05T12:48:39.136000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 65.364
dataflow_v2_java11_total_bytes_count 2.0E9
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221105124803
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221105124803]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221105124803] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155
ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Sat, 05 Nov 2022 12:54:59 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404}
Failed to compute blob liveness for manifest: 'sha256:276278bdf67d74d89ea1d8d1252097c42ad5ccf5b5ac3486422624ac0ee75155': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 304
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 6m 57s
109 actionable tasks: 9 executed, 100 up-to-date
Publishing build scan...
https://gradle.com/s/b7vdllwbvgnje
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11 #505
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/505/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11 #504
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/504/display/redirect>
Changes:
------------------------------------------
[...truncated 53.22 KB...]
03127cdb479b: Preparing
9b55156abf26: Waiting
9c742cd6c7a5: Preparing
03127cdb479b: Waiting
293d5db30c9f: Waiting
9c742cd6c7a5: Waiting
2d9b48547753: Waiting
ee57d2c906b3: Waiting
9c51d675f757: Pushed
474cebba054e: Pushed
c0aace243b3d: Pushed
0e2d4fc08a53: Pushed
1af428bee5f9: Pushed
32cfee8b8f5b: Pushed
0a39d8964a15: Pushed
96e0a60b939c: Pushed
f4c4dc46a537: Pushed
31902a2a1ece: Pushed
2d9b48547753: Pushed
7b7f3078e1db: Layer already exists
baca2c41f7d2: Pushed
826c3ddbb29c: Layer already exists
b626401ef603: Layer already exists
9b55156abf26: Layer already exists
03127cdb479b: Layer already exists
293d5db30c9f: Layer already exists
9c742cd6c7a5: Layer already exists
08932f9a67b5: Pushed
ee57d2c906b3: Pushed
869a82baae54: Pushed
20221106124127: digest: sha256:1c59109da8db3473603542b9cad8703e8066df746462b8169556e748e37e3dcd size: 4935
> Task :sdks:java:testing:load-tests:run
Nov 06, 2022 12:42:33 PM org.apache.beam.runners.dataflow.options.DataflowPipelineOptions$StagingLocationFactory create
INFO: No stagingLocation provided, falling back to gcpTempLocation
Nov 06, 2022 12:42:34 PM org.apache.beam.runners.dataflow.DataflowRunner fromOptions
INFO: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath: will stage 229 files. Enable logging at DEBUG level to see which files will be staged.
Nov 06, 2022 12:42:35 PM org.apache.beam.sdk.Pipeline validate
WARNING: The following transforms do not have stable unique names: ParDo(TimeMonitor)
Nov 06, 2022 12:42:35 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Executing pipeline on the Dataflow Service, which will have billing implications related to Google Compute Engine usage and other Google Cloud Services.
Nov 06, 2022 12:42:38 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Uploading 229 files from PipelineOptions.filesToStage to staging location to prepare for execution.
Nov 06, 2022 12:42:38 PM org.apache.beam.runners.dataflow.util.PackageUtil stageClasspathElements
INFO: Staging files complete: 229 files cached, 0 files newly uploaded in 0 seconds
Nov 06, 2022 12:42:38 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging portable pipeline proto to gs://temp-storage-for-perf-tests/loadtests/staging/
Nov 06, 2022 12:42:38 PM org.apache.beam.runners.dataflow.util.PackageUtil tryStagePackage
INFO: Uploading <114866 bytes, hash 3bdc9c65f4d0e768e7b03692946153582682e7b6422aa853bceaf22acde63121> to gs://temp-storage-for-perf-tests/loadtests/staging/pipeline-O9ycZfTQ52jnsDaSlGFTWCaC57ZCKqhTvOryKs3mMSE.pb
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Read input as step s1
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor) as step s2
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(ByteMonitor) as step s3
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 0 as step s4
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 1 as step s5
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 2 as step s6
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 3 as step s7
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 4 as step s8
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 5 as step s9
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 6 as step s10
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 7 as step s11
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 8 as step s12
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding Step: 9 as step s13
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding ParDo(TimeMonitor)2 as step s14
Nov 06, 2022 12:42:40 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Dataflow SDK version: 2.44.0-SNAPSHOT
Nov 06, 2022 12:42:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2022-11-06_04_42_40-6712135883233400612?project=apache-beam-testing
Nov 06, 2022 12:42:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Submitted job: 2022-11-06_04_42_40-6712135883233400612
Nov 06, 2022 12:42:41 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel --region=us-central1 2022-11-06_04_42_40-6712135883233400612
Nov 06, 2022 12:42:45 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
WARNING: 2022-11-06T12:42:44.677Z: The workflow name is not a valid Cloud Label. Labels applied to Cloud resources (such as GCE Instances) for monitoring will be labeled with this modified job name: load0tests0java110dataflow0v20batch0pardo01-jenkins-110612-asjc. For the best monitoring experience, please name your job with a valid Cloud Label. For details, see: https://cloud.google.com/compute/docs/labeling-resources#restrictions
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:51.961Z: Worker configuration: e2-standard-2 in us-central1-b.
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.190Z: Expanding SplittableParDo operations into optimizable parts.
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.217Z: Expanding CollectionToSingleton operations into optimizable parts.
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.265Z: Expanding CoGroupByKey operations into optimizable parts.
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.293Z: Expanding GroupByKey operations into optimizable parts.
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.338Z: Fusing adjacent ParDo, Read, Write, and Flatten operations
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.356Z: Fusing consumer Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource) into Read input/Impulse
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.375Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction into Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.399Z: Fusing consumer Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.420Z: Fusing consumer ParDo(TimeMonitor)/ParMultiDo(TimeMonitor) into Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.440Z: Fusing consumer ParDo(ByteMonitor)/ParMultiDo(ByteMonitor) into ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.462Z: Fusing consumer Step: 0/ParMultiDo(CounterOperation) into ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.486Z: Fusing consumer Step: 1/ParMultiDo(CounterOperation) into Step: 0/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.507Z: Fusing consumer Step: 2/ParMultiDo(CounterOperation) into Step: 1/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.527Z: Fusing consumer Step: 3/ParMultiDo(CounterOperation) into Step: 2/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.544Z: Fusing consumer Step: 4/ParMultiDo(CounterOperation) into Step: 3/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.568Z: Fusing consumer Step: 5/ParMultiDo(CounterOperation) into Step: 4/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.589Z: Fusing consumer Step: 6/ParMultiDo(CounterOperation) into Step: 5/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.609Z: Fusing consumer Step: 7/ParMultiDo(CounterOperation) into Step: 6/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.633Z: Fusing consumer Step: 8/ParMultiDo(CounterOperation) into Step: 7/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.655Z: Fusing consumer Step: 9/ParMultiDo(CounterOperation) into Step: 8/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.680Z: Fusing consumer ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor) into Step: 9/ParMultiDo(CounterOperation)
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.932Z: Executing operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Nov 06, 2022 12:42:54 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:42:53.993Z: Starting 5 ****s in us-central1-b...
Nov 06, 2022 12:43:15 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:43:15.782Z: Your project already contains 100 Dataflow-created metric descriptors, so new user metrics of the form custom.googleapis.com/* will not be created. However, all user metrics are also available in the metric dataflow.googleapis.com/job/user_counter. If you rely on the custom metrics, you can delete old / unused metric descriptors. See https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
Nov 06, 2022 12:43:47 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:43:46.935Z: Autoscaling: Raised the number of ****s to 5 based on the rate of progress in the currently running stage(s).
Nov 06, 2022 12:44:51 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:44:50.253Z: Workers have started successfully.
Nov 06, 2022 12:45:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:45:04.529Z: Finished operation Read input/Impulse+Read input/ParDo(OutputSingleSource)/ParMultiDo(OutputSingleSource)+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/PairWithRestriction+Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/SplitWithSizing
Nov 06, 2022 12:45:04 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:45:04.658Z: Executing operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor)
Nov 06, 2022 12:45:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:45:27.408Z: Finished operation Read-input-ParDo-BoundedSourceAsSDFWrapper--ParMultiDo-BoundedSourceAsSDFWrapper-/ProcessElementAndRestrictionWithSizing+ParDo(TimeMonitor)/ParMultiDo(TimeMonitor)+ParDo(ByteMonitor)/ParMultiDo(ByteMonitor)+Step: 0/ParMultiDo(CounterOperation)+Step: 1/ParMultiDo(CounterOperation)+Step: 2/ParMultiDo(CounterOperation)+Step: 3/ParMultiDo(CounterOperation)+Step: 4/ParMultiDo(CounterOperation)+Step: 5/ParMultiDo(CounterOperation)+Step: 6/ParMultiDo(CounterOperation)+Step: 7/ParMultiDo(CounterOperation)+Step: 8/ParMultiDo(CounterOperation)+Step: 9/ParMultiDo(CounterOperation)+ParDo(TimeMonitor)2/ParMultiDo(TimeMonitor)
Nov 06, 2022 12:45:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:45:27.522Z: Cleaning up.
Nov 06, 2022 12:45:28 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:45:27.586Z: Stopping **** pool...
Nov 06, 2022 12:47:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:47:41.913Z: Autoscaling: Resized **** pool from 5 to 0.
Nov 06, 2022 12:47:42 PM org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-11-06T12:47:41.959Z: Worker pool stopped.
Nov 06, 2022 12:47:47 PM org.apache.beam.runners.dataflow.DataflowPipelineJob logTerminalState
INFO: Job 2022-11-06_04_42_40-6712135883233400612 finished with status DONE.
Load test results for test (ID): 0492b2ab-dca6-414c-831c-9e1add4321e1 and timestamp: 2022-11-06T12:42:34.788000000Z:
Metric: Value:
dataflow_v2_java11_runtime_sec 17.889
dataflow_v2_java11_total_bytes_count 2.0E9
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221106124127
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c59109da8db3473603542b9cad8703e8066df746462b8169556e748e37e3dcd
Deleted: sha256:062401062440272cfc507eba3c305c9850e282e45f5b6907c92cf36a3f6c61bf
Deleted: sha256:579178d547356ca5fb0db66bee0d14268c9dec629a2e126ac9449843dfe34745
Deleted: sha256:9b7e9d7c50aa06cd0668b19b39cb7314d6747836a81bd7804c44ae0efb200207
Deleted: sha256:d4a6bc574452a682c3d32adbffb7e8165edac512a78038dbb5dc66dc91be9ceb
Deleted: sha256:afd2f132349a66a8ffab4bef6934ee490a1489454960eccc90f681414247ec29
Deleted: sha256:38570a09a129e6b8e91b3f508d87e8beb20ace4ba9d7c186f3c573a6d23317eb
Deleted: sha256:a2fe9b8036d04006552517327e0040c206ab0b012fe22b604971616fe062871d
Deleted: sha256:5090ce76a19599d911df8ad61a5661afca30e7e72273ccb5acfdb0c540d3e955
Deleted: sha256:7db863792e1303c49414ca83d6277ef84f2a4663cfdfa76bb8b60c5d2ccfe04a
Deleted: sha256:f259c67a38960583222bba510c7d9db8db1fc01538f712c9420cfc82c0c3dbaf
Deleted: sha256:2aef2e6e4fc4c3872b8b944f985ecb577090fa1d9c1dd01d69cfa9328270c53c
Deleted: sha256:d837cfe3528997877afe38b1ed090b6ae4ed8f1c0a604b3f482bd48f5e61d0f8
Deleted: sha256:430e46bf34ea28f3a1cba63e00e9a57a9e433973059fb57b8a7a83006ecdd847
Deleted: sha256:7ebf8c5b21ebaccd7da44ef593f8656a722d847bbcb60fcac550598d46a92794
Deleted: sha256:6120aca201f52910e099e85527988bf0f55f4449f01481c858754640bf3df045
Deleted: sha256:78a0eb2edc68b721aba674560a258a72e9547d0f3f80d74e3e6b88a033fe9e28
Deleted: sha256:ebab6fca0ce23cd3db70611c83c5c5e50f1e4a90e9f2094b3bbc0397c3e6dd94
Deleted: sha256:5f89e85ced0a93e0057646d0ef49b1d43b66dc1a060010bebd01fae622c9be34
Deleted: sha256:762a4d2d80aefc7ef2afd2268889b93ee6aec991461ebcbce053b125d1f13813
Deleted: sha256:ef509874befa2e5b3e73fba79cbb350f3404315d9666406c286a3693c24d7321
Deleted: sha256:1f8768f8a2f5e5117efb9c32d0710c1b0e0897450280fa135fb91bf6a3ded451
Deleted: sha256:29f96bd8df54d9389f2c4726ea8154cc75263697cd2cc2fddfeed9dda76e52c3
Deleted: sha256:b21b409526b186f63a7e0e31d648a1ca3a4039a699505eaade26997890bbfd36
Deleted: sha256:4b3f8e27899a572cbbdfa68e872019b4ad52036b05f532e762d83526eb17f9b7
Deleted: sha256:52fe9021edbcf2518ea6bd3f4d679acee8b3a34da534b56214d9326d6b8a8d05
Deleted: sha256:2559286c8d337e4204647544e9540b2f8b1795f3a25dbe2dfaa1e558eb394384
Deleted: sha256:03de64bd8e97f594ae692706dc73b9aeadc9b56d5f2a55a2a92c411050fa68ee
Deleted: sha256:380923a3c0dc4661eee7d1067e13d7dc52f3823278b95ef67e776feeac3e2024
Deleted: sha256:67cbce920669852b01da43cbf1606b8feecd82a0fa971030ccf42722d870e426
Deleted: sha256:7dbffacffaf025a7a2a5d367ff290b6a0ab79ed1df7321ef149776e2152e8ebc
Deleted: sha256:c3ff4899fadfc1e97b13b80317d7c1ab233a858a827bb325a9eb1f28400b7c39
Deleted: sha256:34d74e34536a79fa46143b91a392421f520edb21f7a3a9510d94b963bb0ae71d
Deleted: sha256:014f05a8a51d3e2a6191b6c2b57b46d00f4fd80e16c072bac6fbe723364364e4
Deleted: sha256:a6abf6d618e99b1f99d8e46da088d0b03cdb632d4387da2a71ff6ff76ab46d7a
WARNING: Successfully resolved tag to sha256, but it is recommended to use sha256 directly.
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221106124127]
- referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c59109da8db3473603542b9cad8703e8066df746462b8169556e748e37e3dcd]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20221106124127] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c59109da8db3473603542b9cad8703e8066df746462b8169556e748e37e3dcd])].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c59109da8db3473603542b9cad8703e8066df746462b8169556e748e37e3dcd
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c59109da8db3473603542b9cad8703e8066df746462b8169556e748e37e3dcd
Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1c59109da8db3473603542b9cad8703e8066df746462b8169556e748e37e3dcd].
Removing untagged image us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:780f85997bf197bd93277fc0d2445058a93b5b72efe100e3dd494ca44ad7770f
Digests:
- us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:780f85997bf197bd93277fc0d2445058a93b5b72efe100e3dd494ca44ad7770f
ERROR: (gcloud.container.images.delete) Not found: response: {'docker-distribution-api-version': 'registry/2.0', 'content-type': 'application/json', 'content-encoding': 'gzip', 'date': 'Sun, 06 Nov 2022 12:47:56 GMT', 'server': 'Docker Registry', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'transfer-encoding': 'chunked', 'status': 404}
Failed to compute blob liveness for manifest: 'sha256:780f85997bf197bd93277fc0d2445058a93b5b72efe100e3dd494ca44ad7770f': None
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://ci-beam.apache.org/job/beam_LoadTests_Java_ParDo_Dataflow_V2_Batch_Java11/ws/src/runners/google-cloud-dataflow-java/build.gradle'> line: 304
* What went wrong:
Execution failed for task ':runners:google-cloud-dataflow-java:cleanUpDockerJavaImages'.
> Process 'command './scripts/cleanup_untagged_gcr_images.sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 6m 31s
114 actionable tasks: 76 executed, 34 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/4pzwx5ydqmxwq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org