You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/08/26 19:12:30 UTC

Build failed in Jenkins: beam_PostCommit_Python37 #2765

See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2765/display/redirect?page=changes>

Changes:

[sychen] Refactor to reuse computation+key

[Luke Cwik] [BEAM-10771] Fix whitespace error causing whitespace lint to fail

[noreply] [BEAM-4980] Upgrade to Netty 4.1.51.Final and Netty_tcnative

[noreply] [BEAM-10670] Make Twister2Runner opt-out for using an SDF powered Read


------------------------------------------
[...truncated 21.29 MB...]
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                        }
                      ],
                      "is_pair_like": true,
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                    },
                    {
                      "@type": "kind:stream",
                      "component_encodings": [
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [
                            {
                              "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                              "component_encodings": [],
                              "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                            },
                            {
                              "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                              "component_encodings": [],
                              "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                            }
                          ],
                          "is_pair_like": true,
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                        }
                      ],
                      "is_stream_like": true
                    }
                  ],
                  "is_pair_like": true
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "out",
            "user_name": "CoGroupByKey/GroupByKey.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s21"
        },
        "serialized_fn": "%0A%8C%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C7%10%0A%25ref_Environment_default_environment_1%12%9D%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3D%0A%3Bgcr.io/cloud-dataflow/v1beta3/python37%3Abeam-master-20200630%2A%13beam%3Acoder%3Abytes%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.7_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1",>
        "user_name": "CoGroupByKey/GroupByKey"
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s23",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "CallableWrapperDoFn",
            "type": "STRING",
            "value": "apache_beam.transforms.core.CallableWrapperDoFn"
          },
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
            "type": "STRING",
            "value": "_merge_tagged_vals_under_key"
          }
        ],
        "non_parallel_inputs": {},
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key).out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s22"
        },
        "serialized_fn": "QlpoOTFBWSZTWRw64PoABA//+H//////////////////////4QABYAAgAlAEV6mkJo0GIWDQiamp6IxQaehomRnqj9UDzUeqaGg0aDQ0PUB6geSAAB6T1NDTTaaYo09R7TVCBAmJqYET0moekaNAMmhoMQAAAAAMjIZAA00NAaAPSCDAJiMEyYQYTEwJgCGEYCGBMCYTBGAAAmhhMTTAhBgExGCZMIMJiYEwBDCMBDAmBMJgjAAATQwmJpgQJJARpNBGnqnqNNTwT0U9R5J6h6h6g0AA9QAA09QADQA9QG0j1DQD0jpkjxC94YZViJsh2yCvXthezzA4rByUg4IMGCZrpaVuqnsXrqAhelk+h6Dot5Qe+83oIDgYf0HAqc/yHOWKAUYR+v5xrkNffMfoHXC8jAJfwYU0XLWf50sskcgVJcsD0PADIyiH+KkThZENeHARlKUYPZ4NffCCZ0HpZxMi04D77cHDw8T+iLhHRZ7cj8oRoBWyYa13A9zM19zodC/BmRJzg+YjRgiIhWJaLWgQGCxAL9GOaCpz2mY7urmT9o3m9cnrFrU/mYaCl7y14agoh09V4/vxMzM3HoaqkoWJk5MuJe4rK1Ain77FSYPZTarazXmGa9MYYdWcTm2BnLZbY/6LNo3iMxpA5hOouSGr41DZQ0G3YxQnlvs7RJkVxFG0zJylrEndpHpYNtXYPnk0vY1iVaZhf11goebnazY2QRijSoeXvz9Km/+a2vYtcTM5E554971RO3AyrOSps/TBIaXdzx04KlXzq8Erm1PRTre+q/7Lft0sDPlNXNdW6raFdYSjqaOI3DFVGpapu1K2con5iIDmlJpPrpkhIxJqO5oKW2nm9e2BT7Nqp+c4qfCmY9+9GVGlEgWPdtX3ptyWAS3ZrM7qOI9tWiVawVFMSCZUzMzdJOfiKn/JuWKEiJblAkWIlo5U9QtEQgJ9FTYxbBoapfju/K7R9TP93vcsZ4zFDrdMzWc9cZy3Ds/vrtmV1VjaatvXnTdWwrBcpQRUWtPkmjoDqly1pKOpLVSNIgN9WYJUUJtqxcUw78oWtSZ1BVY42cwrmQc6WOBRzyaiXQPD9ZXcq3uGczzlObHZjQKE0R13vGBk03h4YDEWtQCpGLXN0/XZyPdZ/V3C8XA2JEMnHxiIaFxe2lrCtykcgQHgmNZiGmcRsO0NHKKfWHps5bVL6x4RMSpFsosKxJ+0hZSrK/WTV53Vptm6sXJYVcWn/lCkiKkDmceimQG2DYq5F/BjU1EmSxIKc+QFbThNphgZkzCi7dGZMKKBoMDdh2teELz7TTyJ6rHCaKz4oxaKvoIGSXqJlLPtZW5uB2es1I4e2B5IDjIiA1rBYOs1toNscX1ZjGJC11uwo3zB5puOtzJGpe264ikwiRplHGtq6iqN2tYh6CgnFN9pxwKmWQhmoMlewzcTSKJi1qWV5EClJOgG8GOSwp8SGoicSUKgZvvgScllEqEGZ0WPfF+dfuvFTNojZLXQQddpQomXITUUzRRV8rRQrMvNK9rRJzoxr3LKo6TgettOHneUtfi1ldWg31RYAfeMBkufF2KikOTFzLpRV+3AscoFtuQfr5hQm14OYKYbEqrJDDR8nE26NFnS3M6gppqPwhYaWFSY4+p07rS3qm4L64lQiO7GXZ3oUhOCpGBS8aSBWkIGKOISi4RWhUVwkVnTIzF8sGQgJoRvVQTh6ZjqKpUPlKW52ozG01WlZF05b8TBgGHiBtuXqkMR3OFbS5D1stcEDkNcS1Q3ceKrysHa5d4L+ZMxdsX/F3JFOFCQHDrg+g==",
        "user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key)"
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s24",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "CallableWrapperDoFn",
            "type": "STRING",
            "value": "apache_beam.transforms.core.CallableWrapperDoFn"
          },
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
            "type": "STRING",
            "value": "check"
          }
        ],
        "non_parallel_inputs": {},
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "Map(check).out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s23"
        },
        "serialized_fn": "QlpoOTFBWSZTWYGF7aoAA7l/0H////////////////////5/wGAE0AQ+ctNlhQIgsNVP0RQ9RtI0DTIA0aHqaDQGQ0NNGhoNAGQGQaaD1HlAGgaHpAIMmAEwCYmTJgAEwJgJiYJgAAAABMjATAhhADQQEJqR6YNUGh6mRp6h6agANAAABoGgAANDTR6gZGmm1GQgyYATAJiZMmAATAmAmJgmAAAAAEyMBMCGEAJTUTTRMECbUwQaU/U09SekBkbU000A0AAaeoAaD1ABoaDamg0aGnAvx+qjPa7wLzlRfc1tura0wa/PgdjySa1sZa8VpdlxSSZcb6FAAaerpvA89uEcMEvF1HjN7HmIcRQ3YjEi7V10f7DVhAUElOUHfUi9xj95+dKhg2I+1Cq5G6E7CflPiUICQ6lKQZ8Po94g4qJlfdmCwhBWORS2ioDMFQBWWIYjDu5mZtn9UbiHQT1h60kMFDBcQhOc5JJJK67hRZpc12e7JcIopGIhPkcgeLstEQi0ICcJ4CDdlBNQ7FUvdtRE23WDnhTzxtHHutiRaXZH6BqiATLRL9b5GEhbs2UiSQVYh4jiLSEhFoiY9cRqWwrnqjtracVHVcUxcLm9nxuzzTZjG0IuxNFANmampalZrVGy153OuHXpsljHPuKloSWO2nDOOUTfaKmyPV/B4SQ6iqBMAMIcPWiRrTm6Onu8L6X6zLyFYuRlilbE7Ttm6Ad4aB2ON0vB2jrKmWlMUkCSpJv5WuszypZq3xeL9sZyh5fKqVdNVpuSOV3IuwIOKXyKMYYgtrcUzGzIh3bhcatign45vcYgi9Mt0tmEs7iERxEpk5cKgaEOG/zJeg1h25Ww1FlZzD0Bp5hISyj780MK3boUtCKUaIEg56IpLFZg15Riowv4JZ6Sqc1ZHV1T5ul+vB91yUv69Dxi27YSp5hTnt0jJktm46EdFN0Z4KnarqqcmagbEVBNWpcZt4x0xmNoholzjGySA9ICHLMSExoej+zCTmOdRSg+8AkGtdLDDCnf1CERghpNCkoFMY9fP8Gf1HyXjIZnLFhwDPKLnNuvraE+cJzqblzi072/1ul/G92nX1YNkGx4TKbAQ2dyGIJ3g0uhENg65W7Lm0BHdOenMci4WCLwXs6w07YOvmE3WG1l+6oxaSh3Ht05LJB4z0NRKp81JTPBooi5OOGlwzcllflI6xApJQhVeGo5cWahTSRYikEjuWOe97IJxk9Au2uDWBcdxqi3MPJ2cCgkSMXdoqGz244+8Ry2Jq7FEvjGKAgMSGKrSbGpYntjVDd/3JcofoY8ibw77IZBlJ8adfRYyZ66xqWnSiLZYUSsnXDnmXWhdPLL/qLUGh8hyHOlI6ztKZTTIbdFEicTwEjB73POzENaxHnJpliqoiWILtSY5l/XrziKXPV543cbeO4JsDKO2R9xSMGQbc3XE0LJ4oELd8e02WjDZezpDbJD56qMPGMDEw3TITnKJK9NRYIyXHq/SWt2CLSCZ7C77xC9fnagMLy2aF2WBlJCCYoaC1byvhF+KmmMyzKPsn9946roFzfx1sY1Y/CFRpwNKjkWti/aoq0T8qg13V97rlmxWXScvX3Ab8sqIwdhFJgOTB9WpMkVDjG5DRc2+NEYhlhHykCvYA7Ap1+Tg1bJB8kSSWZnwmzf1nXreTge7E1qb6+0/z9UgfzYcQ/xdyRThQkIGF7aoA==",
        "user_name": "Map(check)"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
 createTime: '2020-08-26T18:16:48.819892Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-26_11_16_47-11468761624837505396'
 location: 'us-central1'
 name: 'beamapp-jenkins-0826181638-026187'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-26T18:16:48.819892Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-26_11_16_47-11468761624837505396]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-26_11_16_47-11468761624837505396
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-26_11_16_47-11468761624837505396?project=apache-beam-testing
apache_beam.io.filesystem: DEBUG: translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/37315312-4e78-4e78-8653-b7d72d80db38' -> 'gs://temp\\-storage\\-for\\-end\\-to\\-end\\-tests/py\\-it\\-cloud/output/37315312\\-4e78\\-4e78\\-8653\\-b7d72d80db38'
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3914.144s

FAILED (SKIP=7, failures=1)

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 118

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 12m 4s
167 actionable tasks: 157 executed, 6 from cache, 4 up-to-date

A build scan cannot be produced as an error occurred gathering build data.
Please report this problem via https://gradle.com/scans/help/plugin and include the following via copy/paste:

----------
Gradle version: 5.2.1
Plugin version: 2.3

java.lang.NullPointerException
	at com.gradle.scan.plugin.internal.j.d$a.a(SourceFile:51)
	at com.gradle.scan.plugin.internal.j.d.a(SourceFile:41)
	at com.gradle.scan.plugin.internal.j.f.a(SourceFile:42)
	at com.gradle.scan.plugin.internal.o.a$a.a(SourceFile:30)
	at com.gradle.scan.plugin.internal.o.a$a.a(SourceFile:19)
	at com.gradle.scan.plugin.internal.o.a.c(SourceFile:60)

----------

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_Python37 #2773

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2773/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #2772

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2772/display/redirect?page=changes>

Changes:

[noreply] [BEAM-9898][BEAM-9899] SnowflakeIO.Write for cross-language with python


------------------------------------------
[...truncated 15.43 MB...]
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "m_out.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s4"
        },
        "serialized_fn": "QlpoOTFBWSZTWWeYg/EAApJ/8H/////////////cwr///+ZjwCAAYEBAAvYZlAZGGqZKeap6nqaD1Bk2o9T9UeoGgAaAaDQaNPSeoaD1PUAGnqeoMj0gZNBKmiZNCYmI1J4mSbSYg0yZAAGgABoDQaABoNAyMgGmSIQ0pspptTYiDTTQNBgQyaAGIyAGg0Bp6BNqeoGgeoOAAAAAAAAAAaAAAAAAAAAADvptRksy3rYqqrRyJX2qH0NSOBctdVUdLQAm1Vh2UANxiG8xcsPs2/V+wqRYe1ULTTsFGP9a61H8xkkgE7und2KQKCYLXStXLn3eFthcDyETfV4UGFKZNeBBEHUSJLWyzBEAWMCthwxMLlv1cDyano9cgF8al+wdq5r/REAkG1Xg8aacyW/LCkBXoTuB4iGoncNkgf7kZTycpPhEogIUlcmUXbLXkkTvSvGWUVI8gorCTQi4qGCTsUwnjQkyt2ZyOO9OYuufzYucYr+tb6skz+fLbYmGltqvc0ZyO62U1BN/063ZqwM9sHukMYDtXzQzuCo6I8hcg9bN+uA5zVxEToRovLZIoOS0PpZ6DtewoIpXjNEHdMET2MhmBwtiJO/7kFGvRXCBJCR3E0VT+tlPoVcp7u8FEolFZEAQgtDOCFCYBounGasGioKCtPYuiTpMtBVhRemCeN1kw3xz7+O3HdpAYYCUXQKJCFvkypPA1qn+cbuIJzJofIN2BcCmDlvIBCstlwFz2aQYXYogZO/bA/V1tacCaIv1lmiMtOWCxQ22hA4/JeLrKatgfimoi1XTBYqKI1UlwpqoFFxMxI7eKk1vELwoiakO73oRuciOUowiTwDyilzBw1LIP03KHIxylREq0IIBlhEEIgRqAmRKSZspXcY8WJZc1S79gLtt2o65KoRUptqAP0C0mEjQrLUMMdcwvLxdDZ2YWF3a2YmEc6V3Flq/zGko0q1i7CE9F60VVmlLVbxGN1Kc8GIjGCmM2+eg7pKnM7xezfVKYmJBAxbGHNEIVArMrZhiGweBLCVomDBhtYxZft2DIMzallLUjBweKHOZYLJJaYlEbRaHX4A2iWd0kmIYgPGrVkkFdUkblNPWmlouz7UYWBJGThIYIMpTkP5/pJL782MpXbJs/HJr2mwipgUqF1LL6WhjchFIhEb70ijjxamTOr2EAb6pUqdP+qQ4F4FkIiHj/i7kinChIM8xB+I=",
        "user_name": "m_out"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
 createTime: '2020-08-28T13:06:27.341421Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-28_06_06_25-17166564161423573615'
 location: 'us-central1'
 name: 'beamapp-jenkins-0828130617-290271'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-28T13:06:27.341421Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2020-08-28_06_06_25-17166564161423573615]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2020-08-28_06_06_25-17166564161423573615
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-28_06_06_25-17166564161423573615?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_06_06_25-17166564161423573615 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:25.644Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-08-28_06_06_25-17166564161423573615. The number of workers will be between 1 and 1000.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:25.644Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-08-28_06_06_25-17166564161423573615.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:30.314Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.471Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.535Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step GroupByKey: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.572Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.611Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.677Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.722Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.760Z: JOB_MESSAGE_DETAILED: Fusing consumer metrics into Create/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.792Z: JOB_MESSAGE_DETAILED: Fusing consumer map_to_common_key into metrics
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.827Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Reify into map_to_common_key
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.855Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Write into GroupByKey/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.883Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/GroupByWindow into GroupByKey/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:32.913Z: JOB_MESSAGE_DETAILED: Fusing consumer m_out into GroupByKey/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.053Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.077Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.105Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.143Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.397Z: JOB_MESSAGE_DEBUG: Executing wait step start13
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.467Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.508Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.537Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.580Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.652Z: JOB_MESSAGE_DEBUG: Value "GroupByKey/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:33.844Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:06:57.101Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:07:02.863Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:07:20.952Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:07:20.992Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:25.016Z: JOB_MESSAGE_BASIC: Executing BigQuery import job "dataflow_job_10873971826641967196". You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_10873971826641967196".
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:35.823Z: JOB_MESSAGE_BASIC: BigQuery import job "dataflow_job_10873971826641967196" done.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:37.259Z: JOB_MESSAGE_BASIC: Finished operation read+write/NativeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:37.393Z: JOB_MESSAGE_DEBUG: Executing success step success1
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:37.470Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:37.717Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:37.738Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:52.770Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:08:52.804Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:02.945Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+InspectForDetails/ParDo(_InspectFn)+ParDo(CallableWrapperDoFn)/ParDo(CallableWrapperDoFn)+Type matches/WindowInto(WindowIntoFn)+Type matches/ToVoidKey+Type matches/Group/pair_with_1+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:06.069Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Create/Read+Type matches/Group/pair_with_0+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:06.137Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:06.178Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:06.245Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:15.446Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:15.518Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:15.590Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:15.643Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:15.683Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:22.856Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:22.911Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:09:22.953Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_06_02_33-650662409565445728 is in state JOB_STATE_DONE
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Attempting to perform query SELECT fruit from `python_query_to_table_15986197404768.output_table`; to BQ
DEBUG:google.auth._default:Checking None for explicit credentials as part of auth process...
DEBUG:google.auth._default:Checking Cloud SDK credentials as part of auth process...
DEBUG:google.auth._default:Cloud SDK credentials not found on disk; not using them
DEBUG:google.auth._default:Checking for App Engine runtime as part of auth process...
DEBUG:google.auth._default:No App Engine library was found so cannot authentication via App Engine Identity Credentials.
DEBUG:google.auth.transport._http_client:Making request: GET http://169.254.169.254
DEBUG:google.auth.transport._http_client:Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): metadata.google.internal:80
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bigquery.googleapis.com:443
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "POST /bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/fa61d88f-33b1-4ee8-b269-f38ff021dc37?maxResults=0&location=US HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anon7c1365c677f997f1407f6e1404cfd48f46ec69fe/data HTTP/1.1" 200 None
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Read from given query (SELECT fruit from `python_query_to_table_15986197404768.output_table`;), total rows 2
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Generate checksum: 158a8ea1c254fcf40d4ed3e7c0242c3ea0a29e72
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:06.261Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:06.313Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:06.346Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_06_03_18-2769475089471059061 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:44.787Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:51.275Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+ExternalTransform(simple)/Map(<lambda at external_it_test.py:43>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:51.391Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:51.443Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:51.508Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:58.643Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:58.707Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:58.766Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:58.818Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:10:58.867Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:11:49.667Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:11:49.715Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:11:49.741Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_06_05_01-9887592088227291031 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:32.567Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:32.642Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:32.695Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:32.759Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:41.861Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:41.953Z: JOB_MESSAGE_DEBUG: Executing success step success11
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:42.033Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:42.094Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:12:42.132Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:13:32.140Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:13:32.181Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T13:13:32.217Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_06_06_25-17166564161423573615 is in state JOB_STATE_DONE
test_autocomplete_it (apache_beam.examples.complete.autocomplete_test.AutocompleteTest) ... ok
test_streaming_wordcount_debugging_it (apache_beam.examples.streaming_wordcount_debugging_it_test.StreamingWordcountDebuggingIT) ... SKIP: Skipped due to [BEAM-3377]: assert_that not working for streaming
test_datastore_wordcount_it (apache_beam.examples.cookbook.datastore_wordcount_it_test.DatastoreWordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_leader_board_it (apache_beam.examples.complete.game.leader_board_it_test.LeaderBoardIT) ... ok
test_game_stats_it (apache_beam.examples.complete.game.game_stats_it_test.GameStatsIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_user_score_it (apache_beam.examples.complete.game.user_score_it_test.UserScoreIT) ... ok
test_avro_it (apache_beam.examples.fastavro_it_test.FastavroIT) ... ok
test_hourly_team_score_it (apache_beam.examples.complete.game.hourly_team_score_it_test.HourlyTeamScoreIT) ... ok
test_read_via_sql (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_read_via_table (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_bigquery_read_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_bigquery_read_custom_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_bqfl_streaming (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... SKIP: TestStream is not supported on TestDataflowRunner
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_one_job_fails_all_jobs_fail (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_avro_file_load (apache_beam.io.gcp.bigquery_test.BigQueryFileLoadsIntegrationTests) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_spanner_error (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_spanner_update (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_write_batches (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_copy (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_value_provider_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_transform_on_gcs (apache_beam.io.fileio_test.MatchIntegrationTest) ... ok
test_datastore_write_limit (apache_beam.io.gcp.datastore.v1new.datastore_write_it_test.DatastoreWriteIT) ... ok
test_dicom_search_instances (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_dicom_store_instance_from_gcs (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_file_loads (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... SKIP: https://issuetracker.google.com/issues/118375066
test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... ok
test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_parquetio_it (apache_beam.io.parquetio_it_test.TestParquetIT) ... ok
test_analyzing_syntax (apache_beam.ml.gcp.naturallanguageml_test_it.NaturalLanguageMlTestIT) ... ok
test_text_detection_with_language_hint (apache_beam.ml.gcp.visionml_test_it.VisionMlTestIT) ... ok
test_basic_execution (apache_beam.testing.test_stream_it_test.TestStreamIntegrationTests) ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream supports emitting to multiple PCollections. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream can independently control output watermarks. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
test_label_detection_with_video_context (apache_beam.ml.gcp.videointelligenceml_test_it.VideoIntelligenceMlTestIT) ... ok
test_big_query_write (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_new_types (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_schema_autodetect (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... SKIP: DataflowRunner does not support schema autodetection
test_big_query_write_without_schema (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
Runs streaming Dataflow job and verifies that user metrics are reported ... ok
test_big_query_legacy_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_avro (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql_kms_key_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_deidentification (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_inspection (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_job_python_from_python_it (apache_beam.transforms.external_it_test.ExternalTransformIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
test_metrics_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 4133.237s

OK (SKIP=7)

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':release:go-licenses:java:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 125

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 13m 23s
163 actionable tasks: 125 executed, 34 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/dc6tt3fy234vg

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #2771

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2771/display/redirect?page=changes>

Changes:

[ningk] [BEAM-10827] Fix forward the google-cloud-core version

[Valentyn Tymofieiev] [BEAM-8551] Verify that installed python packages don't have conflicting

[Valentyn Tymofieiev] Upgrade TF to 2.3.0.

[noreply] Merge pull request #12492 from [BEAM-6807] Implement an Azure blobstore

[noreply] Merge pull request #12661 from Add export FHIR resources to GCS IO


------------------------------------------
[...truncated 15.43 MB...]
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "m_out.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s4"
        },
        "serialized_fn": "QlpoOTFBWSZTWWeYg/EAApJ/8H/////////////cwr///+ZjwCAAYEBAAvYZlAZGGqZKeap6nqaD1Bk2o9T9UeoGgAaAaDQaNPSeoaD1PUAGnqeoMj0gZNBKmiZNCYmI1J4mSbSYg0yZAAGgABoDQaABoNAyMgGmSIQ0pspptTYiDTTQNBgQyaAGIyAGg0Bp6BNqeoGgeoOAAAAAAAAAAaAAAAAAAAAADvptRksy3rYqqrRyJX2qH0NSOBctdVUdLQAm1Vh2UANxiG8xcsPs2/V+wqRYe1ULTTsFGP9a61H8xkkgE7und2KQKCYLXStXLn3eFthcDyETfV4UGFKZNeBBEHUSJLWyzBEAWMCthwxMLlv1cDyano9cgF8al+wdq5r/REAkG1Xg8aacyW/LCkBXoTuB4iGoncNkgf7kZTycpPhEogIUlcmUXbLXkkTvSvGWUVI8gorCTQi4qGCTsUwnjQkyt2ZyOO9OYuufzYucYr+tb6skz+fLbYmGltqvc0ZyO62U1BN/063ZqwM9sHukMYDtXzQzuCo6I8hcg9bN+uA5zVxEToRovLZIoOS0PpZ6DtewoIpXjNEHdMET2MhmBwtiJO/7kFGvRXCBJCR3E0VT+tlPoVcp7u8FEolFZEAQgtDOCFCYBounGasGioKCtPYuiTpMtBVhRemCeN1kw3xz7+O3HdpAYYCUXQKJCFvkypPA1qn+cbuIJzJofIN2BcCmDlvIBCstlwFz2aQYXYogZO/bA/V1tacCaIv1lmiMtOWCxQ22hA4/JeLrKatgfimoi1XTBYqKI1UlwpqoFFxMxI7eKk1vELwoiakO73oRuciOUowiTwDyilzBw1LIP03KHIxylREq0IIBlhEEIgRqAmRKSZspXcY8WJZc1S79gLtt2o65KoRUptqAP0C0mEjQrLUMMdcwvLxdDZ2YWF3a2YmEc6V3Flq/zGko0q1i7CE9F60VVmlLVbxGN1Kc8GIjGCmM2+eg7pKnM7xezfVKYmJBAxbGHNEIVArMrZhiGweBLCVomDBhtYxZft2DIMzallLUjBweKHOZYLJJaYlEbRaHX4A2iWd0kmIYgPGrVkkFdUkblNPWmlouz7UYWBJGThIYIMpTkP5/pJL782MpXbJs/HJr2mwipgUqF1LL6WhjchFIhEb70ijjxamTOr2EAb6pUqdP+qQ4F4FkIiHj/i7kinChIM8xB+I=",
        "user_name": "m_out"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
 createTime: '2020-08-28T07:11:13.622827Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-28_00_11_12-10411183892553126582'
 location: 'us-central1'
 name: 'beamapp-jenkins-0828071102-327957'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-28T07:11:13.622827Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2020-08-28_00_11_12-10411183892553126582]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2020-08-28_00_11_12-10411183892553126582
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-28_00_11_12-10411183892553126582?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-28_00_11_12-10411183892553126582?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_00_11_12-10411183892553126582 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:12.554Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-08-28_00_11_12-10411183892553126582. The number of workers will be between 1 and 1000.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:12.554Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-08-28_00_11_12-10411183892553126582.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:16.944Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:19.872Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:19.909Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step GroupByKey: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:19.939Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:19.968Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.031Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.075Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.107Z: JOB_MESSAGE_DETAILED: Fusing consumer metrics into Create/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.134Z: JOB_MESSAGE_DETAILED: Fusing consumer map_to_common_key into metrics
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.173Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Reify into map_to_common_key
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.207Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Write into GroupByKey/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.245Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/GroupByWindow into GroupByKey/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.293Z: JOB_MESSAGE_DETAILED: Fusing consumer m_out into GroupByKey/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.321Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.354Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.389Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.421Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.766Z: JOB_MESSAGE_DEBUG: Executing wait step start13
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.833Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.880Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.924Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:20.975Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:21.024Z: JOB_MESSAGE_DEBUG: Value "GroupByKey/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:21.094Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:11:39.669Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:12:04.227Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:46.693Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+InspectForDetails/ParDo(_InspectFn)+ParDo(CallableWrapperDoFn)/ParDo(CallableWrapperDoFn)+Type matches/WindowInto(WindowIntoFn)+Type matches/ToVoidKey+Type matches/Group/pair_with_1+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:49.840Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Create/Read+Type matches/Group/pair_with_0+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:50.190Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:50.234Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:50.299Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:50.490Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:55.166Z: JOB_MESSAGE_BASIC: Executing BigQuery import job "dataflow_job_11139931203831599175". You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_11139931203831599175".
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:55.941Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+ExternalTransform(simple)/Map(<lambda at external_it_test.py:43>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:56.012Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:56.054Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:56.151Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:59.870Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:59.982Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:59.254Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:59.324Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:59.399Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:59.463Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:13:59.501Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:05.334Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:05.420Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:05.501Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:05.560Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:05.588Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:06.064Z: JOB_MESSAGE_BASIC: BigQuery import job "dataflow_job_11139931203831599175" done.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:06.949Z: JOB_MESSAGE_BASIC: Finished operation read+write/NativeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:07.012Z: JOB_MESSAGE_DEBUG: Executing success step success1
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:07.088Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:07.365Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:14:07.421Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:21.395Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:21.438Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:21.479Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_00_07_54-15836497326177671606 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:34.557Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:34.598Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:34.634Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:39.531Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:39.575Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:15:39.613Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_00_07_54-18280263292823606256 is in state JOB_STATE_DONE
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Attempting to perform query SELECT fruit from `python_query_to_table_15985984593746.output_table`; to BQ
DEBUG:google.auth._default:Checking None for explicit credentials as part of auth process...
DEBUG:google.auth._default:Checking Cloud SDK credentials as part of auth process...
DEBUG:google.auth._default:Cloud SDK credentials not found on disk; not using them
DEBUG:google.auth._default:Checking for App Engine runtime as part of auth process...
DEBUG:google.auth._default:No App Engine library was found so cannot authentication via App Engine Identity Credentials.
DEBUG:google.auth.transport._http_client:Making request: GET http://169.254.169.254
DEBUG:google.auth.transport._http_client:Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): metadata.google.internal:80
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bigquery.googleapis.com:443
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "POST /bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/b2a26a5f-349b-488d-b21b-41f957f0e45b?maxResults=0&location=US HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anonb6125fbb9e12373a5c7c3ecfffb94e93ff5e5bd4/data HTTP/1.1" 200 None
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Read from given query (SELECT fruit from `python_query_to_table_15985984593746.output_table`;), total rows 2
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Generate checksum: 158a8ea1c254fcf40d4ed3e7c0242c3ea0a29e72
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_00_08_07-1920862903070691967 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:41.127Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:41.191Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:41.243Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:41.313Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:50.509Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:50.576Z: JOB_MESSAGE_DEBUG: Executing success step success11
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:50.651Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:50.706Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:17:50.732Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:18:51.054Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:18:51.097Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-28T07:18:51.127Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-28_00_11_12-10411183892553126582 is in state JOB_STATE_DONE
test_autocomplete_it (apache_beam.examples.complete.autocomplete_test.AutocompleteTest) ... ok
test_streaming_wordcount_debugging_it (apache_beam.examples.streaming_wordcount_debugging_it_test.StreamingWordcountDebuggingIT) ... SKIP: Skipped due to [BEAM-3377]: assert_that not working for streaming
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_datastore_wordcount_it (apache_beam.examples.cookbook.datastore_wordcount_it_test.DatastoreWordCountIT) ... ok
test_leader_board_it (apache_beam.examples.complete.game.leader_board_it_test.LeaderBoardIT) ... ok
test_game_stats_it (apache_beam.examples.complete.game.game_stats_it_test.GameStatsIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_user_score_it (apache_beam.examples.complete.game.user_score_it_test.UserScoreIT) ... ok
test_avro_it (apache_beam.examples.fastavro_it_test.FastavroIT) ... ok
test_hourly_team_score_it (apache_beam.examples.complete.game.hourly_team_score_it_test.HourlyTeamScoreIT) ... ok
test_read_via_sql (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_read_via_table (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_bigquery_read_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_bigquery_read_custom_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_bqfl_streaming (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... SKIP: TestStream is not supported on TestDataflowRunner
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_one_job_fails_all_jobs_fail (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_avro_file_load (apache_beam.io.gcp.bigquery_test.BigQueryFileLoadsIntegrationTests) ... ok
test_spanner_error (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_spanner_update (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_write_batches (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_copy (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_value_provider_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_datastore_write_limit (apache_beam.io.gcp.datastore.v1new.datastore_write_it_test.DatastoreWriteIT) ... ok
test_transform_on_gcs (apache_beam.io.fileio_test.MatchIntegrationTest) ... ok
test_parquetio_it (apache_beam.io.parquetio_it_test.TestParquetIT) ... ok
test_dicom_search_instances (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_dicom_store_instance_from_gcs (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_file_loads (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... SKIP: https://issuetracker.google.com/issues/118375066
test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... ok
test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_analyzing_syntax (apache_beam.ml.gcp.naturallanguageml_test_it.NaturalLanguageMlTestIT) ... ok
test_text_detection_with_language_hint (apache_beam.ml.gcp.visionml_test_it.VisionMlTestIT) ... ok
test_basic_execution (apache_beam.testing.test_stream_it_test.TestStreamIntegrationTests) ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream supports emitting to multiple PCollections. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream can independently control output watermarks. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
test_label_detection_with_video_context (apache_beam.ml.gcp.videointelligenceml_test_it.VideoIntelligenceMlTestIT) ... ok
test_big_query_write (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_new_types (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_schema_autodetect (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... SKIP: DataflowRunner does not support schema autodetection
test_big_query_write_without_schema (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
Runs streaming Dataflow job and verifies that user metrics are reported ... ok
test_deidentification (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_inspection (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_big_query_legacy_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_avro (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql_kms_key_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_job_python_from_python_it (apache_beam.transforms.external_it_test.ExternalTransformIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
test_metrics_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 4136.155s

OK (SKIP=7)

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':release:go-licenses:py:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 125

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':release:go-licenses:java:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 125

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 18m 39s
159 actionable tasks: 148 executed, 7 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/2av7iudrpeaug

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #2770

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2770/display/redirect?page=changes>

Changes:

[noreply] [BEAM-10699] Logging BigQuery streaming insert tail latencies (#12609)


------------------------------------------
[...truncated 21.08 MB...]
              "is_wrapper": true
            },
            "output_name": "unbatchable",
            "user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn).unbatchable"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s2"
        },
        "serialized_fn": "QlpoOTFBWSZTWfd0mCEAAXl/wP//////+RAAFfuUwr/n//JgwAQAQAG8lZiw0ibU1T2qMm9TRkygNBoyaBoeoPUxDTR6gA0aNqaDSE9UfpRtGqe1T1D0TQAAYQwgAAAAABzTEZGTTJoBkNGQyZAAADI0yNAwhkDTREyk8kY9UZAAAAAAAAAGgBkcJooNeUmqM2NJ90JqV5KW05Ag8jOQANwp/KHD9KVgQSSbNn57n+vp6u8/ak64AiQQSCLlVBJQlEBIAtI09RJ2be/cMZ9AU2/KlJJCAiWDy2RBVSmk3mlktblm3td2HY4cUza169vX+nk4EUXkXPWM8EjBJmLlZjZqkVfbOx2nWX8ILiUwMxHAFUM4RqbQCRcHwT2AmMO0iODMT7jTSp86umLohHp9EbkWGabwXgXAA4CS2O+59wmamoU0B12pVEUYL9TRiBO2OSjwZTkQxkRilAHVC0eIlhaCDw6THKkbSmAlBBIVFNAkDvFiw4e4euZ049Ee0fLoTigMysWUsQHP6pEqmtRhIoowGvnpKZwqJCvEPaAETOXxUY4VHBkgFUT31+woUU6SSc1/Eo0YGcJL8TKIq1aMu1ailYFxSa2p/baqsDNFoMyqsYsz2qyrUCKApTsCTnWy5gUsPvXOx7EL1YSOYm5NRqNDBI+NhG2UKMUAosY6rjJh2DANChLEofmV/NCxUdp2K4Y+tBJoJJ4n4XgKUPHjyT50xDJPP/Zf8XckU4UJD3dJghA=",
        "user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)"
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s4",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "_BatchFn",
            "type": "STRING",
            "value": "apache_beam.io.gcp.experimental.spannerio._BatchFn"
          }
        ],
        "non_parallel_inputs": {},
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "WriteToSpanner/make batches/ParDo(_BatchFn).out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s3"
        },
        "serialized_fn": "QlpoOTFBWSZTWUzbrC4AAWF/wP//////4RAAFfuUwr/n//JgwAQAQAG8juus4ggplPUep6ajE9TRiaaNMGp6Rk9IxoNT0aIxPQjT0BpEymyNBNqTZQYnoQBpkZBoaAyABp6IAamIaVGjTTaZGkaAANMjIyDIGgAGgaekGmoUMmIntKMj1GmRoBkxMmg0aZAaA8oBkbAXxSiiWpWxEyANc0mtvMRAPQvEIl8of8sGUpCCCSZJPrIyX2lZ6+7rJ4DhIJBFBSgSUJRASAN6prrCfKs3ZYXDoZiQgwkQF8TM9UPwuphm5ddr2HMkFdvXCxMeePhvOug5Z0tIfw41nZar3P+0BH0qIp/KetmIhtIWBamlQC5QEy51AFVAJUGIAkFlVVnSCLWDYydrjYigTmafhhg2QKSwOAmkzcB9sjnNoE2UB76UctUM/Tnyhj63VL6Is+DhoOiGSCWgFMGobGGQahUkrKQCEAKa8ZYEIgOYMFAiPGxo+FRLGdkkgqBNGSMNpYVaTw4MVhiqlR7KL2jMYuGAcoECnE2BjZCkYFpNClB7UjWH1CB1GsXG4UW5OLwRv6m2Q2F/czf0AEJjpjLFMZm8nqiohmccERyZsVHKEACZl0xE1sxkOAxSpmQieV2Y4UyQl13lqWHBDGxwkriBkjRAmQ/AgnHbKQEqJsSDCj+a+HRUk15w82kYjwHJRNlWBHLw/f5+s+xCPfH7cOIu5IpwoSCZt1hc",
        "user_name": "WriteToSpanner/make batches/ParDo(_BatchFn)"
      }
    },
    {
      "kind": "Flatten",
      "name": "s5",
      "properties": {
        "display_data": [],
        "inputs": [
          {
            "@type": "OutputReference",
            "output_name": "unbatchable",
            "step_name": "s3"
          },
          {
            "@type": "OutputReference",
            "output_name": "None",
            "step_name": "s4"
          }
        ],
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "out",
            "user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable.out"
          }
        ],
        "user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable"
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s6",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "_WriteToSpannerDoFn",
            "type": "STRING",
            "value": "apache_beam.io.gcp.experimental.spannerio._WriteToSpannerDoFn"
          }
        ],
        "non_parallel_inputs": {},
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "WriteToSpanner/Writing to spanner.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s5"
        },
        "serialized_fn": "QlpoOTFBWSZTWeJsr+EAAs9/wH/////////////+wr/3/+JhwEAC7KmjjSDDRAU9TVP0nqn6Tyahij2mqZD1AYR6nqNNGmj1NPUH6k0yHqBvRQGho009IGgTTUmaRNJmTKA0AaAABoAAAAAAAAaNPUDU/UokeoaAAGgAAAA0AAAaAAADQHqAAEoU0Q0TamAJoj0TQ9QwAAAjIZGgwgwAE000zQjHpOF+DNgTIa8uPt3LdWKJxvqhUo4stqMpLeXDZs13PLIiA+xhyS1x2yJk8FL9My7GTIHAkDiGGH3kwyWlfSFRH4JZmf8n3okwnQCEIQCABwAAOBIHKKAc3a7HWz7krqUc12fb3cLSjB/kjkkFYDOJJLJIMBRIQRmjqlEvGMxrSHmHxSCKJUA5VJ4DLDrHmpH0zynUMQLQN7F8L6iaXOK7uK7Kot5QHc2L8+76oeVEIhwY6lWXOENme7jlXfXq62um+dHe2X+762eTDgY2fHmUhJ439nT825I/PNT0JbYBXtRbLzQ1ppU/16kto8jkiEdYItJ2KDl+GAAu3AJEIAFpTrMGRGaw4PH8qdxXacky6HI4BRo/sRnT6sH6hoP+PgFqOVJsZSCmxYsNH136+u6Hz+7PlCgRWBELS7RMVFTBUm5phCrbHGuugNDgHLs2pbGGCxUQEgEhDJiIo0S8Oh7VPXmPvJ26qn2gNrPzFcquqQLQZQaSjI8r80cPDyOHxvmKKoUqgUivHJ06JHh+BIUj2dQIFP1JmoiSI0JFKQlqg5Q85OB+u5GSXMLBas4dNZoaJ9JBQSBBuyBkrWiFuDoqtB1QZQicScHKU0NAAGMY2JCMqXjIHWxWFEeAxIOM4TJCEIC2RGGRXAMxHamORkfCEVkVUPGWCKrFJtYyLWc8T1cTJaUYKZHH7aUqSpCLPmoJYBg679LlFKNcHAw3l4GnpyU5YhTKwI2HJ5de3hOlyLDxZKmVVe7N1VbpxhcUhgHVDXIiJBvUs1VESqFWS4sulogzABlmlfGfeEpEQ1pyUFs9qFLBnxOYlnNB43QmUTtxjMKsKK7diVWW0zsBi+11RBk4MTNlO2+KMUAnUWkZMNsDeltj1WOpA6/pKb6F64VoIHJbCrGbRzH60v5/rMFQyswU0JhmCoxkBknkorHVINrvAYOKjJx8L+1xGC/uTI9rYOP/f8XckU4UJDibK/hA",
        "user_name": "WriteToSpanner/Writing to spanner"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
 createTime: '2020-08-28T00:21:43.358018Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-27_17_21_42-3323581107925331133'
 location: 'us-central1'
 name: 'beamapp-jenkins-0828002131-951932'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-28T00:21:43.358018Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-27_17_21_42-3323581107925331133]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-27_17_21_42-3323581107925331133
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-27_17_21_42-3323581107925331133?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3896.837s

FAILED (SKIP=7, failures=2)

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':release:go-licenses:py:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 125

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 118

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 9m 8s
163 actionable tasks: 136 executed, 23 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/vbyl2wwhc3zwq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #2769

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2769/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-10820] Delete dead code SDFFeederViaStateAndTimers.java

[Udi Meiri] [BEAM-10701] Fix paths yet again


------------------------------------------
[...truncated 21.01 MB...]
        "windowing_strategy": "%0A%8C%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C7%10%0A%25ref_Environment_default_environment_1%12%9D%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3D%0A%3Bgcr.io/cloud-dataflow/v1beta3/python37%3Abeam-master-20200630%2A%13beam%3Acoder%3Abytes%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.7_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1">
      }
    },
    {
      "kind": "CollectionToSingleton",
      "name": "SideInput-s19",
      "properties": {
        "output_info": [
          {
            "encoding": {
              "@type": "kind:stream",
              "component_encodings": [
                {
                  "@type": "kind:windowed_value",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        },
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        }
                      ],
                      "is_pair_like": true,
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "kind:global_window"
                    }
                  ],
                  "is_wrapper": true
                }
              ],
              "is_stream_like": {
                "value": true
              }
            },
            "output_name": "out",
            "user_name": "Write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(Extract.out.0).output"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s14"
        },
        "user_name": "Write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(Extract.out.0)",
        "windowing_strategy": "%0A%8C%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C7%10%0A%25ref_Environment_default_environment_1%12%9D%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3D%0A%3Bgcr.io/cloud-dataflow/v1beta3/python37%3Abeam-master-20200630%2A%13beam%3Acoder%3Abytes%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.7_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1">
      }
    },
    {
      "kind": "CollectionToSingleton",
      "name": "SideInput-s20",
      "properties": {
        "output_info": [
          {
            "encoding": {
              "@type": "kind:stream",
              "component_encodings": [
                {
                  "@type": "kind:windowed_value",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        },
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        }
                      ],
                      "is_pair_like": true,
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "kind:global_window"
                    }
                  ],
                  "is_wrapper": true
                }
              ],
              "is_stream_like": {
                "value": true
              }
            },
            "output_name": "out",
            "user_name": "Write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(PreFinalize.out.0).output"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s17"
        },
        "user_name": "Write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(PreFinalize.out.0)",
        "windowing_strategy": "%0A%8C%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C7%10%0A%25ref_Environment_default_environment_1%12%9D%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3D%0A%3Bgcr.io/cloud-dataflow/v1beta3/python37%3Abeam-master-20200630%2A%13beam%3Acoder%3Abytes%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.7_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1">
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s21",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "CallableWrapperDoFn",
            "type": "STRING",
            "value": "apache_beam.transforms.core.CallableWrapperDoFn"
          },
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
            "type": "STRING",
            "value": "_finalize_write"
          }
        ],
        "non_parallel_inputs": {
          "python_side_input0-Write/Write/WriteImpl/FinalizeWrite": {
            "@type": "OutputReference",
            "output_name": "out",
            "step_name": "SideInput-s18"
          },
          "python_side_input1-Write/Write/WriteImpl/FinalizeWrite": {
            "@type": "OutputReference",
            "output_name": "out",
            "step_name": "SideInput-s19"
          },
          "python_side_input2-Write/Write/WriteImpl/FinalizeWrite": {
            "@type": "OutputReference",
            "output_name": "out",
            "step_name": "SideInput-s20"
          }
        },
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "Write/Write/WriteImpl/FinalizeWrite.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s7"
        },
        "serialized_fn": "QlpoOTFBWSZTWYwDoxcACI5/////////////////////////////////////////////4AjT6j0ds5XF3N2BrJkFcDakToDUSJqfopiemU9TTEPUaPKeSep6g0wmg9TQMgPU9TQBtJoGgAAA0D1AAeo0B6gA0A0DIPSaDQA2oAGjHqhpmiPU9I9Jp6Q0aBkhAE0METNJkTak9TRpp6npDEAAD1A0epkAA0AAAGgAAAAAAAAAAAAAAGQDQAAAACTAATAAEwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAKZqINFNNNGkymBNoAQyMA0aJgaAJgCMAAADQajJ6TJgAABMjCaYaATTAmmAmATTBMAAAAEwjCTAATAAEwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEihDQgCMlN6jSZqNqn6k9Tan6Ux6oeU08o9TZJiaejUAB6gDTRkaNAbSAAAAADQBkyAAAAAAAAAAAAB4pl0u19oMIEdTgBVZaimpviWR8SQ1q1fAhuGnXLbIHli0unlW4on7Nlxtpkzy41ZQ2JZn3Z54FyvwB40720aQRCAhQoEBI0xJtIBnRZDopJLfpjGtHpHokZMY0JSEIJ13EQBizvIWAoE8UEcArh0L4YRUVb6W1bt3l7BYs0Z1mulZmLpeL55L/ZrkjxpnhCUBaLNca84w0TkMOYMpXaWHTEKxcpDOOjJFw6Y8YRCZeC938qPHWhesJFSKsBEPA06eMqCqVJIJBKBKIo1kZBICUyXlZKUYIQcrfzwf2/cREpSgkNyxtpIlEiWCJg4ZIiJVaApo0oeewTJVYi8Eb0AhgIwcVCJGI2EjXEYobG8RAg2HVyChpERkcjkmQbTIYDsgzspK8ZxoBQZSRWsIZDMUkyRMpr3IVhBnPwvM36oOxhExoufWz+Dc4tvkIq5fFZhnu6J2GPlZroeE+BNpCSnboqeqk5DPQHJGakKet6NLihNluLG/A9GpwGazme/LRaSXaaaaabWtSlKUta1KA9sQmjRqKKgpFCkX2Uvy5KnVOR9Lu+j2S5iJzJZzQqBceJpq1hYsRKTJCboZBYelv0KYq96oKlVKCuVVqQbH0K4S8LNVZ+krsaPDR5FS4Ua8CgR4GihijqpVkgy9EJda4JFJKlIzGQrFYpAE1cooIg2tQoxdx3IKGVDTgywdfihRMDA48VS+jsyLgIfeUFsURaOKI2mFChAKamKJgXAOFA6/0q6wTUmcbI8oRJHNBcta6Akvx05HNdD78I3RbjN4pRPPaHtXmZz9Mc6eXq+VNm0wuYaqBGXLvRlL9RaaBSsmWs27TeG8GycTOtc828U9P0Df7u4WABSlBQufn5fW1dcMfSkMkk5ppUBTUS88wCIFNvpFwIYRpcIdlddx1b08RRUcmIuY5szttgn5NZiES/zz6WVtUcllo1Mxh49A0YM90VVHGqzTJcpqsw+9GSh4Sz+Zn5KAf1shhyb3aIfIdBqLT6c5MGERzbmvQToxVehxaJkyQclk8RGztuj0AvBnOKRxA9EwmsiM3gaEgkyQbQiftKQtDhrD1NN+ChLqQ2h4wTEKVO5YdgU7kqXXlUwnIeNSaBYu9WlRRcoBhb3mvoUc6mKtJKaqC8LEWi3gKtibNqo5zzgqqFiLGYNxj5qZbmegWkAZC1IajhnGY8O8CuwSw2hCoTAQC8ZiwugeWepeGhy4Ak/M6QhEUgeTCCsEiez3bt3ITiwOaPc6Xanq/MI++UTT6BDfB4Xw/i++pDjtDbrachQgW3B0HLXyYPcAoQxxOTISVJGJbwFzJMzHaiIw90VB6Q8HYaclpqOGOzVy+s9ixRxRkx7dimxBkyUpZ4tRXULAThZfV+2wjgbr5S9rOg6EtIGDd1qYsC1VyqsVDdtK3Ci5XFeQKiicHVUKCqk6It1VGVJK6uJXZWSMBDsBKzlaiqV+O6CEwvxNmU66XBFTaLX042UugjZCEiFue0DpkggyIGVgoE7QY6aaKgBbY6HglgBtrxU4zGCgCizLaMkoWvS1A2KtdZmFVAMAtjjUZGMKCJGd56XudUxGpkNjPeLyeh9r8thrDFhJOULZzEEDyIYQQQgYkJFcG+MY94JAgjY6icLply9EAIoUVZ8sZ9VC4C0QiyqRhExAHCpajexSFILyAc6o6hgFgDAAoF7Adt3NTGA2NZh/mzOyZug32w221W1S5c49hohvbeWN5WCib1q1nLjJ2ayr3xzo0Ns0cccQQwmKsWhqb7HtRYObyHv4xTRa1XkEMMWqVjOQcwWmykoaU/WEIfAoyANXWhhMuMWCoWzUOG8Qa9BQvIu+ZlyuW/qFeI2y+N6kIbC7gFZoC4JYLDzeAICmxQtd0d6zdp59+ZVODUxJsEsbUlFVhnElIGUpt2lOSBIWC8ZlGasOYLFNrzSpp3l0V3ZaNATGBgaKZhcC0raihOggQlAC+4il7a7ITbdrK4FLCKpatFCDkFhFqBBWaxhlLKbKBqc5lFG93fKxcYkENA2hlylJjmpyUlCsLpIUGnWNqLMGSNc6PGIMjLQAebvlYwxvDGvNC6CGkMBEiC/NlAr54pRuwbBs2UApVzYQmlOF2GgozwsBszitERJJLabjL/O0IyCgySJQyk5QzNbjlVAEgI+XcUxxxyIU46tcGPInYsol1111LsBtQhmsOfWSiJqDBiTBR/AUqBz4TkyYuKaWpt4fAs1sZHlIE8w0RL5oVGxzUmt+MM4JBjIENQAAAAAAADoAeAD7rsFTwaBERERFEMMFDinUQ4bGNmbgIiIiYwwTGMQxjzzzUWEPvwg0+ZvEIUKJBEREREtb4bCwREREyKAdAMzeigFqShwkJhPhEdAQuNJKQpKZvR7bKRsAqCBBaLouC2prN2occj2BFEAVkh4QXTjZKbHn3BzgltmChMcNJVipuYCBwQyGUzKoWmUvqw5MZXkToFIU7F3Ij5kTFUPhAtmRwUgXRhzg5Q55hBxBhmnGY2sZjMkMsb5learGqBTJLHEV27jjie047xJQa8Z6sZ2cNTCYS5Hk2KKcoRx0LaXqcczFWJ7qmYiKz3ARNZYclPUoYJ3aA4QFRF8uB0VY43ECYJhpVBJDI4oIMtBaacbzT7mKERPwYpYnfu25SZaTcMxWgdqG+riaAQIReXPb7Pso/l+v+cScjBjBMq8hJkZi1OBbv2nxfGzplgkWDA2FiIi8x5WRZq0SMZrZ1miUmGK0h2uDBtWFFbCNRReNNUU0zsKlcjM1mhsivqtayaoqE/IbYuGkd+PbjJGqFWqNzhxzVL74lYpnYudoKG3N6P5fO5uPojco6T6/Z0gpUCam/Dun/P7qP5/an/LdkIIU25gc2G/ARyJHkjVKwYMkSKQbDnOe0D/v/uzRDiQ3XD3vEjxbpw+HxOBYN8+ZxxZ5wRhA/DD94yINg0wbBpg2DF9+EA0AdJAgKI0A2khttA/eQEc80Hm2hTGlxvsP/i7kinChIRgHRi4",
        "user_name": "Write/Write/WriteImpl/FinalizeWrite/FinalizeWrite"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
 createTime: '2020-08-27T18:14:30.737559Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-27_11_14_29-12753691206178711853'
 location: 'us-central1'
 name: 'beamapp-jenkins-0827181421-295210'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-27T18:14:30.737559Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-27_11_14_29-12753691206178711853]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-27_11_14_29-12753691206178711853
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-27_11_14_29-12753691206178711853?project=apache-beam-testing
apache_beam.io.filesystem: DEBUG: Listing files in 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1598552057316/results'
apache_beam.io.filesystem: DEBUG: translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1598552057316/results*' -> 'gs://temp\\-storage\\-for\\-end\\-to\\-end\\-tests/py\\-it\\-cloud/output/1598552057316/results[^/\\\\]*'
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
apache_beam.io.gcp.gcsio: INFO: Finished listing 0 files in 0.036600589752197266 seconds.
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 4058.281s

FAILED (SKIP=7, failures=1)

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 118

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 12m 49s
167 actionable tasks: 142 executed, 21 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/mvr6y5gakysie

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #2768

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2768/display/redirect?page=changes>

Changes:

[Kamil Wasilewski] [BEAM-10675] Clean up Python Load Tests


------------------------------------------
[...truncated 15.96 MB...]
            "user_name": "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "SINGLE_PARTITION",
          "step_name": "s23"
        },
        "serialized_fn": "QlpoOTFBWSZTWV70rMwABad/+//////////////////////////////wAABAEAgAINAGF5ydQNjYzqsSFrNuRE0CpmRqeqbI1HlPUeptNIMyAaTaGpkaeoMQMINAZNAaD1AaHqeofqhpkbTUHlA0yaaNAegaQBqmTETBT0xMjSTepH6keoyeoybSDJpoGg0AGQAaNNGEAADQAAAaAGgB6EAANNCAgSaJqekD1Dyh6g9Q9QbKPUAAGgADQAGgGQGmg9IAAAAAaAAABAGmjQMmmRpoMgBkNGBADTIaDJoGgaDINMIaDJgjQaYRiAZGJpgmg0GTQDEkaaJoxTMgieJMmp+pPKGQDQ0AA0AAGgaAAGgBtQAAAAAAAAGmjWkuFlHCyaQt8y2YyjswwQrKmrwRxIYlA7L516VBoENIkS5aEHQkbD0OB2fJnT2VW555xWKNBrgAIFrdsTzwQ0NFi5Ega6JI6bcJokfBcGBPoyDLDzaM+5VjvepvqSPPmIvKjOuXt+zDKnWm5WaY/BWu581hK1O/j59RNrYgC9g2DorMGRCygGLBkSD+swU7fW1tx5ZJ27KiyMQGIKxrttwHcxVBSXeSxSak4M6NxmSAZmCRdgc4BIpUsGS4FgyyuTByIVG4XN27tYi8qLx6RZifCKE42wlDJBuUDHcjd8/Vwlnzum06o4vA9+Vq71PNu4F1wX2FiW1ZJgJSlKabM+8xcNYIPePU1QEqkIIHpkIZGI1ZYi4hKRBh/kj3azYXM9vS0YtKAvqVDaFDCJb8pEqsjIFoNQJDYJS0KLuKjGe19uNeyTYFWcDqXdy3XFcoqBHN142H3wWcLM4yunhnMRQqVGqgnOTZAWghD7MBhnNzTtTzliFkq37tobXBpnJn0Sgcr0517i/bM5OQaM1Bo73CviQ8fTwjEPSUfkoTxerHYqMKef8LY4+TTOBEFpyncVzp5yqytdqMgKMJtSNUvXhWk6uGzBUBhJ0bGRJVwL6piD0R6DAc9f3X0nIjM6J7KVxcSLR416p6JkphjdsMPvDZto8pa8P7R8bSozuMy8FqiafgarK8/mgyZcI29EAxWrd6fhhurWJVoVMFoQgBZiUbbb8sZpv3I6wSQqNj0woXczBsVRc6jmXWSd33E3ed12QJXWW1DNVrTR9q926Aiz/2lkVcyJAxXTCO64URlLdR9wdyEZCCJpBcmB6BiNwQJUQkOidYA8UUxL5cnc3xq0gUwStTZ894v1sXmYxTHiAtTEgV3nya+lJ0YMkJR535yiZB7C7Q306eGeU3Xlr+vPy8/Qrkkq8eXk4KyZ8XWXSBRHIQAdCcEOhABnwIBaNdHYPAiIeNe+5eXi7JiPikPlvCoTprM2poEYnwZxwZQIGRMAhGlk4wEqZqJ20z9DdDDhi3pVWGvw0dOcCaYkY6aIBOBEzGAmJPLXIEFQIwXGvGilNhIYntbK1A11Rq4R328QR2zKsKnnUYu22aLRQKMxCQYGxAhhELHwCgJHygypKNrRyYbt2rEamIswNgIiZKiFpjoWyI3iMJHTKq3C7Phjb3sDa7K5kkgGiIUaJlEAUV5uHXOVxMn96H5p9rMxWneOQ18bDZHjsoNOPBx8JwC4X0BlCEJ9MeMEAkhabOLZxTxVGeC+MnC3KqZIB95NZ0QTHRxzoBHHlXAq+hk0vFigWdmCE1GzqIO1B0d5dpuP4DYY48mOcSM8VxkZJqooAvQNE6uGolLYiNykSAGUQEBLiaUxu4kFeWUrOEktuY82gNKIEiDHm7EFmfVJFA5pWkqAIsFUoLlDeTs4AklgaWCJRhYggpdKMQoVDm1YaoxgkD6xsckEi+AA17NFbpD4opjsXBkpHsBFXXsJRadTeBlhIWyQ0LcuUgZyM5egH3yQLg2pnRFmg44YCAgBYHPIqQ0BnkHFzulw9TZ4C5thzznNEQXbTv1Ts5XFG/BT416qsMLWi7VWDT94uSMNSuNWO6/Y72+5kzo+dB3jVt5gsKU15FaKLrOEBYQzd7y58tG7KVcgtbZhrnbhXd3ZmZmZmZqszWszX1rje1qyckkkm+jNczKq22M0LcdLBMEhMW+5DA4IyM2x0lQzRrZASDXhtio9nMGJeN/GrTNB6eTqIkOQQqkQKGZADxJFMwdOzDsKiQqTkx4IksetYYXbghMKJBEnPjmIu8TqbTAF8dualhVVXWGDK2K1aopjL4rziZp9H8WwLqVzAzr75sFLKuFd6thHCQvzIxCMFMyCRaVAmMcGgcvRRapIZgiL77CZJxINmD1erbKnHYqTy6S58TzcnICZC2VaAaSmvOSgssUe+PD5lIIZIAolnmhnNyUqGIqY1BMyyb4BCB8swnFy5miNiVzHhwjFaOVBIpG2IoIufRqRZlHQM56Aq5oAkEQXCAKELl16mLIuhPSgmlFmXa3GY5+Ut+3f1n5g/St+szNzs/Q0f1NvXLn/FpRA0MhAB2Y0h5RAIChBETXVuNhZprbmHpTYOlZM1pucqbe71vuXkISIk/6gLAoMwIHwdtvoY/+/8XckU4UJBe9KzM",
        "user_name": "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/TriggerLoadJobsWithoutTempTables"
      }
    },
    {
      "kind": "CollectionToSingleton",
      "name": "SideInput-s40",
      "properties": {
        "output_info": [
          {
            "encoding": {
              "@type": "kind:stream",
              "component_encodings": [
                {
                  "@type": "kind:windowed_value",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        },
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        }
                      ],
                      "is_pair_like": true,
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "kind:global_window"
                    }
                  ],
                  "is_wrapper": true
                }
              ],
              "is_stream_like": {
                "value": true
              }
            },
            "output_name": "out",
            "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0).output"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s39"
        },
        "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0)",
        "windowing_strategy": "%0A%8C%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C7%10%0A%25ref_Environment_default_environment_1%12%9D%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3D%0A%3Bgcr.io/cloud-dataflow/v1beta3/python37%3Abeam-master-20200630%2A%13beam%3Acoder%3Abytes%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.7_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1">
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s41",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "WaitForBQJobs",
            "type": "STRING",
            "value": "apache_beam.io.gcp.bigquery_file_loads.WaitForBQJobs"
          }
        ],
        "non_parallel_inputs": {
          "python_side_input0-write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs": {
            "@type": "OutputReference",
            "output_name": "out",
            "step_name": "SideInput-s40"
          }
        },
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s7"
        },
        "serialized_fn": "QlpoOTFBWSZTWbr5ox8AAxV/4///////////////wr/v/6Li0AAEAEAQCAAA0AM+83pygGRg1NEyp6Q0Bo0MgxGRoPSAABoNGmgeo0ANMTTEGmj1AxAgwAAAAAAAAAAAAAAAAAAAABEzUJqnlGgGgaDIAAANAAAAAAAGgAAABE/VKan6o00AA0ADTQA0aA0AA0xGgAAaAwRoMhkAkkJkBNMUwg0CaaQ2o9R6mNJ6TQ00AaGQAAAGmhp6E9TRo1U1rie267Z1rKIzunL/YhVkwvjiwy3IS7LAjrMgYcd05VACgA+1r8pMnz9gPFstS2DGwLZK7/RppSN28egaY4UjgQQQEAEABEQFJIWLREvuJ1hPrtk0rbN4+0oezF3meXoeyK4CK9F0i5MKJgQ9TgHMRgRJIHE1L5F8gNGoiRrApV3FpvScYTXzhVK4H5IwRvrIBRvUKIVOkjw4OmQwYK59WBPnLCbX2ARWlCLLzuBFiuZd6sKCUu3gOClR2YnbM00JcbW45iJ1/Q5dJK8I66o9mysuytemADsmmGCTC7AwMaAKpTarIKeQfMbzqXTRkOdtP4P0gQxIC7hD+Cl4ccuidti0QRsFYjjEpMO4iHW9C/nU3z1Odfadj8sp3ZZQ4EBhDRh2I/i2B1HKZPXnTeeDLlN+6R40cSgoS5x3784MB7h06IBwDAnx2ETTyimaUAlF2rrsCHk5uApqCjW3Go3MTns/dHddAQhAhNvCCUIb5Hl+NM+12OmJbhZHSYTRZhyL2EQN6oqmjSKuqu8YMWPdRRFjLjTwk0cNf3LRBXJreO67rmNSzaXkWhbVv7+mDw7gxFs5wDJmYndjLDWwz6eg+F1Svnw2C3dzy1FokEkatGzDawycNA1OR4VFJzFkqmKyKSIlbn7cwqGjMK9EdacHzRBZ2ZlD3+q8ZlGQUIkQZkzedYMwc0zdFGCS0NJOq2yBfYjUmftgVsqlJlagMOJarLM4zTJ6K22Cvi5P6j4kGUu+5ve5HOcxzg1YgRgdemszf+X4a3OAAAAAAAAogBDAEnCWtcACIjzQGPOgKM4iKMRhRVk0sp5ma2vNlW5FE0orkAHsVBW0/izvRrwbYGUZU4atPfYyo2ebsWFJiljqga7AWZQYrmuZ0CLxMTMNCm3akrB5POp2mnhRXOKeMVK7GRY7fc/ympHO+DNUaNTS4eYK1Z3V6ji4zZckkabINgsoggox3Qb3ZAVkayaah/En5+vulTg/1r7AxqlKnUwnMT8kuP1v/f4u5IpwoSF180Y+",
        "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/WaitForDestinationLoadJobs"
      }
    },
    {
      "kind": "Flatten",
      "name": "s42",
      "properties": {
        "display_data": [],
        "inputs": [
          {
            "@type": "OutputReference",
            "output_name": "None",
            "step_name": "s25"
          },
          {
            "@type": "OutputReference",
            "output_name": "None",
            "step_name": "s39"
          }
        ],
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "out",
            "user_name": "write/BigQueryBatchFileLoads/Flatten.out"
          }
        ],
        "user_name": "write/BigQueryBatchFileLoads/Flatten"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
 createTime: '2020-08-27T12:16:11.416469Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-27_05_15_58-10897877489491641742'
 location: 'us-central1'
 name: 'beamapp-jenkins-0827121537-976886'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-27T12:16:11.416469Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-27_05_15_58-10897877489491641742]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-27_05_15_58-10897877489491641742
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-27_05_15_58-10897877489491641742?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3794.417s

FAILED (SKIP=7, errors=1, failures=5)

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':release:go-licenses:java:dockerRun'.
> Process 'command 'docker'' finished with non-zero exit value 125

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 118

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 7m 32s
163 actionable tasks: 125 executed, 34 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/mgof6a43sz3xw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #2767

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2767/display/redirect?page=changes>

Changes:

[zyichi] Fix PairWithRestrictionFn process no attribute signature error

[Boyuan Zhang] Handle split when truncate observes windows.

[noreply] [BEAM-10821] Add Python SDK typing improvements to CHANGES.md (#12693)


------------------------------------------
[...truncated 22.11 MB...]
                              "component_encodings": [],
                              "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                            }
                          ],
                          "is_pair_like": true,
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                        },
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [
                            {
                              "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                              "component_encodings": [],
                              "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                            },
                            {
                              "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                              "component_encodings": [],
                              "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                            }
                          ],
                          "is_pair_like": true,
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                        }
                      ],
                      "is_pair_like": true
                    }
                  ],
                  "is_pair_like": true
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/DropShard.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s28"
        },
        "serialized_fn": "ref_AppliedPTransform_WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/DropShard_46",
        "user_name": "WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/DropShard"
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s30",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "BigQueryWriteFn",
            "type": "STRING",
            "value": "apache_beam.io.gcp.bigquery.BigQueryWriteFn"
          },
          {
            "key": "max_batch_size",
            "namespace": "apache_beam.io.gcp.bigquery.BigQueryWriteFn",
            "type": "INTEGER",
            "value": 500
          },
          {
            "key": "max_buffered_rows",
            "namespace": "apache_beam.io.gcp.bigquery.BigQueryWriteFn",
            "type": "INTEGER",
            "value": 2000
          },
          {
            "key": "retry_strategy",
            "namespace": "apache_beam.io.gcp.bigquery.BigQueryWriteFn",
            "type": "STRING",
            "value": "RETRY_ALWAYS"
          },
          {
            "key": "create_disposition",
            "namespace": "apache_beam.io.gcp.bigquery.BigQueryWriteFn",
            "type": "STRING",
            "value": "CREATE_IF_NEEDED"
          },
          {
            "key": "write_disposition",
            "namespace": "apache_beam.io.gcp.bigquery.BigQueryWriteFn",
            "type": "STRING",
            "value": "WRITE_APPEND"
          },
          {
            "key": "additional_bq_parameters",
            "namespace": "apache_beam.io.gcp.bigquery.BigQueryWriteFn",
            "type": "STRING",
            "value": "{}"
          },
          {
            "key": "ignore_insert_ids",
            "namespace": "apache_beam.io.gcp.bigquery.BigQueryWriteFn",
            "type": "STRING",
            "value": "False"
          }
        ],
        "non_parallel_inputs": {},
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn).out"
          },
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "FailedRows",
            "user_name": "WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn).FailedRows"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s29"
        },
        "serialized_fn": "ref_AppliedPTransform_WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)_48",
        "user_name": "WriteUserScoreSums/WriteToBigQuery/_StreamToBigQuery/StreamInsertRows/ParDo(BigQueryWriteFn)"
      }
    }
  ],
  "type": "JOB_TYPE_STREAMING"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
 createTime: '2020-08-27T06:04:37.110053Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-26_23_04_34-7564813273261174894'
 location: 'us-central1'
 name: 'beamapp-jenkins-0827060421-045924'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-27T06:04:37.110053Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-26_23_04_34-7564813273261174894]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-26_23_04_34-7564813273261174894
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-26_23_04_34-7564813273261174894?project=apache-beam-testing
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): bigquery.googleapis.com:443
urllib3.connectionpool: DEBUG: https://bigquery.googleapis.com:443 "DELETE /bigquery/v2/projects/apache-beam-testing/datasets/leader_board_it_dataset15985082476836?deleteContents=true HTTP/1.1" 204 0
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3283.730s

FAILED (SKIP=7, errors=1, failures=7)

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 118

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 58m 18s
167 actionable tasks: 130 executed, 33 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/hxwwj6v36gmic

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_Python37 #2766

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python37/2766/display/redirect?page=changes>

Changes:

[leiyiz] implement query 12

[saavan] Fix author names

[noreply] [BEAM-10701] Add codecov config, fix paths hopefully (#12684)

[noreply] Merge pull request #12674 from [BEAM-8258] basic metric feature for

[noreply] Add skipped tests for Series.dt and Series.str methods (#12615)

[noreply] [BEAM-9547] Add a few more DataFrame operations (#12682)


------------------------------------------
[...truncated 22.22 MB...]
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "SINGLE_PARTITION",
          "step_name": "s23"
        },
        "serialized_fn": "QlpoOTFBWSZTWT43kpIABc7/+///////////////////////////////wABAEAgAIOAGV8enVro4UFZBwmkuBqaTU9TTSNDU9Gp4hM0Rk09NTNR5J6Iz1TQAADRo00xBoGmgDTRoGnpqG1GJpppoxNHqA0Mj0aNEaDU0jSaek9ACnlR4KepmkaGhoGgAAAANAAAAAAAAAAAAAAAAAEDQ0aAYQGg0DAgANAaZAaAwCAyaaAAAaYJppggMmjINGEABkMIaZBFP01EGhNTUaepoHqDQANAAAAAADQAAAAAAyPUAAAAAAGgAAEDQ0aAYQGg0DAgANAaZAaAwCAyaaAAAaYJppggMmjINGEABkMIaZAxImEE0CNNJkxTE2o9Rk00GnqAAGhpoGgAANAGRoDQAAAAAAAAAAMyWlSy+ea85Ivv0PIXWhYXDrMVrarLbSYnOGQoRoanrViG0TZJGIUIRbHzWU7URv1zybtjq6xkC3Ma4ASBVuGAG1COZoMXIAjdokjnuUTPR3TgxJ8mIz5eLbqLl7Nw+Z/t0jx6SMKtv3MOt0RhlTP42kb/cNT8fjOEazuYeRSJOrgSLjg614DOcHAlVRFfKF55u7RvQYijf1lZW0gBwCryxJCsCIwIFgj31aHvUGIpp3c3x1tgNaNrXA5MmAc5gkX43OASKV5gyQ17BloOTByIV3lVtH3MOSKPCfbdGTlwk+U+EEwyIx9kDiyHaPWW+rb/euuYbnlUusPjLlCdu+G+4thDfUsSmvsBKUpT9vxkRs86pDWdXweyBfsqCMohDYMRrpvLiEooMP6oaWudje0GiaZFIqLwgyIU5B6Rn6WaqgQJIjk/Ix7i2tq2AlW96K++Jg8TRiaoFmo1dgfn84Geok4x49PSEJL4VIqC0pn6jiyriGKXlbHDEFlmjFiZjsAo3XLE6kRnIykNkMasLbOWuXES7TRBs6CUQ6VvKJlghRjW6+Cby67yLv6ZScvOp1Kr5EwLS4SrbvecmhzaLlmzdPF5bCEi57FxivVbLelBDJ/OzLIEUGe07SeKcKVZyhUIWBTCc13ULyaoxqO0wT9clOqk/nFnZ+uL42U+6q2V/6exgTlitOxne2hbG68k/WPcKGUn3zwyumbXL9Svm2jCQjCiTUXBvuZAgwd4pQVxzkLyVb65AZGr5SyXgJaKCoMYBcjlCq7ElTUD3wgYikclxwmnvUgqmYWPYb89onb8tJ75WWXhGyqukM16e2o2MH9EA/N/OcVkUokDUYDKjA4W0FLw6NudMIxIIpiLlIOgxGzIE0QkM92SBAW3XrU52SNVaBa6LKmeXVgMM75MvNHg0ZYFVJIGRhhH8ao7QGMpjy/ImKUIMFfufF83yedrfMf4fua4se/j5mOk0CLi2tu0TMFNWD0UCDGAmiQGEyQBOwYHoj0kF9CEA+FO35OO66ByHnxHG3Aw3lMtNphWHSQvPuueNeiCHE3QUNjhwAGlSYSrnpYk/Yp3pzajHc37TlQlO0uWHTJAnBCajATEnxyCCKgIUNfbfBOeyiHVNh0w6uY4e5Rib6BRWZrGq64udAX7GaGggUYkJBgclAhg8ZKaEgpCL5gzSVDVHOx25ZtYjIxNiIe2NXKXMcysiiASDMFDquxiYnhw68S845ffRbaurWXcLBBjANicNmJ10gZLOpjVLWpXE/tw384NZuNHR3vnTonFyUs48nvIN7K2cagC4a5EbAIRq1w3YQBEQSd4ziBUp2NcGrndhaHZXMBFCsmARyQCwQwCfhZfDKJy1UT77bz2QOJrdk6YGs5kZzC2YKCk4zY0KKKVFsTDsCNBhSTA+QMEDbWrB4BnXAQsZCIAvogh4kZ4HvEQz45DOeTFq8b5OoGygBFBQ5qoirV0mKNiFCpqplSAWoZkQg3d9Q8JJOClUIIuFRFDJ5k5BgxWew70XwkB3Q5zAERiAAbDg1NFl0Re+o7w4MlKDAPyMjNmK3XcIM5RLZ0syyeeQMCNZgr6McRIFo2xsRGYxxxEREJQQvvJPCW9LWEFNV13jcI65bORdhUsVVVZWoxcnDOxYwcEoeN9UZGcqq2aQvsLlaYcwGAJN7nV5SLFtGMkz9fhiZUtZRbBGyi+rXOsYSqSRxSaVFRlpoP5RslOq0wNVHHNQaSSSSSSSS4kyEmVzp7JC6BgAAAE6ImQlVWSMltd6dQkEgbUDicRo6G8KxmoWrAiO+lplUb1SGJgN7GlcplBQJ1iJDoJs0IWamYGBTzbIO2gw44kb1QtII00cApSjuySrjBkPetckJMIb5VusgLuqS6cPOiKIHByUIiacdQYPynE019yspdOtqNVZYwSZmuTzqqIXIizFCALgykgkKkGAkL1Dt9g2ZieXVGQhlBC22tKJ4AKu6+mltzPYXmZlamZdwzTheBnjtJbAbNPhfjCUnEfs+fYcDoA4rHqXr23DXifLUoCS9rRAEQiMc4UFCvWNERKoPSSCVo1EgRGJBzKFE0XRt1j9aqJcLgigteikLt9a9RF5S0au38370/SEY6Q5DmaEY8zkSTyspINPVWtN+42Vlx8nMzZDnnEHWg9UUqjGAPNldzs+CBIQkikOoDyjnmI4DytzkM5Gc1tFt61VVz89SKXWJgREDEQMP6Rm4JU5wAbAff5Wb0P+LuSKcKEgfG8lJA==",
        "user_name": "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/TriggerLoadJobsWithoutTempTables"
      }
    },
    {
      "kind": "CollectionToSingleton",
      "name": "SideInput-s40",
      "properties": {
        "output_info": [
          {
            "encoding": {
              "@type": "kind:stream",
              "component_encodings": [
                {
                  "@type": "kind:windowed_value",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        },
                        {
                          "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                          "component_encodings": [],
                          "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                        }
                      ],
                      "is_pair_like": true,
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "kind:global_window"
                    }
                  ],
                  "is_wrapper": true
                }
              ],
              "is_stream_like": {
                "value": true
              }
            },
            "output_name": "out",
            "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0).output"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s39"
        },
        "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0)",
        "windowing_strategy": "%0A%8C%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C7%10%0A%25ref_Environment_default_environment_1%12%9D%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3D%0A%3Bgcr.io/cloud-dataflow/v1beta3/python37%3Abeam-master-20200630%2A%13beam%3Acoder%3Abytes%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.7_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1">
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s41",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "WaitForBQJobs",
            "type": "STRING",
            "value": "apache_beam.io.gcp.bigquery_file_loads.WaitForBQJobs"
          }
        ],
        "non_parallel_inputs": {
          "python_side_input0-write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs": {
            "@type": "OutputReference",
            "output_name": "out",
            "step_name": "SideInput-s40"
          }
        },
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s7"
        },
        "serialized_fn": "QlpoOTFBWSZTWbr5ox8AAxV/4///////////////wr/v/6Li0AAEAEAQCAAA0AM+83pygGRg1NEyp6Q0Bo0MgxGRoPSAABoNGmgeo0ANMTTEGmj1AxAgwAAAAAAAAAAAAAAAAAAAABEzUJqnlGgGgaDIAAANAAAAAAAGgAAABE/VKan6o00AA0ADTQA0aA0AA0xGgAAaAwRoMhkAkkJkBNMUwg0CaaQ2o9R6mNJ6TQ00AaGQAAAGmhp6E9TRo1U1rie267Z1rKIzunL/YhVkwvjiwy3IS7LAjrMgYcd05VACgA+1r8pMnz9gPFstS2DGwLZK7/RppSN28egaY4UjgQQQEAEABEQFJIWLREvuJ1hPrtk0rbN4+0oezF3meXoeyK4CK9F0i5MKJgQ9TgHMRgRJIHE1L5F8gNGoiRrApV3FpvScYTXzhVK4H5IwRvrIBRvUKIVOkjw4OmQwYK59WBPnLCbX2ARWlCLLzuBFiuZd6sKCUu3gOClR2YnbM00JcbW45iJ1/Q5dJK8I66o9mysuytemADsmmGCTC7AwMaAKpTarIKeQfMbzqXTRkOdtP4P0gQxIC7hD+Cl4ccuidti0QRsFYjjEpMO4iHW9C/nU3z1Odfadj8sp3ZZQ4EBhDRh2I/i2B1HKZPXnTeeDLlN+6R40cSgoS5x3784MB7h06IBwDAnx2ETTyimaUAlF2rrsCHk5uApqCjW3Go3MTns/dHddAQhAhNvCCUIb5Hl+NM+12OmJbhZHSYTRZhyL2EQN6oqmjSKuqu8YMWPdRRFjLjTwk0cNf3LRBXJreO67rmNSzaXkWhbVv7+mDw7gxFs5wDJmYndjLDWwz6eg+F1Svnw2C3dzy1FokEkatGzDawycNA1OR4VFJzFkqmKyKSIlbn7cwqGjMK9EdacHzRBZ2ZlD3+q8ZlGQUIkQZkzedYMwc0zdFGCS0NJOq2yBfYjUmftgVsqlJlagMOJarLM4zTJ6K22Cvi5P6j4kGUu+5ve5HOcxzg1YgRgdemszf+X4a3OAAAAAAAAogBDAEnCWtcACIjzQGPOgKM4iKMRhRVk0sp5ma2vNlW5FE0orkAHsVBW0/izvRrwbYGUZU4atPfYyo2ebsWFJiljqga7AWZQYrmuZ0CLxMTMNCm3akrB5POp2mnhRXOKeMVK7GRY7fc/ympHO+DNUaNTS4eYK1Z3V6ji4zZckkabINgsoggox3Qb3ZAVkayaah/En5+vulTg/1r7AxqlKnUwnMT8kuP1v/f4u5IpwoSF180Y+",
        "user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/WaitForDestinationLoadJobs"
      }
    },
    {
      "kind": "Flatten",
      "name": "s42",
      "properties": {
        "display_data": [],
        "inputs": [
          {
            "@type": "OutputReference",
            "output_name": "None",
            "step_name": "s39"
          },
          {
            "@type": "OutputReference",
            "output_name": "None",
            "step_name": "s25"
          }
        ],
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "out",
            "user_name": "write/BigQueryBatchFileLoads/Flatten.out"
          }
        ],
        "user_name": "write/BigQueryBatchFileLoads/Flatten"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
 createTime: '2020-08-27T00:21:19.214483Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-26_17_21_17-6455528061212922695'
 location: 'us-central1'
 name: 'beamapp-jenkins-0827002109-407293'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-27T00:21:19.214483Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-26_17_21_17-6455528061212922695]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-26_17_21_17-6455528061212922695
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-26_17_21_17-6455528061212922695?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py37.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3906.779s

FAILED (SKIP=7, errors=1, failures=5)

> Task :sdks:python:test-suites:dataflow:py37:postCommitIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 118

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py37:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 8m 19s
167 actionable tasks: 128 executed, 35 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/juwwevjsd2mxc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org