You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/08/12 07:12:13 UTC

Build failed in Jenkins: beam_PostCommit_Python35 #2807

See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2807/display/redirect?page=changes>

Changes:

[michal.walenia] [BEAM-10492] Add missing sideinput handling to DLP transforms

[noreply] Use new ZetaSQL value create API (#12536)


------------------------------------------
[...truncated 18.95 MB...]
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "CallableWrapperDoFn",
            "type": "STRING",
            "value": "apache_beam.transforms.core.CallableWrapperDoFn"
          },
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
            "type": "STRING",
            "value": "<lambda>"
          }
        ],
        "non_parallel_inputs": {},
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "To Keys.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s8"
        },
        "serialized_fn": "QlpoOTFBWSZTWQzKr/IAAvb/4H///////////////////+ZrwEACUANW7vdlvNbyzszw0RSPSAB6gM1A00A0A0aBoDQAGnqHqA0G0TRpoMh6RoaNA0KZNGQTCano1TzVBoABoAAGgAAAAA0aA0APUDNINE0mmkmjRoBoAAAAGgAADQAAAAABoAAA01RP1JP1Ro9I00AANAAAAAAAAAAAAAD1AAAlTSZCaTyEymTaehGUMmajTBGRkAwQYIAYEwAmJpiaaekAdo8fucJDOCVCpp4luTBNVcobEsRKlrutoUQ9hggMRghjSKhDNDFEADMAY5oYKX6PpZE6s1KHyg6zQo1SgbyiGmr5sjqee9m/EI8GlLZdfeasCMIIgNRjZQtEkl0gkmZpMkGEGAKUGtEWuAxe3ilznWDPZ4ylAKsV4IycOES566oDFqEQWtHIxY4889CPtHRCAzRjFQT0rCVwhmhkFgw+MTPetCFVzw5dvqGBKE1CRNRwHynTph1xAsJFgKdmo9Mz5SRGjkhs5mNnuwpPh0AYfPoGXrqr8ELp64cXt78qxFQHch0kW2GlMnGx1WOPAZ3oEGCwu8EOPKZeRfB+0qu1C7jc8URBCjKgkpGKKIUZmdARCJRlcQ+YE7EN1hhqkQeaZDizDXGBAsP1nVbXArHl+1j4KdkwHkFNiEQRKI5E86EQSFONRGt5hQny5ZqYAQiCcp+V+IR4frT+fu2zuZ3T9TXxPQgIJHhFJ+EPKLEMGBUE8EINpwoZEwFeEIDW1MqFtgRhrhFge7IZa3QBCdCwZMEEAjJGHqPX61lGN3wGTwcegNlgs0UHlOhQQfqgVNOR1QJ4KZkVtJa6wIBmWZ0Pv0cvS/NmoxYtXeBDIrycUAnxsnAsFMuUGWZWKhTcs46QP1DASOWxVM6cVeESAWA/AM8BCCiPQJRn0LIcQGOhyYiBCQjFL/JYqk4TiBKZC6ogwgoiw4FghGTTiI42qJG3QaaAVqtBKEJApGCAiFWUSb2EtYxweFgjWBPBJloQimWLt+H7IzKNoO+JgQ/oCA5AbjFQqYx1ctowjc5+e+8L+hm5iaBzfSSFUkDbt/GpUbHrq0XIuMzM2rgUjDldCZRaKGvNRHxvGbXHFusVCaxi0R03pFFoiJMQX0c/a2CiI44ZgwVXC6UkRSpakdnj3CjKYgFGk+19o7EUlNtFqcOuVYJ1qNFaI6dgcgISxXNJUgaLEJoMJUJMbBAwnDw+DqDAxaAvJmc58OaAjN0MoM2kziExxPOAaMGpJ8xc1WUt19NdCKEi2OER3jmgFxVYMLnR8ThHm2mRmGwIha8ed/oV4+7fW9OsQbyG7UuYn6+5trOm/ga/Zz+N1f2in/F3JFOFCQDMqv8g",
        "user_name": "To Keys"
      }
    },
    {
      "kind": "ParallelDo",
      "name": "s10",
      "properties": {
        "display_data": [
          {
            "key": "fn",
            "label": "Transform Function",
            "namespace": "apache_beam.transforms.core.ParDo",
            "shortValue": "_DatastoreDeleteFn",
            "type": "STRING",
            "value": "apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreDeleteFn"
          },
          {
            "key": "project",
            "namespace": "apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreDeleteFn",
            "type": "STRING",
            "value": "apache-beam-testing"
          },
          {
            "key": "mutation",
            "namespace": "apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreDeleteFn",
            "type": "STRING",
            "value": "Delete"
          }
        ],
        "non_parallel_inputs": {},
        "output_info": [
          {
            "encoding": {
              "@type": "kind:windowed_value",
              "component_encodings": [
                {
                  "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                  "component_encodings": [
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    },
                    {
                      "@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
                      "component_encodings": [],
                      "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                    }
                  ],
                  "is_pair_like": true,
                  "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
                },
                {
                  "@type": "kind:global_window"
                }
              ],
              "is_wrapper": true
            },
            "output_name": "None",
            "user_name": "delete entities/Write Batch to Datastore.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "None",
          "step_name": "s9"
        },
        "serialized_fn": "QlpoOTFBWSZTWerj27YADJz/////////////////////////////////////////////4A499ntHnc99fezvji+95OuO+13qveAaehyA598+8D7h3hqlT7O7hVT8kwITKnjRNT9KeownihtDRP1Q9Q3qmjyQ9Tam1BmKGj1BiH6k9I81Mk8poY1PUbTU2kNpqbU9RptqnphJp6YiaZmhplT9TMmmp4FQ/RT2lPCn6ajJpinptMmFQqnoGU2iSbTRpopgBpqephqeTTTQQYnkaI9J6npom1Nk9JspPJNhTaeinjRT0wJtU2mAnpNJ5PSZMRPaBpT9TKeiMJkek2piYyJtJ6g0xPFGJh6iZqFTU0wgmU2pho1NqM0GmEmDUwJmpskzKemk9JtEw0Q9I9QNGjJoAAGgNDQA00AANADTIAAGRoPUaaNANAaZPUbSep6jQigNGJohomNJkmp5oo0002oxNqMjZPVPKZNPU9E8o2U9TR6g8keo00ZqaaNAbInqbSbap+qeSPSaPaKNM1NNqeoHqP1RiemkyaHlAaBp6T1D0n6KbSeoxPUek9JoUaJiFPSajT0j0TRpoyaaaA9Q0aNDJ6gAaGgGjQBo0A0DQNAAAaA0AGgDQDQDQ0AAaNNAaAGhiZGhk0aASmohNNCMp5NGgmmT0I1TzRqn6aAaKfoptQ/UaTJvVB6j1P01J5JoP0k0aZM1PUaeoeUGj1NqeKekBp6maeqepk9R+qaPQnqbUG1PU9GpkHqG1Bo9Ro9T0mmm1NPKPUNpGg5CAMruW7Zhhw9UZciEkJ2mqkWQdzZ0oWSbPjLu1gaevkGZAiSz5KxGGBJIYTAySYQAkmS6xwzMG77Lb8vI2nOsBczDTVfQLxueuv86qqemIfkt7PKbu7HJserEu2uBe1x/QgPua1zYD7KgHcnHgW7aFC2z48odl3zxSM367/L0kcxx2CNwxzDEH+sYbJkoyK1WUdWj6sOmM7+Tz9SWg73wbKm8U8NyQ9801dTlea+I0Q8SRuBGZyCL/QKRzgvacjZGyS2Fqlavj3Epj9pGW/jxf03oAzNqwuloUeIoEwwIAZmQkwJCEASnCTZrkJLawUS7z+Gv9VL0pn5rRiLlGomUkEtfpxe9onNYqfI1wgz0jaRGCHLe6bvMOVUsE8VMNVqO6/JkPfoORGnDRSMYRi2ej5s8rdWDaHYvi80Xjl1w0BoZSF/iA/Ppn29P3FtjZhgmxZwE9KzzpO3B2UbNRZ61nykBg01yyVO2Ql5BuxGmX+Ykop2McwQZu10mb8sdAuOWMD7upupD3OXLck2IKWr6ednBzk9NTdFPz9NQUlHSbukpaKop96xqajfVW/+eqq6zgMq3g11fwrCxsuHxPos2dpa21vcNLn6WvFZXV39V3I6bT8blcy+Ztbu+Ys7xYwYMWe0X9JovZMGrJm0atdYhl6muVH4IHCBCnzEQ01Ih1nU3bj2zvkbjsfkdt+m1obSu28z8vApuy/j2HSTd5UdWc3Cnfwz3Ej7DektD0AMkDYaophuMgZpEEKBgnpmPIQzAeoTM1VDAw3AvGq44y26GMZohxKDqBuYlkoAKFESFZoazKiVBXYo2rX4LaeNrfWXjMCYc5VbwGeCTL/NycZLzUu8zRgEsC5AKAGFMIOZ1mNDn39MT9UfZqIZOcwX7UKn4aWrLuygVMdn81Lud0qrd2X8URdIxNjOGwFNxdiNUBi34wGJYBSOTf2goI8ICpYss9n3WLSCTXdvdFcw0KbAbiSxitd9JQRt0mgkNjIhk9QTpEHFgvV/AMMIIBz5fdmNCiuQpdGa5EdxNPEcHNOnSeivJ7WDvIQ+6MJ+WlV0EjJjbH6mjxrGKZqheNyyYcJTbRkNqpXqtwzsMu+UQDNqdxrmtJSqAreYMEjAUnJcg8GREh+EMYVqQvSQVtIcZIYwQ9P7MPtrZ72TC+w0GaXiTKm4VkpQz2lgp9jBlqMygoWaEiiGn6B5cDN8su8xJIy+opsiZbu7WcXdH3mw5eEqx9wj/yWh0WgxYIQPFYpbIbU6EZ7LpO2HAZGn2fUflDB6b33TpwOQbQeUknvx/yQfce1biQ2JCL38qcKaOp63cEVWyCsjWDK5ZQ0DPgw1tDPvMDcvNe+NK7UNaJ3W8TctW1xrOBC5+MqorePNsy2DKtoc071uraVTzNK4TS7hXaes0e2GgoJeA727lal/xF/lb1zntUdxO/rttpyc+e0Uvrt8ynr1FZnpqCgxcZ6nn8NW9T1dx2FnZcPt6te/NRU7z8/p6arr5rz97647FbynXOysuvsma507dOn9TzFcC9/Js0z4CfRY8u+dvriyYKVrKAxrW6d6qXYgIIAAAtgm6TOV/w1xCcBO9u29+5gTJB7gSNRbQScc8y0NAIQhvukA0AOGKovVyMRWditGs6OXUKAOJC7gO01x+oa1ieLPQFGEvC+FqoeHmz8jYR8fImwct0OU7b8fh3nd/TrKcuk3jeVkG+yC7GcDiIaiM4QJMj0T3IHIkyNc68lJiX3HtCCSZQwlWZlbEmq9dSkLl7FJMwQ/HQv8nPQEi00gIcN0aE60KyiDaT/Q9TZA0PUlblD2FLVGDbA/KqHZvEgphy4VGsoFbdz8hwHFwJj1o2fWKpGpi1Z7pJlMBFrI0B/7dzcQ4lCScoAqZeqzRsq6AJd+hZZvpo7bxsPpKfes+9aMD+pNuvKy8OGOsvbtZv35rWqGjV23wuAInzGY7fS2BZsYbu5IWdhJ/rSkmFNgOPi3tCcq9tH3tmZMfTz1ejje5szRN/OFnK3DE80RsG78s2fQOmPYeePcD78yU4KyYdMG0O2Zq/q1KTAJL/KUBuiegz26pdjsyuoI/fqGOYweiJYp6lAhi6rrnZwZmEbJUVkibgwF4Fzt3C9P65HKepEbQn/j16tEqw2LBqbWomw6DFxp2ZmB+5axe4538eT++EndTeW0DZ1No0HKy/Nf3S7Xm9bP6KFpNrf2cAdmhpabRLy1zEHzdi4o7Nx5yD5S6rdbDvICqtve3o8tE2nVwg8xH9qTmbC8pxmv8/X7V0Gc7eB5skFsuv77H52crYsdDGa2zhVhuA9HqzlG+TYfmBA7EFPUlmcTszCAIKh098XMJarWwoxihG0ekzMi59dBVamaRNqoeoL80mDGKoGgRQCKQxwQHgiMQghArQgvARpIoJb0kWKZNZrWOxkF4ml/Bd3faZt/xPnv0FLBAGZv/SgBmZLuSq4toaSFvlHiHpUeOJwN5aDrolxsShcL6rz4rIMpd7baU5mq7Tgp4VZJgAfvolE+0LtOuQQYir96qmKq2uYXuuIo17PGYGC4S3E2kfLrraclI6SLH0fRZq+nctNLSIEJYt8N1hiXs4pvJqd+mTO8lZY2bzYPsiVsJ5oWGT/Gp4OvbqbJOPeVKcVjfvpVmmniWOEQr4JyW7TPpltzy1HWlS4eBErnXIwDLE+tGui2fCS4Ntm0SXRWaPn5m/V6uBPjV0KZJGAj9GUYXjBv4SeNlBTpAMAmhMBUFe1zHXbC3Iy3sM/kMhzUmoqUVlmXyucSlatAD07YVzromlm8DkjKOp/3+uVb+f1WQeAWE/W0OB/Kn/N0OsukRHms+tcf4yUsmMrUc2qgxjEMYAAxjEMdVq/J76zHQYL7+d1I6CzJP0srO5ixKDMzvbI7jo3GPvCL1lGJ8slc/4TyCVCEPTDh0kDyFERsugmNP6TaeJ0GXizPIjfsJ1NgIadXGhyQBlrAKRZ/DQRV4mQCVQkiYDlPGQIZzSWT+rlvSU6LnmFqa/oeodUydjMn4EO4YytNxZV+ooszQFyhzRcXhVhz5upt95A5JLve40mHv34dYEc9u+rNrpbvMQ2DIAqRtXmXIssNHOhnDREkEA/U2/f/1wY4LOVPVR1aNNEFip2SnuJh5b2agpn+9bzbjLFxm7Sljws16x11KxgYyCtrxmYZo2ZqUqXFfgEf4M7QwMbc0aVaX0cFZQmhC3p6FCSEsplpARQky5jc5051J8FpLl0SeTGhgJV0SfHUhDrhCQQCgHSi8tMb3HA8B66ZAILig+Sqv3ta4bLnggcu4A52cpIvwATiz8zFov73dZ4y4vVfF0RgGPnHmn4d8aY05ZxmRrNDJnd1r8S/AKtu67PJS5Muzxo7nd1MbR075jPpifoXBPz4LRIz06VmTOls6KSc6VeuwTqaQQoBCoAEGSghtyBjck5wDwqKAlSBklQ9Ca18JRp9rFnhDAQRdnJioDoQSDtZpkUHTB6Ix1x38hDLS2vgaDbVx6W0lJ++tKetoAEWpgjfAWCatLm7TCqQEVczyM7LXzOBKHavMPjJhOaayCBWVyM5jXwO8ESPYkpnymnic0lB+e2f3oqFRzBZWxcaCZ58V06UznucXTAV9FnQtxUxqiGjqpJybVVvk6WKfBRU8b6HhW8WDaAHVjkKR64xO7uw0SJ8dHt6125hpyS/eleso5tO3RzMylY5CDoOc52hylKgiXY4opJykGoYCUtS4uXmUNOo3DJkQhV0IawaiEEICEIRRXFKUlK97TQqpmDXJrVAKJwFITAYCGPVoZjuUMzdNqpkc2FgDWIAJCemcMzVEMNl30KMVLRypP74T450NY97331/MnWMcdi974cp55zZh0/foZoUEsgJJTMYahem4l1g4EsktGJhJI04Wxmt3vG8Hh6fUcjYaefi3Lrmg5oXmJTda4FO3LZk6veiYIsWm28BIiOwlM0jAIkKX2YaGm4EPraUugyyZOJzAOZ45kmgMXErWiMOnKlyQvaqlRYhYB8FObDto9dMatGFNilNMhFXMTSwrZaOZz6PBi41jouRy8l53oHV2/tH1K7p1E00WqlQdgJp+DQSOqRDHBQnQARFNZIcH7n2rPuHJQOR4Gv5042yPWx/Hl2CCq0TZADtMW95dMMNozBRAy3g1GKixvKxufrEFJ/yijX4pb6kjT/NgF1iTnhHI03h8pZjhIVHhEvIYaVFOKCB6KE4hNUsJaJNkbv7qe16InFs6KOudbBIohLCc5y813vi8IYJ3BMxywkloI3WHgHi2Kh4mn5CGXJd7yovXCTdRb00gAJQpAdVnYDk0tEwgKt8kLVFNShQ+RDhXjZP4BjfR0e0scWYzQxabAjn2Zwmo+LqJT07BtujbM6m3dY4ApfQOzVbxCKDqP9tDoYSrqTezpnLrSyZAhwE0XIAxOn8pVutHp9u4g3Stelje5X3YaXcQMYq9FA496jFWVQN4t668+pYvt+zcZCOHwHHzExtlCiw91tHtcb6/t4DO7nE6ODP8dxoke84biqgp9o44MebfnFapjwr5xsV1q8Bdusqjc9E6yXBTcfcdY8r+8tXtwvUudyXXWorHzpk7S3UONpHaZBksBxf8rLQQN2KbgLZI8NOXCRltXvH8PrnEF59Xr5Lrpy7jMR1XJwAZ/dYL2tV7uTZ5yC+zLieqOK4P11rryi41lq7qLasqQNyEaTTZR/i8Rw75dPHqw7T4DmC7Q1gg2vdaXzNbrel9JV/NB7Lb9Dhb2OKTI3t8aQEgdAWpu6rkP4SoXzupOZ9nA2EqG89SFxyxFPnJAGNVUriZ1EDY5W4p/FukoAuedPgK0pi+Db2JvO9C/weGIMg5QhPBX3KZMUOQbJj9sKL1R73yL0eWvMe4fqGURneha6ORgEXV+JgBlDWu5MAmAtu3o0wRwBhLpwukjGTHiZLCLSHsw8YOUrtKMSv7s6wnzXi5m99UtYFFvsvtKL/cpgGEt38sF105JwwGdAj8WD4u129ro7nK1SZIROU/S1NwDTg6oSTuwOfR49DZ/WS9iSAQLl5+Mth5NPfKWOv0PiJItUicU4BK7s97cDF0fDFnNH0IuBJHpqmxca9AWXoJekMk0p8sV7iGGIXjXxML/EGcGUKyJoQDRLkYYFQLSjHw77DU3hh5H88b0N9bYPql62SluMgk/aScYv0SPOc96hpRya18gZWfFwGZYE3VN0xoCHi/tGaKVwJXDmwgRhUdK/UEHgfbRjFekPBeXcPaYgmTiZPZdHYPIMotVeCAgDaHIUYl8IHrIBSG5WKilEAopNqmUw8LJsWgtwZnLSRs4h6CvHoTWmCvlSwNZu382WNkFh3SEVTqe5cTKYyP0/WUJThyeYjXcyQ8i69U5xislv42RPeXy351yFR3LLjKsmhyKbrmgrwx3WFeOjaPv8kdVHx9ztX87WyN0lRHME5AQsN/wUWoJBw6Y2oWt2pWzodejrDMJoe45lgEAwZTfuyxWhaofbC0Po0uXk3wV/pZNhXvmISiTO3Yh/Iacc5twHac7FrBW8zYDBhIYhaK2EaYO1jZ1Y35FJBnJ9zE71J6ZOgjLiYf7sIS5yvtyl5zrFANUuwqLU1R43hGTMx/Zz4XE0T9hRByUwNDMK1HxR0u7r0cNmtjNz1ISf1d6RLzhEZFZmjK8ueMiy2dh3AyCxZHc6OzKA0k2iUCj76cs4M5zbOFMwoLdrTEvmKVaTsxDI1wDPJeeXBBzmeoKhdsyyZvb1T36K2LyS3hgEgUEsIAsu098o1WSQicDS2qMogHZU3Zdz7MQknkJBfCFIgF5xnirZdw5Le7z0aKVldCJu6+ixi4jMeMSZbsdx6KVa4oOVlyvZRNAoFZ3zrhYqNKf69chJzyMrVvvP7WGgeCkKKq5chYbDYa3W+FL3RDApxjXpm/zYtjuteUBn7ed6cyUQ8303A4swxPpIPxl7PRIUFwnYDoeXYOs9nOrGCrYPfvszJ4Y/4P6u6AaM4QmPiNRzw4aFxvBzSxILFK3RAghXqyJ7CmOIVrst3kWvOmHyCb5p/IOi2yuQ8bSDuh9xXFlW3gtn9p5GbBl2lvT/pSKhieOVtxjsOzQkWUVINC5zgIk9aMAvAMRaF6srdd9MNHGHXwmK5WVFZBPav7FlHYHJec40miRh53XKBxm4PIJyS9ks4H457b4dtp0o4FCNizJYO92LcCdmSGY81aNbyY2S/I87HB0B9/yHSc3ydG8KRLsdtg4x95j9kYhCHtbMO5kM7uVazTEDJ/Rkf2dKiYw/FyvKxFBbzvNajKwIt5e54T8rc5H/xdyRThQkOrj27Y",
        "user_name": "delete entities/Write Batch to Datastore"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
 createTime: '2020-08-12T06:39:16.345272Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-11_23_39_14-8343172392530526585'
 location: 'us-central1'
 name: 'beamapp-jenkins-0812061637-113311'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-12T06:39:16.345272Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-11_23_39_14-8343172392530526585]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-11_23_39_14-8343172392530526585
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-11_23_39_14-8343172392530526585?project=apache-beam-testing
apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2020-08-11_23_39_14-8343172392530526585 is in state JOB_STATE_RUNNING
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:14.762Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-08-11_23_39_14-8343172392530526585. The number of workers will be between 1 and 1000.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:14.762Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-08-11_23_39_14-8343172392530526585.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:19.288Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.030Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.082Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step read from datastore/Reshuffle/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.106Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.131Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.180Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.210Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.241Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/SplitQuery into read from datastore/UserQuery/Read
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.267Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/AddRandomKeys into read from datastore/SplitQuery
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.295Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps) into read from datastore/Reshuffle/AddRandomKeys
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.321Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify into read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.349Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Write into read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.368Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow into read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Read
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.395Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps) into read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.420Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/RemoveRandomKeys into read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.446Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Read into read from datastore/Reshuffle/RemoveRandomKeys
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.468Z: JOB_MESSAGE_DETAILED: Fusing consumer To Keys into read from datastore/Read
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.500Z: JOB_MESSAGE_DETAILED: Fusing consumer delete entities/Write Batch to Datastore into To Keys
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.524Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.546Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.569Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.591Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.707Z: JOB_MESSAGE_DEBUG: Executing wait step start13
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.770Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Create
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.803Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.831Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.864Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Create
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.914Z: JOB_MESSAGE_DEBUG: Value "read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Session" materialized.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:20.966Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/UserQuery/Read+read from datastore/SplitQuery+read from datastore/Reshuffle/AddRandomKeys+read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:47.381Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:39:54.773Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:41:26.368Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:41:26.403Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:40.346Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/UserQuery/Read+read from datastore/SplitQuery+read from datastore/Reshuffle/AddRandomKeys+read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:40.414Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Close
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:40.461Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Close
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:40.528Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Read+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+read from datastore/Reshuffle/RemoveRandomKeys+read from datastore/Read+To Keys+delete entities/Write Batch to Datastore
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:51.428Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Read+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+read from datastore/Reshuffle/RemoveRandomKeys+read from datastore/Read+To Keys+delete entities/Write Batch to Datastore
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:51.489Z: JOB_MESSAGE_DEBUG: Executing success step success11
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:51.610Z: JOB_MESSAGE_DETAILED: Cleaning up.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:51.662Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:44:51.690Z: JOB_MESSAGE_BASIC: Stopping worker pool...
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:45:37.461Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:45:37.496Z: JOB_MESSAGE_BASIC: Worker pool stopped.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-08-12T06:45:37.536Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2020-08-11_23_39_14-8343172392530526585 is in state JOB_STATE_DONE
apache_beam.io.gcp.datastore.v1new.datastore_write_it_pipeline: INFO: Querying for the entities to make sure there are none present.
apache_beam.runners.portability.stager: INFO: Executing command: ['<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/bin/python',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 4113.051s

FAILED (SKIP=7, errors=1)

> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 210

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py35:postCommitPy35IT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 11m 43s
139 actionable tasks: 106 executed, 32 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/dbfh4q7suwfpu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PostCommit_Python35 #2810

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2810/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python35 #2809

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2809/display/redirect?page=changes>

Changes:

[Maximilian Michels] Revert "Merge pull request #12408: [BEAM-10602] Display Python streaming

[kcweaver] [BEAM-10681] Set metrics supported in Spark portable runner.

[noreply] [BEAM-7705] Add BigQuery Java samples (#12118)

[Maximilian Michels] [BEAM-10602] Add latency/checkpoint duration as separate panels in ParDo

[tobiasz.kedzierski] [BEAM-10686] Simplify names for GCP variables check in GA

[noreply] Fix format string in PipelineValidator (#12522)

[noreply] Fix some typos (#12539)

[noreply] Linkage Checker 1.5.0 (#12545)


------------------------------------------
[...truncated 18.68 MB...]
            },
            "output_name": "None",
            "user_name": "m_out.out"
          }
        ],
        "parallel_input": {
          "@type": "OutputReference",
          "output_name": "out",
          "step_name": "s4"
        },
        "serialized_fn": "QlpoOTFBWSZTWfqGx+MAAp9/8H/////////////cwr///+ZrwCAAAEBAAvykVARIamIFGp+qG1T1PTU8U8JNqA9GUA0Gg2oDTJ6g0PJA0aepkG1GI3pTyhwAAAAAAAAAAAAAAAAAAADIOAAAAAAAAAAAAAAAAAAAAZAlECGQmI01T9TU9JPU9JpkaGmAEwQ0wEwNQZDQyDGgATJthfdEqrZOxqZcvL16p81s9r1i5lWfLljc8ENlFBPOlnhaHVmYgk2F9jEcqoORUSEnDUMhkYmHc/pGyQuigtcGq4VIx7IKH9WxgYaIhoikMwYM1C+Zl9MGDfetn5UMA2ZShrfLFCZUUVRdhjFWsYmyqINUDU1cW6+G1+V3I0dfY/XuQC5bMEGpiu08jFBVF7uLmvqY1YbPWdIJ5MOqoAlF+CoEBj3D6TdBErEY3iMoNPNLN2dXbbtbTa+dnJCLtEItcJeXAUy+tlY3R1Lfi1fL7L3t+GjRFb7VZ9k9vTo9626vo6lzj6ztS5xNy86709i4cfOLAfvu3JYZf7tSqQpgDWpCzY6ChbDw5pB5paNZy3soKITDxm4bJA4zw2bPih6KUCiqcbyAhzAVf5bNWA0GhFlP/YXM4Jk5wAigngakVP79nBuv07+z85TJ+/GgAgI8NYVhAJtSy5EgUaaM4tKyYolCGEgpjCo22JCfHS/TD7wNVxUMtEJEz/z15dJ70n/Qfg7Ia1s8h/pGORpBk44Uzl5iDLLLgaV0UA1s2AT/54ezWBVQbW8yWRMsGAwQfmUdA85qGLbsvpJ9BwlYmJppylsRLjEuy2iGK7lY36FrvwNAhQ9Zvr+QIwgqwRDWFyOJy26DSA9bAn7EEIK2CJQVMUc4bSqilAK9QX4aiW7qM+LZxgtkHozTSGpfD8YY1IKlRtLQPUDFrFipnM000udkg+TStSSOQUMMmwgigZ4rDo5NJsuLMo4lryJaZjDmPcSpmUZMxGeQVVgYxZvJ81GoiJDJpT4PeZnAOIgQGfRrxMBjLB0nK65MCqdRy3KYKlTkZdQTX1kCLz+GEBOiQNA13WkpLCWZq2xeMUkjslNT4xvLwnHsTXHZpSjBHnjXqcqG8uiFIsm5AkartukFP+/+UtE/zRLmXle82xXj2WlFzkSZsaUSmhGViURCULK1WJ+LQxwpKDlb3BJJhw/7FOx0P1d/4u5IpwoSH1DY/GA=",
        "user_name": "m_out"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
 createTime: '2020-08-12T19:01:41.240231Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-12_12_01_39-3192924686630996756'
 location: 'us-central1'
 name: 'beamapp-jenkins-0812190131-049088'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-12T19:01:41.240231Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2020-08-12_12_01_39-3192924686630996756]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2020-08-12_12_01_39-3192924686630996756
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-12_12_01_39-3192924686630996756?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-12_12_01_39-3192924686630996756?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_12_01_39-3192924686630996756 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:39.637Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-08-12_12_01_39-3192924686630996756. The number of workers will be between 1 and 1000.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:39.637Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-08-12_12_01_39-3192924686630996756.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:44.619Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-f.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.158Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.197Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step GroupByKey: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.245Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.278Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.345Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.381Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.417Z: JOB_MESSAGE_DETAILED: Fusing consumer metrics into Create/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.450Z: JOB_MESSAGE_DETAILED: Fusing consumer map_to_common_key into metrics
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.487Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Reify into map_to_common_key
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.521Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Write into GroupByKey/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.543Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/GroupByWindow into GroupByKey/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.572Z: JOB_MESSAGE_DETAILED: Fusing consumer m_out into GroupByKey/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.607Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.640Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.677Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.710Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.893Z: JOB_MESSAGE_DEBUG: Executing wait step start13
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:47.960Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:48.007Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:48.042Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:48.089Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:48.139Z: JOB_MESSAGE_DEBUG: Value "GroupByKey/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:48.210Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:02:00.751Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:02:00.799Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:02:00.823Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:01:59.219Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:02:05.494Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_11_54_37-1622717965737340533 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:02:12.306Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:02:40.487Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:02:40.525Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:03:07.370Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:03:31.457Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:03:31.491Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:23.500Z: JOB_MESSAGE_BASIC: Executing BigQuery import job "dataflow_job_18443008169449848470". You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_18443008169449848470".
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:29.959Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:30.066Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:34.231Z: JOB_MESSAGE_BASIC: BigQuery import job "dataflow_job_18443008169449848470" done.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:35.079Z: JOB_MESSAGE_BASIC: Finished operation read+write/NativeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:35.153Z: JOB_MESSAGE_DEBUG: Executing success step success1
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:35.263Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:35.568Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:04:35.602Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:05:29.630Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:05:29.671Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:05:29.710Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_11_58_53-6739733209432800708 is in state JOB_STATE_DONE
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Attempting to perform query SELECT fruit from `python_query_to_table_15972587211881.output_table`; to BQ
DEBUG:google.auth._default:Checking None for explicit credentials as part of auth process...
DEBUG:google.auth._default:Checking Cloud SDK credentials as part of auth process...
DEBUG:google.auth._default:Cloud SDK credentials not found on disk; not using them
DEBUG:google.auth._default:Checking for App Engine runtime as part of auth process...
DEBUG:google.auth._default:No App Engine library was found so cannot authentication via App Engine Identity Credentials.
DEBUG:google.auth.transport._http_client:Making request: GET http://169.254.169.254
DEBUG:google.auth.transport._http_client:Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): metadata.google.internal:80
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bigquery.googleapis.com:443
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "POST /bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/85636c86-1036-40ac-8cbb-183e031df078?maxResults=0&location=US&timeoutMs=10000 HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/jobs/85636c86-1036-40ac-8cbb-183e031df078?location=US HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anonbfd1ad7d1f9e997da63802acd60be25f52468bf6/data HTTP/1.1" 200 None
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Read from given query (SELECT fruit from `python_query_to_table_15972587211881.output_table`;), total rows 2
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Generate checksum: 158a8ea1c254fcf40d4ed3e7c0242c3ea0a29e72
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:00.935Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Create/Read+Type matches/Group/pair_with_0+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:04.638Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+InspectForDetails/ParDo(_InspectFn)+ParDo(CallableWrapperDoFn)/ParDo(CallableWrapperDoFn)+Type matches/WindowInto(WindowIntoFn)+Type matches/ToVoidKey+Type matches/Group/pair_with_1+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:04.724Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:04.816Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:04.920Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:12.120Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:12.197Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:12.337Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:12.435Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:12.473Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:06:57.268Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:00.424Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+ExternalTransform(simple)/Map(<lambda at external_it_test.py:43>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:00.487Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:00.537Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:00.596Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:05.528Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:05.595Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:05.645Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:09.857Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:09.934Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:10.191Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:10.240Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:07:10.263Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_11_59_58-4099221058121290750 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:00.697Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:00.732Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:00.771Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_12_01_21-638214378783837261 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:27.104Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:27.235Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:27.296Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:27.365Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:36.481Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:36.620Z: JOB_MESSAGE_DEBUG: Executing success step success11
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:37.744Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:37.789Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:08:37.824Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:09:31.172Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:09:31.206Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T19:09:31.242Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_12_01_39-3192924686630996756 is in state JOB_STATE_DONE
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_streaming_wordcount_debugging_it (apache_beam.examples.streaming_wordcount_debugging_it_test.StreamingWordcountDebuggingIT) ... SKIP: Skipped due to [BEAM-3377]: assert_that not working for streaming
test_autocomplete_it (apache_beam.examples.complete.autocomplete_test.AutocompleteTest) ... ok
test_datastore_wordcount_it (apache_beam.examples.cookbook.datastore_wordcount_it_test.DatastoreWordCountIT) ... ok
test_leader_board_it (apache_beam.examples.complete.game.leader_board_it_test.LeaderBoardIT) ... ok
test_game_stats_it (apache_beam.examples.complete.game.game_stats_it_test.GameStatsIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_user_score_it (apache_beam.examples.complete.game.user_score_it_test.UserScoreIT) ... ok
test_avro_it (apache_beam.examples.fastavro_it_test.FastavroIT) ... ok
test_hourly_team_score_it (apache_beam.examples.complete.game.hourly_team_score_it_test.HourlyTeamScoreIT) ... ok
test_read_via_sql (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_read_via_table (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_bqfl_streaming (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... SKIP: TestStream is not supported on TestDataflowRunner
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_one_job_fails_all_jobs_fail (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_bigquery_read_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_bigquery_read_custom_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_avro_file_load (apache_beam.io.gcp.bigquery_test.BigQueryFileLoadsIntegrationTests) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_spanner_error (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_spanner_update (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_write_batches (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_copy (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_value_provider_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_datastore_write_limit (apache_beam.io.gcp.datastore.v1new.datastore_write_it_test.DatastoreWriteIT) ... ok
test_parquetio_it (apache_beam.io.parquetio_it_test.TestParquetIT) ... ok
test_transform_on_gcs (apache_beam.io.fileio_test.MatchIntegrationTest) ... ok
test_dicom_search_instances (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_dicom_store_instance_from_gcs (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_file_loads (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... SKIP: https://issuetracker.google.com/issues/118375066
test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... ok
test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_analyzing_syntax (apache_beam.ml.gcp.naturallanguageml_test_it.NaturalLanguageMlTestIT) ... ok
Runs streaming Dataflow job and verifies that user metrics are reported ... ok
test_basic_execution (apache_beam.testing.test_stream_it_test.TestStreamIntegrationTests) ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream supports emitting to multiple PCollections. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream can independently control output watermarks. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
test_big_query_write (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_new_types (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_schema_autodetect (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... SKIP: DataflowRunner does not support schema autodetection
test_big_query_write_without_schema (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_label_detection_with_video_context (apache_beam.ml.gcp.videointelligenceml_test_it.VideoIntelligenceMlTestIT) ... ok
test_text_detection_with_language_hint (apache_beam.ml.gcp.visionml_test_it.VisionMlTestIT) ... ok
test_big_query_legacy_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_avro (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql_kms_key_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_deidentification (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_inspection (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_job_python_from_python_it (apache_beam.transforms.external_it_test.ExternalTransformIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
test_metrics_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3988.958s

OK (SKIP=7)

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 210

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py35:postCommitPy35IT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 9m 23s
139 actionable tasks: 107 executed, 31 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/ihpvuphcgqs2k

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Build failed in Jenkins: beam_PostCommit_Python35 #2808

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2808/display/redirect>

Changes:


------------------------------------------
[...truncated 18.69 MB...]
          "output_name": "out",
          "step_name": "s4"
        },
        "serialized_fn": "QlpoOTFBWSZTWVK0JDoAAp9/8H/////////////cwr///+ZrwCAAAEBAAvd04ugN13YamiGlNpqA000xNqepkAZMg0AA0NAAGmgaAekAaA9R6g1ASeqflPUT9TIgANAAAANGgAAAAAANDRoACIxKekjRoaDTTRoGQANDRowgMgyDJoGIAMQ0GQwCUQmjRMmmkzU9FPRNGgaaAABoBoAaDIDTQAGmgNANsv6sNiGUY5H38eS1UDlOSVaDNkPvrjJAIPEhQCTiT8w4NCNiCR13qWI5VQcioj5nDULZbYlep60bMhVKCrQyZI/kEbCrRAfpqUCiIiEiQRCAgIoDzEUh5UaP4wfugNYY9SDW/SVCVUUVRdFjFWgYGqog1QMja5bcFeHNdnYe5paeo9KlK0GJYuP82KCqL6X3rHxRzsasmr23QSRSG2cAVReJQyAepxFpSoRakcVCOTKx2yb6ddxbrprSJExDLGYQY4AhKj8WhHclH8xN0J+Xs0KNtzTYYtYcaFfHcnUtPE0XKM/ajbGlv7djT47uj0H3SnSnvWspcdBAU7p0eQQbAG1IGDLvTDSC4SsQXOjBY46ETIEHxkQzMbMgZ0QfKnlv/FpAhPIN5oP6YKuc2FEAeBjlLFV6hDvd0iEAGNPnPHZUzJc2arL7Ofpnk0PtGOAGlVeUKweEeCmpEeQxQvi2lmYokEK5gtSvnMmwfJZiixP0AMhxOMuCExHF4tnNxookk0yKt1syrkkxFrjHI0eyQcKXy8WAymmoGlEIA1sdYSe7R1qAJ4GwvFumUuvYDBCLGUc8+5gLG1XdckwnFViWGK1dLkolRYVXbghYu3WW9hWi9WYRCESx5+YEr3qr0QyhbbiQuVPaPIlpCTvPQerXokCdijnDS0ikAWJQXZTk2bOX7GyDBaXxIzFaDBef4X2ToKk5j3APyDFoFlUvmNGl9Bqwe4iy3XYNaoIf67yoD+sOd6+TAdy1nzD+K8oo/fIhKnrl0ka7ailVcRaJMzJRLSu5JhgzMmjluzWsRFqzWlIJAMy+d2agcWYPFSbHJUGjNJUSZUNNR65oVq7aAhSS6yyILCAsB+JlwIaHCGZDlpBihhERYbUrXHEcBQSYkkIgYxbxEicXKlv3tUoWhZm2wmMh2Wj1M/bTTYZM2UqZeKN5klFmk0hU5EStXoiFACFWyMRCqEpQ0Cy/pMxmIYJNUqff3+fTt5+/z3tw/4u5IpwoSClaEh0A",
        "user_name": "m_out"
      }
    }
  ],
  "type": "JOB_TYPE_BATCH"
}
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
 createTime: '2020-08-12T13:01:19.631723Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2020-08-12_06_01_17-16001836394275850222'
 location: 'us-central1'
 name: 'beamapp-jenkins-0812130106-985175'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2020-08-12T13:01:19.631723Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2020-08-12_06_01_17-16001836394275850222]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2020-08-12_06_01_17-16001836394275850222
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-12_06_01_17-16001836394275850222?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-12_06_01_17-16001836394275850222?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_06_01_17-16001836394275850222 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:18.030Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-08-12_06_01_17-16001836394275850222.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:18.030Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-08-12_06_01_17-16001836394275850222. The number of workers will be between 1 and 1000.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:24.582Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.376Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.412Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step GroupByKey: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.448Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.480Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.537Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.577Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.648Z: JOB_MESSAGE_DETAILED: Fusing consumer metrics into Create/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.675Z: JOB_MESSAGE_DETAILED: Fusing consumer map_to_common_key into metrics
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.707Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Reify into map_to_common_key
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.742Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Write into GroupByKey/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.774Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/GroupByWindow into GroupByKey/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.798Z: JOB_MESSAGE_DETAILED: Fusing consumer m_out into GroupByKey/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.941Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:25.977Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.015Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.059Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.275Z: JOB_MESSAGE_DEBUG: Executing wait step start13
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.345Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.390Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.426Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.467Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.531Z: JOB_MESSAGE_DEBUG: Value "GroupByKey/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:26.600Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:51.959Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:01:55.032Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:02:35.916Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:02:35.953Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:33.544Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:33.574Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:43.939Z: JOB_MESSAGE_BASIC: Executing BigQuery import job "dataflow_job_6726702098962397387". You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_6726702098962397387".
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:54.444Z: JOB_MESSAGE_BASIC: BigQuery import job "dataflow_job_6726702098962397387" done.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:55.137Z: JOB_MESSAGE_BASIC: Finished operation read+write/NativeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:55.193Z: JOB_MESSAGE_DEBUG: Executing success step success1
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:55.306Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:55.462Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:03:55.498Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:08.999Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Create/Read+Type matches/Group/pair_with_0+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:12.681Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+InspectForDetails/ParDo(_InspectFn)+ParDo(CallableWrapperDoFn)/ParDo(CallableWrapperDoFn)+Type matches/WindowInto(WindowIntoFn)+Type matches/ToVoidKey+Type matches/Group/pair_with_1+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:12.753Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:12.807Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:12.888Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:22.109Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:22.167Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:22.280Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:22.324Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:22.359Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:55.373Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:55.419Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:04:55.465Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_05_58_18-13619946588618195421 is in state JOB_STATE_DONE
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Attempting to perform query SELECT fruit from `python_query_to_table_15972370843116.output_table`; to BQ
DEBUG:google.auth._default:Checking None for explicit credentials as part of auth process...
DEBUG:google.auth._default:Checking Cloud SDK credentials as part of auth process...
DEBUG:google.auth._default:Cloud SDK credentials not found on disk; not using them
DEBUG:google.auth._default:Checking for App Engine runtime as part of auth process...
DEBUG:google.auth._default:No App Engine library was found so cannot authentication via App Engine Identity Credentials.
DEBUG:google.auth.transport._http_client:Making request: GET http://169.254.169.254
DEBUG:google.auth.transport._http_client:Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): metadata.google.internal:80
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bigquery.googleapis.com:443
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "POST /bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/89969429-75ff-4ae5-96e1-035456ea9b16?maxResults=0&location=US HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anon08f89733c1ed2c96a1936cc9eb0f112861e10a34/data HTTP/1.1" 200 None
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Read from given query (SELECT fruit from `python_query_to_table_15972370843116.output_table`;), total rows 2
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Generate checksum: 158a8ea1c254fcf40d4ed3e7c0242c3ea0a29e72
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:11.830Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:11.882Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:11.922Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_05_58_48-15535073943335571144 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:51.046Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:57.651Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+ExternalTransform(simple)/Map(<lambda at external_it_test.py:43>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:57.740Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:57.792Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:05:57.863Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:07.059Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:07.126Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:07.255Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:07.319Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:07.349Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:53.345Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:53.378Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:06:53.411Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_06_00_10-12329415187911683549 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:06.715Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:06.794Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:06.849Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:06.919Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:16Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:16.064Z: JOB_MESSAGE_DEBUG: Executing success step success11
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:16.272Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:16.325Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:07:16.354Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:08:00.781Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:08:00.828Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-12T13:08:00.855Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-12_06_01_17-16001836394275850222 is in state JOB_STATE_DONE
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_streaming_wordcount_debugging_it (apache_beam.examples.streaming_wordcount_debugging_it_test.StreamingWordcountDebuggingIT) ... SKIP: Skipped due to [BEAM-3377]: assert_that not working for streaming
test_autocomplete_it (apache_beam.examples.complete.autocomplete_test.AutocompleteTest) ... ok
test_datastore_wordcount_it (apache_beam.examples.cookbook.datastore_wordcount_it_test.DatastoreWordCountIT) ... ok
test_leader_board_it (apache_beam.examples.complete.game.leader_board_it_test.LeaderBoardIT) ... ok
test_game_stats_it (apache_beam.examples.complete.game.game_stats_it_test.GameStatsIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_user_score_it (apache_beam.examples.complete.game.user_score_it_test.UserScoreIT) ... ok
test_avro_it (apache_beam.examples.fastavro_it_test.FastavroIT) ... ok
test_hourly_team_score_it (apache_beam.examples.complete.game.hourly_team_score_it_test.HourlyTeamScoreIT) ... ok
test_read_via_sql (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_read_via_table (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_bigquery_read_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_bigquery_read_custom_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_bqfl_streaming (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... SKIP: TestStream is not supported on TestDataflowRunner
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_one_job_fails_all_jobs_fail (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_avro_file_load (apache_beam.io.gcp.bigquery_test.BigQueryFileLoadsIntegrationTests) ... ok
test_spanner_error (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_spanner_update (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_write_batches (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_copy (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_value_provider_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_transform_on_gcs (apache_beam.io.fileio_test.MatchIntegrationTest) ... ok
test_datastore_write_limit (apache_beam.io.gcp.datastore.v1new.datastore_write_it_test.DatastoreWriteIT) ... ok
test_dicom_search_instances (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_dicom_store_instance_from_gcs (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_file_loads (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... SKIP: https://issuetracker.google.com/issues/118375066
test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... ok
test_parquetio_it (apache_beam.io.parquetio_it_test.TestParquetIT) ... ok
test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_analyzing_syntax (apache_beam.ml.gcp.naturallanguageml_test_it.NaturalLanguageMlTestIT) ... ok
test_text_detection_with_language_hint (apache_beam.ml.gcp.visionml_test_it.VisionMlTestIT) ... ok
test_basic_execution (apache_beam.testing.test_stream_it_test.TestStreamIntegrationTests) ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream supports emitting to multiple PCollections. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream can independently control output watermarks. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
test_label_detection_with_video_context (apache_beam.ml.gcp.videointelligenceml_test_it.VideoIntelligenceMlTestIT) ... ok
test_big_query_write (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_new_types (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_schema_autodetect (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... SKIP: DataflowRunner does not support schema autodetection
test_big_query_write_without_schema (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
Runs streaming Dataflow job and verifies that user metrics are reported ... ok
test_big_query_legacy_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_avro (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql_kms_key_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_deidentification (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_inspection (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_job_python_from_python_it (apache_beam.transforms.external_it_test.ExternalTransformIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
test_metrics_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok

----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3922.222s

OK (SKIP=7)

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48

* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 210

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py35:postCommitPy35IT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 7m 48s
139 actionable tasks: 104 executed, 34 from cache, 1 up-to-date

Publishing build scan...
https://gradle.com/s/7fl4zn3lgt5la

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org