You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/05/29 13:11:47 UTC
Build failed in Jenkins: beam_PostCommit_Python36 #2494
See <https://builds.apache.org/job/beam_PostCommit_Python36/2494/display/redirect?page=changes>
Changes:
[aromanenko.dev] [BEAM-9916] Fixed some IO Urls on website
------------------------------------------
[...truncated 9.31 MB...]
{
"@type": "FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "delete entities/Write Batch to Datastore.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s9"
},
"serialized_fn": "eNqtmXdYFNcWwAdxRBcUBUUBFRUFBMGCjaKgIOWAElBwreuyDOzCFmZ2V4mKgg0cJDbsBTXYNYkVo9hL7Ni72AX1xd4b71zwmnnve1++/PH8g/PbO7efOk6WpYcqSaPV+ijIX5kihTMplCaTIOMZeW2GYRLNGq1JozfyFnIr/ImPyVO+xhTeMo6vqVKmK1VqTpHIKXU+GoNPiirdJ0lpUhpNBoHzGdlRz43667fGIAvltJyJCxMMulDaKuNZuR3OrPje8q2Tnq81hbeK42u3zebrZPIyj6r9KNIFQyqnMvHWcnv8Wb2+N1nf28QZcacpvE3VThUqrYbTm/i6/eT1yE8hXaUwmlUqzmjkjHw99X/uXceZBI3K+E3K+lb/lPG28gY4mOwoRUkmDzGY9SZO4OtP4RvE8Xa4NftMvqGH3Bp7VY9V6JU6jm/0N7MnKo3ctxX6YV8Z74DTNM7km3jI6+A0ZLwRB3O8ozz4+xH/6RX7fL/GvmZUFblGJ3nNb9PyzvJGiN+7x6Wr+n+/kqbmRLklPtXoVXyz/7l9LoNTmU0ag/7b7uPTcSYOTaX5/+yu4rRao+zbjYXgDxnvom4cZZHDt4jjW+Jq1lQvnCAYBCPfSk0u1DWTb+2hbqQmt9Imk3fzUP+f7sFd7VxladLj96le2cOcqG6mbq52Ubch+2sbx3vi/mzJ/kxqwWAyabkkhZFTGXmvqj22y+S96R59Mvn2/7c9dsA9OuNEKrPOrEWLG8kNqF4fba8/pzLok4x8x++b9SGb7RTH++JmZdLNCnznf+KayiRlOlnjr3GyXt+aBnxv4bvgIbtm8t085HXJGkqtViFwvBm9zch3/yfLoM1oZX0NI8kZzDoZ74cT+mfyAR5yGzKh3qxTJJpVaRzOFxiVUX2S6gaFzsj36FthWe3CKrMgoEsrNPokLoPvGcXIG0ubdUaFEY2XU3DpBpWaD4qqjmDf5w4exvfyGMb39ohiohhuGB9CIZRCHwphFMIpRFCIpAAUoihEU+hLoR+FGAo/UIilEEehP4UBFOIpJFAYSEFOYRCFwRSGUBhKYRiF4RQUFEZQUFJIpKCikESBo5BMIYWCmoKGQiqFNApaCjoKegoGCukUeAoCBSMFEwUzhZEURlHIoPAjhdEUxlAYSyGTwjgK4ylkUcimMIHCRAqTKEymMIVCDoVcClMpiBTyKEyjkE/hJwrTKcygMJPCLAqzKRRQmENhLoV5FOZTWEBhIYVFFBZTWEJhKYVCCssoLKewgsLPFIoorKSwisJqCmsorKWwjsJ6ChsobKTwC4VfKfxGYROFzRS2UNhKYRuF7RSKKeyg8Hs1cBhiG5Jo8q2GSDZLouBONQlpuzL5Eg81RjA1CVlqjE9qjEFqDDu7MezsoRPupbCPwn4KBygcpHCIwmEKRyj8QeEohWMUjlM4QeEkhVMUTlMopXCGwlkK5yicp3CBwkUKlyhcpnCFwlUK1yhcp3CDwk0KZRRuUbhN4Q6FuxTuUbhP4QGFhxTKKVRQeEThMYUnFP5F4U8KTyk8o/CcwgsKLym8ovCawhsKbym8o/CewgcKHyl8ovCZwhcKXylUfgOBsWAYyhYSriFhSwnXlDAr4VoStpJwbQnXkbBMwtYStpFwXQnXk7CthOtLuIGE7SRsL+GGEm4kYQcJN5ZwEwk7SthJws4SbirhZhJuLmEXCbeQcEsJt5Kwq4RbS7iNhN0k7C5hDwm3lbCnhL0k3E7C3hL2kXB7CXeQcEcJd5Kwr4Q7S7jLd+ZooWwYyQlagzJJIWDdahC6Yo/woNdM1b/qNzJBqU8y6IRu+ERVzbK4aiF0x7a2cYIfiihLD5HF7lmMyK7+eGoxipkXfK8xYL7eKxa42AatRbanZ5c7DIiHm48T2VrGoHzs8/CZfykD+ZUDQ6G1W51xsN371Q8ie/eZYiI+DFaaHjPQzPK+jciWOZ9+ycD5JvfGwZkhX4wiu2tj7k4G7M+ebyKyx7xXFzLwWIjjRXbD+spVDMxbF5sIMa0eO0OfgS+9oOL6vvZQV7OMgYEPajSBS9MKfKBWzBwj9Dq4ZbzIujYx/ITr1S0L+oLibmCzhSg+LlSQHb6p+/EuipcT/B8w4LDldEeYEhowWmRr2+z7xMBzueCP46/qZ2Kf0lpHf0UxxrH/VgZsfLsOAPukso4im3vW9xI5a8BmkYG7wTaJIju7ldMLHP3yZiPcsQWfxcDvsry+ENSbVYtsRbTTSQZqbjpTV2RPHXt8iIFtNzNtRda/drPrOE//BqojDBwKG9YAHB5ZDoYmAbNr44W67bvPQPznR3VE9lUxgxMsmJvbXmRnMS+W46A+nbpOwtNHjfYUWW1J6jwGSlYPGg9Pgtv4Qll+G2so7RLlI7KPlnmuZMDu1T1HGHR3joPIDt4Uc4uBqRax7SBsZW/UcUXuphkMrPJOSxBZX08mj4Hkqw1RH5unzlrKQHrnSXiAMQebn8A1s2OEIgZ2m4r8RPag7c09DLhWDuZEtpyzJNettWizFq905uV4kXXccvoGA7cWpFqKbFbraNTsL9NGmCG5qMxJZJ1OHV+E/Y+MCtnGQHhOs84QeOVUksg2cLdYi+3FwX/8yUCe9c5AmJjfrTvM8i0RYOrrU6Oh4WJ9gMie3PYLUcv5fNerDJj+DPsRYge+V8O1JZuiRXZZxq/7GdhaGo+KCEso348dnT2tn6IY1abdHXLbXmlks/OW7s1hoOuUtnWA3Xa5PyrDY9FMBn4+2tMsss3Ol15k4F2pcgg8/L3dWNiev7ybyOrbLVvOwIhpcxtCREIqD5FbruDh3WariZH5x2ufoMi95kus6/KsfgUouhizc9Fj9r5A+5pbz2oTNtWKa3sQxR/rYyag6B134D0DfutLLOFnP6ET2tT8X85he0gPuzIGNm7JQtMqO3ugHJuOvbbD1d12HkhF3fRa9RKbAgpvHyL2XT79LQMWlV8z8chuyYsZiKoodhTZrh8GfGVg9IwuNUW23hu/CQy0GmUOEtklFrLDDLxs5BYjshYWA/6FU0xJVjxh4J7dhy4iWzlPVohNdskJa1B8KhRXMwCGzNFQ8KlXW+jqEBorsppL9/aiejf94AqCNlJACxlsO5eB4x5Oabifp69KGNiy510AXFv7uBu4h+/ygrzLi00QarGuFpQsKc8Q2Xv+/HqcvsDBaQcD5xJ7NBNZ95gUjC/Hp51AbSwf+eo4Po7q/eA2A/enbI4UWXgH5MoS/G1OoQM1VnnDl415criRkJ8GO1Zp0E2Mt9xvEh20uDQHxZ1H3dErtu45+QOcnWE3AqzabveEva+VXeHY6nFR0NwjKwSu5PrizCVTlr4hJsF+IcNVd8Z8Ihp66L8P4858VSJ0X5M+GtRNbteEzpc3DBDZ+JaL8fQdJ7wwiWzOu+tnGXiVtgND1al5D6dhEJioQPdJHnFxBVrnqPd4W1aVScU4o3zI9TIUbZ+ayMXunKzZg8Lv4CpiPu/ep6LZRnJT+6L1hVQUM8AFD+4F24ZmhkL9hF1dRfb3cxXbsKPxsQKdptFTWxtoKetvCw/q3tfAFadjtlAz6vexUFya2w7CS/u2hWnZvbqBxWs3jA8Vi3ah6dxzOzkWek5SoXdWpDbCO4TQpVpU8HN7DCTwoW1D8AqUh0JsR4eusNtCgzrq4BmACll45awP7H8R4Y2eGeezC/dw0OvtEgbmKlzGg3FDeUsY2vIIRnSXJl92M9ACsu1gQemGkSLb0nIg6e2w4Pp2Bm5+HuQNgYUBmDamhDS/wMCFPXbRoB+yojPsj0rpKbJnjxdjcCmfVssOOoz38YT5URYtRDayMncjzhE/5FUFUc09/1kovpx5dwNFjdRzmBn2LWmDV3yt97Pd2NTBux0GrT+8fJtC4UfrkZC59nh7OGRX2F1kV1xuT4JOz9t7Z5BUtD11MgOnz5xMhcgGohWG/BV2pzEIt68MBzh4yw82RjQYJrK3BS2eKcoltCV6282G83CkYWNrXLXcjxsrsp3S2s9i4Lfp8gyIVMr08GuoXI+aWlf3MobJ7nkYSdIPdSB2PGrpnUqSSRQtyf5XzZp8DAPcxOYxEP5waHM0ot2h6xgYW6euTmQXfQ4m7r62R40iFLXt9SRFHLJRrmfAcOfCYAzpRf0xpJcEFuOhFrR3vIWP929Zhdaz5IhvY5Gd6rWPuEn0inGbUaTtmPOMgQ+HXtWDmVvGCHDlaR4mgYOuE4nz3djccRKxy6M1L5OlSiM+MOCY1iYYMufWjobZP08BuKR/ho9ezG+FEUZTb3QGtDr4fBSaa83DaOnFW92tweuZnZvIxrZOJXGk5G7hahQNT/bE5C5nxqJTbBz66TE2LfjJEa0gvIatLcwYN9UEdi12ZMKm1+sj4GX2PVTg8K+XSFju0Kv+feLCWy/tQPHaNAYdrcBLUx9sbGQAKYWpQyG1XJYOR28aA2Bfx80dMMyF+qAqO81f3VRkB4YmExdbOncF6uiUdlU0TI8LwEzgnZFKzCMwVU8ygfJAEMkLj3Ne/oYiNsZ+J4prU1efRaE+egzz89pXUTUhp+C5EdqsduDh5eYsdOmjc7YSv7z4sLfI6hwnY/o4KU6sB1eLHmPg7ubx+E8cvjL5y1ISv4+qsTZ5l+qQAb1TBuJjhw0uGxmwKv1RDmvu6/rDOdiASbRiZuxDBtZMTukFRe9mxILFk7PJ0LtJnyGQVZQaLrIt4mPP4GxvR3fCUsAq4RYGxuTh6WiRXsZn+PhBiAtxji1RTRYxMC5hvQU4KtPQhII/V2JmhBar0AmH+mmmYJ8PRxuIKC5mqQ6Qwsj1MB5yZx/XHuhM+1wx7w3Nv4v7cT7mTa5pg286Rs6dF4KMcKPQTg+nja9SRDZv4/bZ+DDI49RzBpoenYyW/uaOjhjZnPxfifILPHYTW+3YxRftU2HzwAzBEX645X26iSSnuf6rgGRIu+VemInaleeyIpsS/ALtyknBeons7i99svFgNjnRkPdOo4S4OZFYya1Z/yPe85vubgDPNPP6wrqIOHTWotlazDY2C7RYNLiFFDwgKvc4jmXMhRkRbWHvXA63yyy9R9TqYjtkIgOZC493hksbE2rDb7/MEaB07scWEJZ3OAHKXe4Px2t5FEjO3fT913wGutkzwfD7MXMS3Aw5h+mypHv3nxjIibNIgDNhLOpySZ8PRCszK++/wwoofSTyExtPrCZb2dmiDQ5WziVaceydhzXsxJaprhgJNy0nSmgc6ZaHYkh9DUkAfqm+aE4Nt8dgEdGgsD4xvrhbhdNQcCNDyhlIu9RtDAy19MfE9nH85q3Ep9u7k8JHW8uN3HNg1rVdDLQvnsPDtlafk3ETEWuwavGcuaMVVh4lK7A0vzNzwFg4n/VVg9fkdAJtqCaXEQRf5tU3Qas/HjuCRQdzbZj/8ANG78nytycw0pVNCsUKIDyFbOPg/S97Ubj3WPYaRV7RWize8xascoLhzawwzS9M2/crA3Va78bUHf/24nUsUMsXYchLux1JNntl0PCjDHQu8wiCE7Xj0SqnhywiBVCNWTosHI256TrI0g1WYqKdpJ+O8cx5Nw/NjxUoMMVNbnGBxPwHOdhxZd8CFVa7Iw7hWvHNd2N9YnDuuprk9YB6sMnVyhqjTYtXX7G/541xGxjosGF5c3g/NQNr38uTwh5hu+6SBXpM/ey4XliadFhDCtnKQZMw/20e8MEdfq7l0g4sVx6Og2yNnw6CmameUNBsTiC4vzBFQ9HmkWGwe+KsdnD2iDWmZifnrqRCfRN87SkDhWk164L9zLsRqOB181/jGSbJZNDN+h66ZmZwb/T3sAkJaK0PbLbnEK/qMppEuLJDPLG1ZtbhJCxG3oglrxLyX+5MR5G4pJgE/Yv7/iRJY0T0ILLYeN/z68jxlDFEGxV6Ay49zn+hN3hsaeyC1+pkT1LjmxrPTqOwTyrCwDxm+bR2WI5070YqhgVXlmApXmfvVXTwplYdibO4b21CooGrSU1S4qUJtuiwpvOPXGG28boK7rslB8LqsB+GgXOa3AGWNU4zQO3oEhdYYPlSDW82PUGFZFllkLJlsRiAxcMuOI9VUd18v2yi3ztD5jMw+UFaG/QU2LsALdLBH40qu2EEqmfQbzoTOOfvxXB6394ea1/3MgdMEouK589m4JlTJb5JtuzshWVr1MbP9lC0cpNz3/QaJsEf30j75QgBFuRT6LdPVqYf0zmFWqM3GYVA8i4r/X6qEjiliav6CJhkMqdrOZnQA/tUDYyMGYAjI6oG9qSNGn262VQ1pVEIIo3km4jBbPqrNZi01iKtgiZFoxd64e8coTdpbfFf35zIgKqN+SRxKgO+iBsEoxBS1T8U/8YJfchx+g0TwqrawqvaIvCvOXGYEIkyUwD8O0yIIuf6j5nxhd2YbBB0Rh8V+Wo7UIMv7qM0+hSZEE3e3bOFvlXD+5H/GKj67jKqqkeyXoj5m7mqO8nCtYZEpbZ6TqNM+KF6xlhyRPJJ1IQHT+EEnCvub+b61ksWyiUrzVrTgG8/hf7Vsw0gs5GvuUoV/bpm0Ct0hiROiCf/7WAhr08earWGUVySAh9zes5oFBL+e0XyNQsX0+g4o0mpS5eFmqv+w0MvEwZWLySvuohBVGs6jUowGIXBZA3GmFj1CfL7aIXKoEvU6DlBGFK9hyoD0xgVSdWHEIZic6450SQMQ/D5NxoFrJ4=",
"user_name": "delete entities/Write Batch to Datastore"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-05-29T12:40:59.926932Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-05-29_05_40_58-12043947472093117508'
location: 'us-central1'
name: 'beamapp-jenkins-0529121830-403937'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-05-29T12:40:59.926932Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-05-29_05_40_58-12043947472093117508]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-05-29_05_40_58-12043947472093117508
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_40_58-12043947472093117508?project=apache-beam-testing
apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2020-05-29_05_40_58-12043947472093117508 is in state JOB_STATE_RUNNING
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:40:58.674Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-05-29_05_40_58-12043947472093117508. The number of workers will be between 1 and 1000.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:40:58.674Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-05-29_05_40_58-12043947472093117508.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:03.222Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:04.894Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:04.928Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step read from datastore/Reshuffle/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:04.971Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.002Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.081Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.158Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.191Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/SplitQuery into read from datastore/UserQuery/Read
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.221Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/AddRandomKeys into read from datastore/SplitQuery
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.254Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps) into read from datastore/Reshuffle/AddRandomKeys
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.295Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify into read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps)
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.338Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Write into read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.371Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow into read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Read
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.412Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps) into read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.449Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Reshuffle/RemoveRandomKeys into read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.485Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Read into read from datastore/Reshuffle/RemoveRandomKeys
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.518Z: JOB_MESSAGE_DETAILED: Fusing consumer To Keys into read from datastore/Read
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.554Z: JOB_MESSAGE_DETAILED: Fusing consumer delete entities/Write Batch to Datastore into To Keys
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.586Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.629Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.664Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.707Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:05.988Z: JOB_MESSAGE_DEBUG: Executing wait step start13
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:06.077Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Create
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:06.125Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:06.170Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:06.226Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Create
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:06.324Z: JOB_MESSAGE_DEBUG: Value "read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Session" materialized.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:06.399Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/UserQuery/Read+read from datastore/SplitQuery+read from datastore/Reshuffle/AddRandomKeys+read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:30.946Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:41:35.074Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:43:25.411Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:43:25.449Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:46:49.962Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/UserQuery/Read+read from datastore/SplitQuery+read from datastore/Reshuffle/AddRandomKeys+read from datastore/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Reify+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:46:50.044Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Close
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:46:50.099Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Close
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:46:50.170Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Read+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+read from datastore/Reshuffle/RemoveRandomKeys+read from datastore/Read+To Keys+delete entities/Write Batch to Datastore
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:02.274Z: JOB_MESSAGE_BASIC: Finished operation read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/Read+read from datastore/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+read from datastore/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+read from datastore/Reshuffle/RemoveRandomKeys+read from datastore/Read+To Keys+delete entities/Write Batch to Datastore
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:02.357Z: JOB_MESSAGE_DEBUG: Executing success step success11
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:02.487Z: JOB_MESSAGE_DETAILED: Cleaning up.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:02.549Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:02.582Z: JOB_MESSAGE_BASIC: Stopping worker pool...
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:48.007Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:48.059Z: JOB_MESSAGE_BASIC: Worker pool stopped.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-29T12:47:48.111Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2020-05-29_05_40_58-12043947472093117508 is in state JOB_STATE_DONE
apache_beam.io.gcp.datastore.v1new.datastore_write_it_pipeline: INFO: Querying for the entities to make sure there are none present.
root: DEBUG: Unhandled type_constraint: Union[]
root: DEBUG: Unhandled type_constraint: Union[]
root: DEBUG: Unhandled type_constraint: Union[]
root: DEBUG: Unhandled type_constraint: Union[]
apache_beam.runners.portability.stager: INFO: Executing command: ['<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/bin/python',> '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']
apache_beam.runners.portability.stager: INFO: Copying Beam SDK "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/build/apache-beam.tar.gz"> to staging location.
root: WARNING: Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
root: INFO: Using Python SDK docker image: apache/beam_python3.6_sdk:2.23.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
apache_beam.runners.dataflow.dataflow_runner: WARNING: Typical end users should not use this worker jar feature. It can only be used when FnAPI is enabled.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/pipeline.pb...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/pipeline.pb in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/requirements.txt...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/requirements.txt in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/parameterized-0.7.4.tar.gz...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/parameterized-0.7.4.tar.gz in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/mock-2.0.0.tar.gz...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/mock-2.0.0.tar.gz in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/six-1.15.0.tar.gz...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/six-1.15.0.tar.gz in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/funcsigs-1.0.2.tar.gz...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/funcsigs-1.0.2.tar.gz in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/pbr-5.4.5.tar.gz...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/pbr-5.4.5.tar.gz in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/PyHamcrest-1.10.1.tar.gz...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/PyHamcrest-1.10.1.tar.gz in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/dataflow_python_sdk.tar...
apache_beam.runners.dataflow.internal.apiclient: INFO: Completed GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/dataflow_python_sdk.tar in 0 seconds.
apache_beam.runners.dataflow.internal.apiclient: INFO: Starting GCS upload to gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0529121830-403937.1590754710.404111/beamapp-jenkins-0529121830-403937.1590755127.504253/beamapp-jenkins-0529121830-403937.1590755574.678087/beamapp-jenkins-0529121830-403937.1590756046.724342/beamapp-jenkins-0529121830-403937.1590756479.723516/dataflow-worker.jar...
root: DEBUG: Caught socket error, retrying: The read operation timed out
root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/temp-storage-for-end-to-end-tests/o?alt=json&name=staging-it%2Fbeamapp-jenkins-0529121830-403937.1590754710.404111%2Fbeamapp-jenkins-0529121830-403937.1590755127.504253%2Fbeamapp-jenkins-0529121830-403937.1590755574.678087%2Fbeamapp-jenkins-0529121830-403937.1590756046.724342%2Fbeamapp-jenkins-0529121830-403937.1590756479.723516%2Fdataflow-worker.jar&uploadType=resumable&upload_id=AAANsUktRbOjh99k6ovoF1g1iOKEmZoNOnOKPi6CY40ET5op7b2iw3eorStsC11spPMsVNIEc6hD4CP60T2fGK9ixtI after exception The read operation timed out
root: DEBUG: Caught socket error, retrying: The read operation timed out
root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/temp-storage-for-end-to-end-tests/o?alt=json&name=staging-it%2Fbeamapp-jenkins-0529121830-403937.1590754710.404111%2Fbeamapp-jenkins-0529121830-403937.1590755127.504253%2Fbeamapp-jenkins-0529121830-403937.1590755574.678087%2Fbeamapp-jenkins-0529121830-403937.1590756046.724342%2Fbeamapp-jenkins-0529121830-403937.1590756479.723516%2Fdataflow-worker.jar&uploadType=resumable&upload_id=AAANsUktRbOjh99k6ovoF1g1iOKEmZoNOnOKPi6CY40ET5op7b2iw3eorStsC11spPMsVNIEc6hD4CP60T2fGK9ixtI after exception The read operation timed out
root: DEBUG: Caught socket error, retrying: The read operation timed out
root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/temp-storage-for-end-to-end-tests/o?alt=json&name=staging-it%2Fbeamapp-jenkins-0529121830-403937.1590754710.404111%2Fbeamapp-jenkins-0529121830-403937.1590755127.504253%2Fbeamapp-jenkins-0529121830-403937.1590755574.678087%2Fbeamapp-jenkins-0529121830-403937.1590756046.724342%2Fbeamapp-jenkins-0529121830-403937.1590756479.723516%2Fdataflow-worker.jar&uploadType=resumable&upload_id=AAANsUktRbOjh99k6ovoF1g1iOKEmZoNOnOKPi6CY40ET5op7b2iw3eorStsC11spPMsVNIEc6hD4CP60T2fGK9ixtI after exception The read operation timed out
root: DEBUG: Caught socket error, retrying: The read operation timed out
root: DEBUG: Retrying request to url https://www.googleapis.com/resumable/upload/storage/v1/b/temp-storage-for-end-to-end-tests/o?alt=json&name=staging-it%2Fbeamapp-jenkins-0529121830-403937.1590754710.404111%2Fbeamapp-jenkins-0529121830-403937.1590755127.504253%2Fbeamapp-jenkins-0529121830-403937.1590755574.678087%2Fbeamapp-jenkins-0529121830-403937.1590756046.724342%2Fbeamapp-jenkins-0529121830-403937.1590756479.723516%2Fdataflow-worker.jar&uploadType=resumable&upload_id=AAANsUktRbOjh99k6ovoF1g1iOKEmZoNOnOKPi6CY40ET5op7b2iw3eorStsC11spPMsVNIEc6hD4CP60T2fGK9ixtI after exception The read operation timed out
--------------------- >> end captured logging << ---------------------
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_16-10136770490935390594?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_22_33-7847605617917020310?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_29_40-8918090988270986727?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_36_22-1448139910536028387?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_43_38-14157365855045080513?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_50_39-1426916119129963429?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_57_08-17789561568310022320?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_06_04_30-1239035853662289127?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_14-15118433484535317500?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_27_04-2770994287843308451?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_34_18-17342714955516511806?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_41_15-303333204124101940?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_48_19-14416430335892438158?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_55_09-12056294872131322164?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_16-14356832938309527804?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_18_41-4125379756498580037?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_25_38-14378425968190045405?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_33_06-16875879232879607132?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_40_58-12043947472093117508?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_53_48-9788417042770875299?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_14-15019036905310088115?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_26_19-13024487732452751753?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_33_41-5653551990088885669?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_40_56-6513927261744767408?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_49_00-16962092560018236117?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_55_41-9386130854816011450?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_13-7720156009154864958?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_15_02-2906584878383344256?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_23_22-2320848789366082525?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_32_15-18210094019538302225?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_40_12-905532937190089959?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_48_08-9537192884466870565?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_56_16-2028143443263027390?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_13-5704412023570596514?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_14_40-16758056299635170363?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_22_29-990428378555097516?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_29_11-7175315880414029790?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_36_01-5980250367390238244?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_43_47-6404920411402682785?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_51_15-3140345583528073746?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_14-16942109195887353395?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_16_27-14352835934249704939?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_25_50-3470882885586389125?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_33_43-9216921964683182511?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_41_04-18300086829433858185?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_57_27-9073734433776374054?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_07_14-7212746226803131336?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_15_12-12215254272004355078?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_23_00-5994325868608986912?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_30_19-11020912400203542655?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_37_17-12879471972551088589?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_44_06-8262512179786509279?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_51_34-7048297940903696808?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-29_05_58_18-6370227030108671639?project=apache-beam-testing
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py36.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 63 tests in 3893.805s
FAILED (SKIP=7, errors=1)
> Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 131
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:postCommitPy36IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 50
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 6m 30s
86 actionable tasks: 63 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/eljxobmgsad7k
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python36 #2496
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python36/2496/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python36 #2495
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python36/2495/display/redirect?page=changes>
Changes:
[bhulette] remove as_cloud_object override
[sniemitz] [BEAM-9964] Move workerCacheMb to a user-visible place
[github] [BEAM-10078] uniquify Dataflow specific jars when staging (#11814)
[github] [BEAM-10107] Remove outdated instructions for website updates in rele…
[github] [BEAM-9679] Add a CoGroupByKey lesson to the Core Transforms section
[github] [BEAM-10110] Propagate ids for custom coders. (#11832)
------------------------------------------
[...truncated 5.57 MB...]
INFO:apache_beam.utils.subprocess_server:b' "type": "beam:metrics:distribution_int64:v1",'
INFO:apache_beam.utils.subprocess_server:b' "payload": "ARUVFQ==",'
INFO:apache_beam.utils.subprocess_server:b' "labels": {'
INFO:apache_beam.utils.subprocess_server:b' "PCOLLECTION": "ref_PCollection_PCollection_14"'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b' }]'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b'}'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Shutting down remote daemon.'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remote daemon shut down; proceeding with flushing remote transports.'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO akka.remote.RemoteActorRefProvider$RemotingTerminator - Remoting shut down.'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopping Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'[flink-metrics-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:43135'
INFO:apache_beam.utils.subprocess_server:b'[flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService - Stopped Akka RPC service.'
----------------------------------------------------------------------
XML: nosetests-postCommitIT-flink-py36.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 4 tests in 54.826s
OK (SKIP=2)
DEBUG:root:Sending SIGINT to job_server
DEBUG:root:Sending SIGINT to job_server
> Task :sdks:python:test-suites:portable:py36:portableWordCountSparkRunnerBatch
INFO:apache_beam.runners.worker.worker_pool_main:Listening for workers at localhost:43321
WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
INFO:root:Using Python SDK docker image: apache/beam_python3.6_sdk:2.23.0.dev. If the image is not available at local, we will try to pull from hub.docker.com
INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7f19235059d8> ====================
INFO:apache_beam.utils.subprocess_server:Starting service with ['java' '-jar' '<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/runners/spark/job-server/build/libs/beam-runners-spark-job-server-2.23.0-SNAPSHOT.jar'> '--spark-master-url' 'local[4]' '--artifacts-dir' '/tmp/beam-temp2m4cp1cl/artifactsbl_dnod4' '--job-port' '55657' '--artifact-port' '0' '--expansion-port' '0']
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:46 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: ArtifactStagingService started on localhost:42147'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:46 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: Java ExpansionService started on localhost:42595'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:46 INFO org.apache.beam.runners.jobsubmission.JobServerDriver: JobService started on localhost:55657'
WARNING:apache_beam.options.pipeline_options:Discarding unparseable args: ['--parallelism=2']
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Staging artifacts for {"sessionId":"job_396e0b8f-4b43-465c-b1ff-7efa66d1b6ef","basePath":"/tmp/beam-temp2m4cp1cl/artifactsbl_dnod4"}.'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Resolving artifacts for {"sessionId":"job_396e0b8f-4b43-465c-b1ff-7efa66d1b6ef","basePath":"/tmp/beam-temp2m4cp1cl/artifactsbl_dnod4"}.ref_Environment_default_environment_1.'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Getting 1 artifacts for {"sessionId":"job_396e0b8f-4b43-465c-b1ff-7efa66d1b6ef","basePath":"/tmp/beam-temp2m4cp1cl/artifactsbl_dnod4"}.null.'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:48 INFO org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService: Artifacts fully staged for {"sessionId":"job_396e0b8f-4b43-465c-b1ff-7efa66d1b6ef","basePath":"/tmp/beam-temp2m4cp1cl/artifactsbl_dnod4"}.'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:48 INFO org.apache.beam.runners.spark.SparkJobInvoker: Invoking job BeamApp-jenkins-0529181148-725f5b50_230bf6ae-e206-4f6c-91d5-96c492511276'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:48 INFO org.apache.beam.runners.jobsubmission.JobInvocation: Starting job invocation BeamApp-jenkins-0529181148-725f5b50_230bf6ae-e206-4f6c-91d5-96c492511276'
INFO:apache_beam.runners.portability.portable_runner:Environment "LOOPBACK" has started a component necessary for the execution. Be sure to run the pipeline using
with Pipeline() as p:
p.apply(..)
This ensures that the pipeline finishes before this program exits.
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED
INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING
INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:49 INFO org.apache.beam.runners.spark.SparkPipelineRunner: PipelineOptions.filesToStage was not specified. Defaulting to files from the classpath'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:49 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Will stage 7 files. (Enable logging at DEBUG level to see which files will be staged.)'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:49 INFO org.apache.beam.runners.spark.translation.SparkContextFactory: Creating a brand new Spark Context.'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:49 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:50 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Running job BeamApp-jenkins-0529181148-725f5b50_230bf6ae-e206-4f6c-91d5-96c492511276 on Spark master local[4]'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:50 INFO org.apache.beam.runners.spark.aggregators.AggregatorsAccumulator: Instantiated aggregators accumulator:'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:50 INFO org.apache.beam.runners.spark.metrics.MetricsAccumulator: Instantiated metrics accumulator: {'
INFO:apache_beam.utils.subprocess_server:b' "metrics": {'
INFO:apache_beam.utils.subprocess_server:b' }'
INFO:apache_beam.utils.subprocess_server:b'}'
INFO:apache_beam.runners.worker.statecache:Creating state cache with size 0
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure control channel for localhost:40127.
INFO:apache_beam.runners.worker.sdk_worker:Control channel established.
INFO:apache_beam.runners.worker.sdk_worker:Initializing SDKHarness with unbounded number of workers.
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 1-1'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-5'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-2'
INFO:apache_beam.runners.worker.sdk_worker:Creating insecure state channel for localhost:34135.
INFO:apache_beam.runners.worker.sdk_worker:State channel established.
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-3'
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-4'
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/data_plane.py",> line 528, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 416, in __next__
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 689, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed"
debug_error_string = "{"created":"@1590775913.710168184","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3962,"referenced_errors":[{"created":"@1590775913.710157651","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":214,"referenced_errors":[{"created":"@1590775913.710156485","description":"DNS resolution failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":369,"grpc_status":14,"referenced_errors":[{"created":"@1590775913.710149944","description":"C-ares status is not ARES_SUCCESS: Misformatted domain name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":254,"referenced_errors":[{"created":"@1590775913.710134441","description":"C-ares status is not ARES_SUCCESS: Misformatted domain name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":254}]}]}]}]}"
>
INFO:apache_beam.runners.worker.data_plane:Creating client data channel for localhost:39445
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/data_plane.py",> line 545, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/data_plane.py",> line 528, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 416, in __next__
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 689, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "DNS resolution failed"
debug_error_string = "{"created":"@1590775913.710168184","description":"Failed to pick subchannel","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":3962,"referenced_errors":[{"created":"@1590775913.710157651","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/resolving_lb_policy.cc","file_line":214,"referenced_errors":[{"created":"@1590775913.710156485","description":"DNS resolution failed","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/dns_resolver_ares.cc","file_line":369,"grpc_status":14,"referenced_errors":[{"created":"@1590775913.710149944","description":"C-ares status is not ARES_SUCCESS: Misformatted domain name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":254,"referenced_errors":[{"created":"@1590775913.710134441","description":"C-ares status is not ARES_SUCCESS: Misformatted domain name","file":"src/core/ext/filters/client_channel/resolver/dns/c_ares/grpc_ares_wrapper.cc","file_line":254}]}]}]}]}"
>
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-8'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-7'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-9'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-6'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:53 WARN org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctions: Either coder LengthPrefixCoder(ByteArrayCoder) or GlobalWindow$Coder is not consistent with equals. That might cause issues on some runners.'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-11'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-12'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-10'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-13'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-14'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-15'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-17'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-16'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-21'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-18'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-19'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-20'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-22'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-23'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-24'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-25'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-26'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-28'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-27'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-29'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-31'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-30'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-32'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-33'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:54 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0529181148-725f5b50_230bf6ae-e206-4f6c-91d5-96c492511276: Pipeline translated successfully. Computing outputs'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:55 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-35'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:55 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-36'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:55 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-34'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:55 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 1-37'
INFO:apache_beam.io.filebasedsink:Starting finalize_write threads with num_shards: 4 (skipped: 0), batches: 4, num_threads: 4
INFO:apache_beam.io.filebasedsink:Renamed 4 shards in 0.10 seconds.
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:55 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0529181148-725f5b50_230bf6ae-e206-4f6c-91d5-96c492511276 finished.'
INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:55 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Getting job metrics for BeamApp-jenkins-0529181148-725f5b50_230bf6ae-e206-4f6c-91d5-96c492511276'
INFO:apache_beam.utils.subprocess_server:b'20/05/29 18:11:55 INFO org.apache.beam.runners.jobsubmission.InMemoryJobService: Finished getting job metrics for BeamApp-jenkins-0529181148-725f5b50_230bf6ae-e206-4f6c-91d5-96c492511276'
INFO:root:number of empty lines: 2
INFO:root:average word length: 3
ERROR:apache_beam.runners.worker.data_plane:Failed to read inputs in the data plane.
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/data_plane.py",> line 528, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 416, in __next__
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 706, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1590775915.747858932","description":"Error received from peer ipv4:127.0.0.1:39445","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread read_grpc_client_inputs:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/data_plane.py",> line 545, in <lambda>
target=lambda: self._read_inputs(elements_iterator),
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/data_plane.py",> line 528, in _read_inputs
for elements in elements_iterator:
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 416, in __next__
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 706, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1590775915.747858932","description":"Error received from peer ipv4:127.0.0.1:39445","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread run_worker_1-1:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py",> line 213, in run
for work_request in self._control_stub.Control(get_responses()):
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 416, in __next__
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 706, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1590775915.747959956","description":"Error received from peer ipv4:127.0.0.1:40127","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Socket closed","grpc_status":14}"
>
Exception in thread read_state:
Traceback (most recent call last):
File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
self.run()
File "/usr/lib/python3.6/threading.py", line 864, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/apache_beam/runners/worker/sdk_worker.py",> line 787, in pull_responses
for response in responses:
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 416, in __next__
return self._next()
File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/2022703440/lib/python3.6/site-packages/grpc/_channel.py",> line 706, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.UNAVAILABLE
details = "Socket closed"
debug_error_string = "{"created":"@1590775915.747882210","description":"Error received from peer ipv4:127.0.0.1:34135","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Socket closed","grpc_status":14}"
>
> Task :sdks:python:test-suites:portable:py36:postCommitPy36
FAILURE: Build failed with an exception.
* Where:
Script '<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 50
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 1s
86 actionable tasks: 63 executed, 23 from cache
Publishing build scan...
https://gradle.com/s/umltasbg7vi6m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org