You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/01/28 18:23:33 UTC
Build failed in Jenkins: beam_PostCommit_Python_Verify #7221
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/7221/display/redirect?page=changes>
Changes:
[chamikara] Updates UnboundedReadFromBoundedSource.split() to at least create one
------------------------------------------
[...truncated 504.16 KB...]
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s22"
},
"serialized_fn": "<string of 1372 bytes>",
"user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key)"
}
},
{
"kind": "ParallelDo",
"name": "s24",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "check"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "Map(check).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s23"
},
"serialized_fn": "<string of 1296 bytes>",
"user_name": "Map(check)"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2019-01-28T17:43:10.742763Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2019-01-28_09_43_09-7914378821450555487'
location: u'us-central1'
name: u'beamapp-jenkins-0128174304-551712'
projectId: u'apache-beam-testing'
stageStates: []
startTime: u'2019-01-28T17:43:10.742763Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2019-01-28_09_43_09-7914378821450555487]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_43_09-7914378821450555487?project=apache-beam-testing
root: INFO: Job 2019-01-28_09_43_09-7914378821450555487 is in state JOB_STATE_RUNNING
root: INFO: 2019-01-28T17:43:09.935Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2019-01-28_09_43_09-7914378821450555487. The number of workers will be between 1 and 1000.
root: INFO: 2019-01-28T17:43:10.045Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2019-01-28_09_43_09-7914378821450555487.
root: INFO: 2019-01-28T17:43:13.182Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2019-01-28T17:43:14.613Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-f.
root: INFO: 2019-01-28T17:43:15.406Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2019-01-28T17:43:15.457Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step CoGroupByKey/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2019-01-28T17:43:15.509Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2019-01-28T17:43:15.558Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2019-01-28T17:43:15.608Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2019-01-28T17:43:15.669Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2019-01-28T17:43:15.872Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2019-01-28T17:43:15.957Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2019-01-28T17:43:15.994Z: JOB_MESSAGE_DETAILED: Unzipping flatten s21 for input s19.out
root: INFO: 2019-01-28T17:43:16.188Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of CoGroupByKey/GroupByKey/Reify, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/pair_with_avro
root: INFO: 2019-01-28T17:43:16.234Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/Map(_merge_tagged_vals_under_key) into CoGroupByKey/GroupByKey/GroupByWindow
root: INFO: 2019-01-28T17:43:16.287Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(check) into CoGroupByKey/Map(_merge_tagged_vals_under_key)
root: INFO: 2019-01-28T17:43:16.338Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/GroupByKey/GroupByWindow into CoGroupByKey/GroupByKey/Read
root: INFO: 2019-01-28T17:43:16.380Z: JOB_MESSAGE_DETAILED: Unzipping flatten s21-u31 for input s22-reify-value9-c29
root: INFO: 2019-01-28T17:43:16.429Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of CoGroupByKey/GroupByKey/Write, through flatten s21-u31, into producer CoGroupByKey/GroupByKey/Reify
root: INFO: 2019-01-28T17:43:16.484Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/GroupByKey/Reify into CoGroupByKey/pair_with_fastavro
root: INFO: 2019-01-28T17:43:16.534Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/GroupByKey/Write into CoGroupByKey/GroupByKey/Reify
root: INFO: 2019-01-28T17:43:16.583Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/Map(reify_timestamps) into read-fastavro/read-fastavro/Reshard/AddRandomKeys
root: INFO: 2019-01-28T17:43:16.641Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/ExpandIntoRanges into create-fastavro/Read
root: INFO: 2019-01-28T17:43:16.708Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/AddRandomKeys into read-fastavro/read-fastavro/ExpandIntoRanges
root: INFO: 2019-01-28T17:43:16.760Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/RemoveRandomKeys into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps)
root: INFO: 2019-01-28T17:43:16.808Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at fastavro_it_test.py:164>) into read-fastavro/read-fastavro/ReadRange
root: INFO: 2019-01-28T17:43:16.867Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/pair_with_fastavro into Map(<lambda at fastavro_it_test.py:164>)
root: INFO: 2019-01-28T17:43:16.904Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/ReadRange into read-fastavro/read-fastavro/Reshard/RemoveRandomKeys
root: INFO: 2019-01-28T17:43:16.959Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Read
root: INFO: 2019-01-28T17:43:16.999Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps) into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow
root: INFO: 2019-01-28T17:43:17.041Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Reify into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/Map(reify_timestamps)
root: INFO: 2019-01-28T17:43:17.099Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Write into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Reify
root: INFO: 2019-01-28T17:43:17.141Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps) into read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow
root: INFO: 2019-01-28T17:43:17.218Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow into read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Read
root: INFO: 2019-01-28T17:43:17.297Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Write into read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Reify
root: INFO: 2019-01-28T17:43:17.341Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/pair_with_avro into Map(<lambda at fastavro_it_test.py:170>)
root: INFO: 2019-01-28T17:43:17.384Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/AddRandomKeys into read-avro/read-avro/ExpandIntoRanges
root: INFO: 2019-01-28T17:43:17.431Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/ReadRange into read-avro/read-avro/Reshard/RemoveRandomKeys
root: INFO: 2019-01-28T17:43:17.492Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/Map(reify_timestamps) into read-avro/read-avro/Reshard/AddRandomKeys
root: INFO: 2019-01-28T17:43:17.541Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/ExpandIntoRanges into create-avro/Read
root: INFO: 2019-01-28T17:43:17.585Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Reify into read-avro/read-avro/Reshard/ReshufflePerKey/Map(reify_timestamps)
root: INFO: 2019-01-28T17:43:17.621Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at fastavro_it_test.py:170>) into read-avro/read-avro/ReadRange
root: INFO: 2019-01-28T17:43:17.667Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/RemoveRandomKeys into read-avro/read-avro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps)
root: INFO: 2019-01-28T17:43:17.724Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2019-01-28T17:43:17.765Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2019-01-28T17:43:17.805Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2019-01-28T17:43:17.862Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-01-28T17:43:18.119Z: JOB_MESSAGE_DEBUG: Executing wait step start41
root: INFO: 2019-01-28T17:43:18.258Z: JOB_MESSAGE_BASIC: Executing operation read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Create
root: INFO: 2019-01-28T17:43:18.309Z: JOB_MESSAGE_BASIC: Executing operation CoGroupByKey/GroupByKey/Create
root: INFO: 2019-01-28T17:43:18.320Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2019-01-28T17:43:18.358Z: JOB_MESSAGE_BASIC: Executing operation read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Create
root: INFO: 2019-01-28T17:43:18.384Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2019-01-28T17:43:18.577Z: JOB_MESSAGE_DEBUG: Value "read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Session" materialized.
root: INFO: 2019-01-28T17:43:18.636Z: JOB_MESSAGE_DEBUG: Value "read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Session" materialized.
root: INFO: 2019-01-28T17:43:18.684Z: JOB_MESSAGE_DEBUG: Value "CoGroupByKey/GroupByKey/Session" materialized.
root: INFO: 2019-01-28T17:43:18.743Z: JOB_MESSAGE_BASIC: Executing operation create-avro/Read+read-avro/read-avro/ExpandIntoRanges+read-avro/read-avro/Reshard/AddRandomKeys+read-avro/read-avro/Reshard/ReshufflePerKey/Map(reify_timestamps)+read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Reify+read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Write
root: INFO: 2019-01-28T17:43:18.807Z: JOB_MESSAGE_BASIC: Executing operation create-fastavro/Read+read-fastavro/read-fastavro/ExpandIntoRanges+read-fastavro/read-fastavro/Reshard/AddRandomKeys+read-fastavro/read-fastavro/Reshard/ReshufflePerKey/Map(reify_timestamps)+read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Reify+read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Write
root: INFO: 2019-01-28T17:43:39.125Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2019-01-28T17:47:49.184Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-f failed to bring up any of the desired 1 workers. ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS: The zone 'projects/apache-beam-testing/zones/us-central1-f' does not have enough resources available to fulfill the request. '(resource type:pd-standard)'.
root: INFO: 2019-01-28T17:47:49.230Z: JOB_MESSAGE_ERROR: Workflow failed.
root: INFO: 2019-01-28T17:47:49.427Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2019-01-28T17:47:49.589Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2019-01-28T17:47:49.636Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2019-01-28T17:48:08.029Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2019-01-28T17:48:08.084Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2019-01-28_09_43_09-7914378821450555487 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 25 tests in 2935.107s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_44-9477806774401328024?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_49_58-10278350646340668407?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_43-5787021123978921205?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_43-7893890032915304639?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_47_20-4694532331448425486?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_54_16-8583894425023235787?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_00_44-10921903563489672931?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_42-12092110505466357459?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_42-7590851100610354324?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_42_25-14665423249936501843?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_42-7358731675973570707?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_41_12-5922076819211737653?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_49_07-5155288222939264479?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_56_24-2795385687115501642?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_03_23-2303264697378419737?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_11_00-784385024821911685?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_17_08-9443648458478939443?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_42-8716730336933517018?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_42_06-8546398999329102725?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_49_22-14918488856093861759?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_56_59-11890664673832149656?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_34_42-933278273165042462?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_43_09-7914378821450555487?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_09_48_27-1415135095011381610?project=apache-beam-testing.
> Task :beam-sdks-python:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 278
* What went wrong:
Execution failed for task ':beam-sdks-python:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 52m 38s
6 actionable tasks: 6 executed
Publishing build scan...
https://gradle.com/s/b2tk46m7w4lqy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_Verify
#7225
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/7225/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Verify #7224
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/7224/display/redirect?page=changes>
Changes:
[gleb] [BEAM-6497] Upgrade testcontainers
[amaliujia] [BEAM-6513] Fix NPE in BeamEnumerableConveter.
------------------------------------------
[...truncated 430.76 KB...]
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "To Entity.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s2"
},
"serialized_fn": "<string of 1464 bytes>",
"user_name": "To Entity"
}
},
{
"kind": "ParallelDo",
"name": "s4",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "to_upsert_mutation"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "Write to Datastore/Convert to Mutation.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s3"
},
"serialized_fn": "<string of 1244 bytes>",
"user_name": "Write to Datastore/Convert to Mutation"
}
},
{
"kind": "ParallelDo",
"name": "s5",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "DatastoreWriteFn",
"type": "STRING",
"value": "apache_beam.io.gcp.datastore.v1.datastoreio.DatastoreWriteFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "Write to Datastore/Write Mutation to Datastore.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s4"
},
"serialized_fn": "<string of 6532 bytes>",
"user_name": "Write to Datastore/Write Mutation to Datastore"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2019-01-29T00:15:59.938092Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2019-01-28_16_15_58-11535588838532301848'
location: u'us-central1'
name: u'beamapp-jenkins-0129001553-564053'
projectId: u'apache-beam-testing'
stageStates: []
startTime: u'2019-01-29T00:15:59.938092Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2019-01-28_16_15_58-11535588838532301848]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_15_58-11535588838532301848?project=apache-beam-testing
root: INFO: Job 2019-01-28_16_15_58-11535588838532301848 is in state JOB_STATE_RUNNING
root: INFO: 2019-01-29T00:15:58.904Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2019-01-28_16_15_58-11535588838532301848. The number of workers will be between 1 and 1000.
root: INFO: 2019-01-29T00:15:58.951Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2019-01-28_16_15_58-11535588838532301848.
root: INFO: 2019-01-29T00:16:03.931Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2019-01-29T00:16:06.076Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-f.
root: INFO: 2019-01-29T00:16:06.834Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2019-01-29T00:16:06.883Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2019-01-29T00:16:06.937Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2019-01-29T00:16:06.982Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2019-01-29T00:16:07.032Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2019-01-29T00:16:07.083Z: JOB_MESSAGE_DETAILED: Fusing consumer To String into Input/Read
root: INFO: 2019-01-29T00:16:07.126Z: JOB_MESSAGE_DETAILED: Fusing consumer Write to Datastore/Convert to Mutation into To Entity
root: INFO: 2019-01-29T00:16:07.169Z: JOB_MESSAGE_DETAILED: Fusing consumer To Entity into To String
root: INFO: 2019-01-29T00:16:07.212Z: JOB_MESSAGE_DETAILED: Fusing consumer Write to Datastore/Write Mutation to Datastore into Write to Datastore/Convert to Mutation
root: INFO: 2019-01-29T00:16:07.263Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2019-01-29T00:16:07.307Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2019-01-29T00:16:07.350Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2019-01-29T00:16:07.372Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-01-29T00:16:07.560Z: JOB_MESSAGE_DEBUG: Executing wait step start3
root: INFO: 2019-01-29T00:16:07.656Z: JOB_MESSAGE_BASIC: Executing operation Input/Read+To String+To Entity+Write to Datastore/Convert to Mutation+Write to Datastore/Write Mutation to Datastore
root: INFO: 2019-01-29T00:16:07.712Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2019-01-29T00:16:07.756Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2019-01-29T00:16:35.055Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2019-01-29T00:20:46.905Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-f failed to bring up any of the desired 1 workers. ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS: The zone 'projects/apache-beam-testing/zones/us-central1-f' does not have enough resources available to fulfill the request. '(resource type:pd-standard)'.
root: INFO: 2019-01-29T00:20:46.950Z: JOB_MESSAGE_ERROR: Workflow failed.
root: INFO: 2019-01-29T00:20:47.129Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2019-01-29T00:20:47.248Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2019-01-29T00:20:47.294Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2019-01-29T00:20:57.739Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2019-01-29T00:20:57.813Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2019-01-28_16_15_58-11535588838532301848 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 25 tests in 1963.491s
FAILED (errors=2)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_11-11727449319289504858?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_15_49-6076934208658781741?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_10-12171153624806607855?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_10-14655584162582924270?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_11-17557616721073621738?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_13_34-16472480060947822327?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_19_58-8568388869577934712?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_27_32-11046474615481520434?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_10-18040888023890492425?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_06_44-12947325951682453911?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_16_26-14256921523204636930?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_24_07-8297770678264826224?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_09-4776643139496807942?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_08_00-8397597758696897334?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_15_58-11535588838532301848?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_09-4175208168581871724?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_09_12-2945928238047091748?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_16_44-4710928883396691880?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_01_10-13802233784993623460?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_16_08_37-15873422496318915146?project=apache-beam-testing.
> Task :beam-sdks-python:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 278
* What went wrong:
Execution failed for task ':beam-sdks-python:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 36m 50s
6 actionable tasks: 6 executed
Publishing build scan...
https://gradle.com/s/wvcbtwzzv72zm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Verify #7223
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/7223/display/redirect?page=changes>
Changes:
[robertwb] Create a standard coder for utf-8 encoded strings.
[robertwb] [BEAM-6269] Cross-SDK transform expansion protocol.
------------------------------------------
[...truncated 649.10 KB...]
"value": "<lambda>"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "assert_that/Unkey.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s21"
},
"serialized_fn": "<string of 968 bytes>",
"user_name": "assert_that/Unkey"
}
},
{
"kind": "ParallelDo",
"name": "s23",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_equal"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "assert_that/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s22"
},
"serialized_fn": "<string of 1328 bytes>",
"user_name": "assert_that/Match"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2019-01-28T20:10:08.501001Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2019-01-28_12_10_07-2184059635342118510'
location: u'us-central1'
name: u'beamapp-jenkins-0128194053-139012'
projectId: u'apache-beam-testing'
stageStates: []
startTime: u'2019-01-28T20:10:08.501001Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2019-01-28_12_10_07-2184059635342118510]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_12_10_07-2184059635342118510?project=apache-beam-testing
root: INFO: Job 2019-01-28_12_10_07-2184059635342118510 is in state JOB_STATE_RUNNING
root: INFO: 2019-01-28T20:10:07.583Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2019-01-28_12_10_07-2184059635342118510. The number of workers will be between 1 and 1000.
root: INFO: 2019-01-28T20:10:07.648Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2019-01-28_12_10_07-2184059635342118510.
root: INFO: 2019-01-28T20:10:10.745Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2019-01-28T20:10:11.696Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-f.
root: INFO: 2019-01-28T20:10:12.261Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2019-01-28T20:10:12.352Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step assert_that/Group/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2019-01-28T20:10:12.405Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step read from datastore/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2019-01-28T20:10:12.445Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2019-01-28T20:10:12.497Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2019-01-28T20:10:12.693Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2019-01-28T20:10:12.756Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2019-01-28T20:10:12.799Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/SplitQuery into read from datastore/UserQuery/Read
root: INFO: 2019-01-28T20:10:12.849Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/GroupByKey/Write into read from datastore/GroupByKey/Reify
root: INFO: 2019-01-28T20:10:12.899Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Read into read from datastore/Flatten
root: INFO: 2019-01-28T20:10:12.951Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/UnKey into Globally/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract
root: INFO: 2019-01-28T20:10:13.018Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Flatten into read from datastore/Values
root: INFO: 2019-01-28T20:10:13.069Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract into Globally/CombineGlobally(CountCombineFn)/CombinePerKey/Combine
root: INFO: 2019-01-28T20:10:13.113Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/CombinePerKey/Combine into Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read
root: INFO: 2019-01-28T20:10:13.173Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/GroupByKey/Reify into read from datastore/SplitQuery
root: INFO: 2019-01-28T20:10:13.222Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/Values into read from datastore/GroupByKey/GroupByWindow
root: INFO: 2019-01-28T20:10:13.273Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write into Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify
root: INFO: 2019-01-28T20:10:13.317Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Reify into Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Globally/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial
root: INFO: 2019-01-28T20:10:13.371Z: JOB_MESSAGE_DETAILED: Fusing consumer read from datastore/GroupByKey/GroupByWindow into read from datastore/GroupByKey/Read
root: INFO: 2019-01-28T20:10:13.422Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Globally/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial into Globally/CombineGlobally(CountCombineFn)/KeyWithVoid
root: INFO: 2019-01-28T20:10:13.468Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/KeyWithVoid into read from datastore/Read
root: INFO: 2019-01-28T20:10:13.516Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey
root: INFO: 2019-01-28T20:10:13.549Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/Map(_merge_tagged_vals_under_key)
root: INFO: 2019-01-28T20:10:13.596Z: JOB_MESSAGE_DETAILED: Unzipping flatten s19 for input s17.out
root: INFO: 2019-01-28T20:10:13.644Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/GroupByKey/Reify, through flatten assert_that/Group/Flatten, into producer assert_that/Group/pair_with_0
root: INFO: 2019-01-28T20:10:13.688Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/Map(_merge_tagged_vals_under_key) into assert_that/Group/GroupByKey/GroupByWindow
root: INFO: 2019-01-28T20:10:13.739Z: JOB_MESSAGE_DETAILED: Unzipping flatten s19-u40 for input s20-reify-value9-c38
root: INFO: 2019-01-28T20:10:13.795Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/GroupByKey/Write, through flatten s19-u40, into producer assert_that/Group/GroupByKey/Reify
root: INFO: 2019-01-28T20:10:13.847Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/GroupByWindow into assert_that/Group/GroupByKey/Read
root: INFO: 2019-01-28T20:10:13.896Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_0 into assert_that/Create/Read
root: INFO: 2019-01-28T20:10:13.965Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/Write into assert_that/Group/GroupByKey/Reify
root: INFO: 2019-01-28T20:10:14.015Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/Reify into assert_that/Group/pair_with_1
root: INFO: 2019-01-28T20:10:14.073Z: JOB_MESSAGE_DETAILED: Fusing consumer Globally/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault into Globally/CombineGlobally(CountCombineFn)/DoOnce/Read
root: INFO: 2019-01-28T20:10:14.128Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into Globally/CombineGlobally(CountCombineFn)/InjectDefault/InjectDefault
root: INFO: 2019-01-28T20:10:14.177Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_1 into assert_that/ToVoidKey
root: INFO: 2019-01-28T20:10:14.228Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn)
root: INFO: 2019-01-28T20:10:14.287Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2019-01-28T20:10:14.342Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2019-01-28T20:10:14.385Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2019-01-28T20:10:14.435Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-01-28T20:10:14.750Z: JOB_MESSAGE_DEBUG: Executing wait step start51
root: INFO: 2019-01-28T20:10:14.881Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Create
root: INFO: 2019-01-28T20:10:14.934Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/GroupByKey/Create
root: INFO: 2019-01-28T20:10:14.945Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2019-01-28T20:10:14.988Z: JOB_MESSAGE_BASIC: Executing operation Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create
root: INFO: 2019-01-28T20:10:15Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2019-01-28T20:10:15.164Z: JOB_MESSAGE_DEBUG: Value "assert_that/Group/GroupByKey/Session" materialized.
root: INFO: 2019-01-28T20:10:15.232Z: JOB_MESSAGE_DEBUG: Value "read from datastore/GroupByKey/Session" materialized.
root: INFO: 2019-01-28T20:10:15.277Z: JOB_MESSAGE_DEBUG: Value "Globally/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized.
root: INFO: 2019-01-28T20:10:15.323Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
root: INFO: 2019-01-28T20:10:15.380Z: JOB_MESSAGE_BASIC: Executing operation read from datastore/UserQuery/Read+read from datastore/SplitQuery+read from datastore/GroupByKey/Reify+read from datastore/GroupByKey/Write
root: INFO: 2019-01-28T20:10:36.965Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2019-01-28T20:13:41.718Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-f failed to bring up any of the desired 1 workers. ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS: The zone 'projects/apache-beam-testing/zones/us-central1-f' does not have enough resources available to fulfill the request. '(resource type:pd-standard)'.
root: INFO: 2019-01-28T20:13:41.753Z: JOB_MESSAGE_ERROR: Workflow failed.
root: INFO: 2019-01-28T20:13:41.961Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2019-01-28T20:13:42.056Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2019-01-28T20:13:42.097Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2019-01-28T20:13:59.672Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2019-01-28T20:13:59.708Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2019-01-28_12_10_07-2184059635342118510 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 25 tests in 2870.743s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_54-887160762830855999?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_42_16-9133444077637851344?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_48_53-6446879565497098305?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_57-10911661130125345023?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_54-15824388532124432930?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_39_10-17920495509657086248?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_45_34-6280063109247657414?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_53_17-16843379137156639682?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_53-13112175618372215221?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_52-13228292562079043637?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_33_55-7032334895283602755?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_40_58-386058495842896898?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_47_55-3734693373925979203?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_55_37-13089693820548734572?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_12_02_39-7001485980839911509?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_12_10_07-2184059635342118510?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_52-1866118706692317211?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_33_27-12986106645691672451?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_40_42-680001668816173799?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_53-15682073981658725157?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_34_11-6497173826193578613?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_42_15-15858779346883356200?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_26_53-9523626331489911632?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_34_45-18050223652950934702?project=apache-beam-testing.
> Task :beam-sdks-python:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 278
* What went wrong:
Execution failed for task ':beam-sdks-python:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 52m 23s
6 actionable tasks: 6 executed
Publishing build scan...
https://gradle.com/s/6sjlbfqttkgyi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Verify #7222
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/7222/display/redirect?page=changes>
Changes:
[lukasz.gajowy] [BEAM-6408] Change test max worker count
[lukasz.gajowy] [BEAM-6408] Increase load test jobs timeout
------------------------------------------
[...truncated 319.39 KB...]
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/PyHamcrest-1.9.0.tar.gz",
"name": "PyHamcrest-1.9.0.tar.gz"
},
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/pbr-5.1.1.tar.gz",
"name": "pbr-5.1.1.tar.gz"
},
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/setuptools-40.7.0.zip",
"name": "setuptools-40.7.0.zip"
},
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/mock-2.0.0.tar.gz",
"name": "mock-2.0.0.tar.gz"
},
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/six-1.12.0.tar.gz",
"name": "six-1.12.0.tar.gz"
},
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/setuptools-40.6.3.zip",
"name": "setuptools-40.6.3.zip"
},
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/funcsigs-1.0.2.tar.gz",
"name": "funcsigs-1.0.2.tar.gz"
},
{
"location": "storage.googleapis.com/temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-0128183951-548291.1548700791.548400/dataflow_python_sdk.tar",
"name": "dataflow_python_sdk.tar"
}
],
"taskrunnerSettings": {
"parallelWorkerSettings": {
"baseUrl": "https://dataflow.googleapis.com",
"servicePath": "https://dataflow.googleapis.com"
}
},
"workerHarnessContainerImage": "gcr.io/cloud-dataflow/v1beta3/python:beam-master-20181218"
}
]
},
"name": "beamapp-jenkins-0128183951-548291",
"steps": [
{
"kind": "ParallelRead",
"name": "s1",
"properties": {
"bigquery_export_format": "FORMAT_AVRO",
"bigquery_flatten_results": true,
"bigquery_query": "SELECT * FROM (SELECT \"apple\" as fruit), (SELECT \"orange\" as fruit),",
"bigquery_use_legacy_sql": true,
"display_data": [
{
"key": "source",
"label": "Read Source",
"namespace": "apache_beam.io.iobase.Read",
"shortValue": "BigQuerySource",
"type": "STRING",
"value": "apache_beam.io.gcp.bigquery.BigQuerySource"
},
{
"key": "query",
"label": "Query",
"namespace": "apache_beam.io.gcp.bigquery.BigQuerySource",
"type": "STRING",
"value": "SELECT * FROM (SELECT \"apple\" as fruit), (SELECT \"orange\" as fruit),"
},
{
"key": "validation",
"label": "Validation Enabled",
"namespace": "apache_beam.io.gcp.bigquery.BigQuerySource",
"type": "BOOLEAN",
"value": false
}
],
"format": "bigquery",
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "read.out"
}
],
"user_name": "read"
}
},
{
"kind": "ParallelWrite",
"name": "s2",
"properties": {
"create_disposition": "CREATE_IF_NEEDED",
"dataset": "python_query_to_table_15487007911241",
"display_data": [],
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "RowAsDictJsonCoder$eNprYEpOLEhMzkiNT0pNzNXLzNdLTy7QS8pMLyxNLaqML8nPzynmCsovdyx2yUwu8SrOz3POT0kt4ipk0GwsZKwtZErSAwBKpRfo",
"component_encodings": []
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"format": "bigquery",
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s1"
},
"schema": "{\"fields\": [{\"type\": \"STRING\", \"name\": \"fruit\", \"mode\": \"NULLABLE\"}]}",
"table": "output_table",
"user_name": "write/NativeWrite",
"write_disposition": "WRITE_EMPTY"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2019-01-28T18:39:57.251370Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2019-01-28_10_39_56-7241936806918503073'
location: u'us-central1'
name: u'beamapp-jenkins-0128183951-548291'
projectId: u'apache-beam-testing'
stageStates: []
startTime: u'2019-01-28T18:39:57.251370Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2019-01-28_10_39_56-7241936806918503073]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_39_56-7241936806918503073?project=apache-beam-testing
root: INFO: Job 2019-01-28_10_39_56-7241936806918503073 is in state JOB_STATE_RUNNING
root: INFO: 2019-01-28T18:39:56.563Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2019-01-28_10_39_56-7241936806918503073. The number of workers will be between 1 and 1000.
root: INFO: 2019-01-28T18:39:56.590Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2019-01-28_10_39_56-7241936806918503073.
root: INFO: 2019-01-28T18:39:59.905Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2019-01-28T18:40:00.811Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-f.
root: INFO: 2019-01-28T18:40:01.551Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2019-01-28T18:40:01.606Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2019-01-28T18:40:01.659Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2019-01-28T18:40:01.724Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2019-01-28T18:40:01.985Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2019-01-28T18:40:02.042Z: JOB_MESSAGE_DETAILED: Fusing consumer write/NativeWrite into read
root: INFO: 2019-01-28T18:40:02.100Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2019-01-28T18:40:02.146Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2019-01-28T18:40:02.206Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2019-01-28T18:40:02.257Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-01-28T18:40:02.537Z: JOB_MESSAGE_DEBUG: Executing wait step start3
root: INFO: 2019-01-28T18:40:02.667Z: JOB_MESSAGE_BASIC: Executing operation read+write/NativeWrite
root: INFO: 2019-01-28T18:40:02.751Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2019-01-28T18:40:02.816Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2019-01-28T18:40:06.222Z: JOB_MESSAGE_BASIC: BigQuery query issued as job: "dataflow_job_15179799911844039562". You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_15179799911844039562".
root: INFO: 2019-01-28T18:40:16.417Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2019-01-28T18:42:05.038Z: JOB_MESSAGE_BASIC: BigQuery query completed, job : "dataflow_job_15179799911844039562"
root: INFO: 2019-01-28T18:42:05.395Z: JOB_MESSAGE_BASIC: BigQuery export job "dataflow_job_3013731445548182599" started. You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_3013731445548182599".
root: INFO: 2019-01-28T18:42:35.759Z: JOB_MESSAGE_DETAILED: BigQuery export job progress: "dataflow_job_3013731445548182599" observed total of 1 exported files thus far.
root: INFO: 2019-01-28T18:42:35.802Z: JOB_MESSAGE_BASIC: BigQuery export job finished: "dataflow_job_3013731445548182599"
root: INFO: 2019-01-28T18:44:31.990Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-f failed to bring up any of the desired 1 workers. ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS: The zone 'projects/apache-beam-testing/zones/us-central1-f' does not have enough resources available to fulfill the request. '(resource type:pd-standard)'.
root: INFO: 2019-01-28T18:44:32.036Z: JOB_MESSAGE_ERROR: Workflow failed.
root: INFO: 2019-01-28T18:44:32.239Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2019-01-28T18:44:32.395Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2019-01-28T18:44:32.426Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2019-01-28T18:44:53.029Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2019-01-28T18:44:53.101Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2019-01-28_10_39_56-7241936806918503073 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 25 tests in 2939.607s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_31-17635691032802428915?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_42_48-15703791944861316724?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_28-10443666394642120027?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_28-12947164188167568389?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_33_58-10408102825517531246?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_42_15-17977887591138767747?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_48_53-2326873160641399752?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_55_40-746261106613676707?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_02_57-12989680197716147623?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_11_09_59-7479032796109294798?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_29-15667393670442539851?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_30-12096484070604593738?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_39_56-7241936806918503073?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_45_14-4172940639846027783?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_51_47-5954892273707526103?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_29-16486279447983851729?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_34_26-6780116226321378998?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_41_44-6690771622403495513?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_29-6076915803903885114?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_34_56-17322787528883391443?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_42_26-10505965757249068177?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_49_13-12069366437769856654?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_27_29-1793208238548731767?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-28_10_35_56-8046316808553682563?project=apache-beam-testing.
> Task :beam-sdks-python:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 278
* What went wrong:
Execution failed for task ':beam-sdks-python:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 52m 40s
6 actionable tasks: 6 executed
Publishing build scan...
https://gradle.com/s/z4drkzkhc4xks
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org