You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/11/25 13:14:43 UTC
Build failed in Jenkins: beam_PostCommit_Python_Verify #6653
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6653/display/redirect>
------------------------------------------
[...truncated 649.92 KB...]
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s22"
},
"serialized_fn": "<string of 1372 bytes>",
"user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key)"
}
},
{
"kind": "ParallelDo",
"name": "s24",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "check"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "Map(check).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s23"
},
"serialized_fn": "<string of 1296 bytes>",
"user_name": "Map(check)"
}
}
],
"type": "JOB_TYPE_BATCH"
}
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
root: INFO: Create job: <Job
createTime: u'2018-11-25T12:12:17.364205Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-11-25_04_12_16-5133104896937027182'
location: u'us-central1'
name: u'beamapp-jenkins-1125121203-461650'
projectId: u'apache-beam-testing'
stageStates: []
startTime: u'2018-11-25T12:12:17.364205Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-11-25_04_12_16-5133104896937027182]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_12_16-5133104896937027182?project=apache-beam-testing
root: INFO: Job 2018-11-25_04_12_16-5133104896937027182 is in state JOB_STATE_RUNNING
root: INFO: 2018-11-25T12:12:16.657Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-11-25_04_12_16-5133104896937027182. The number of workers will be between 1 and 1000.
root: INFO: 2018-11-25T12:12:16.699Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-11-25_04_12_16-5133104896937027182.
root: INFO: 2018-11-25T12:12:19.711Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-11-25T12:12:20.804Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-b.
root: INFO: 2018-11-25T12:12:21.333Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-11-25T12:12:21.383Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step CoGroupByKey/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-11-25T12:12:21.431Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-11-25T12:12:21.479Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-11-25T12:12:21.512Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-11-25T12:12:21.555Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-11-25T12:12:21.733Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-11-25T12:12:21.808Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-11-25T12:12:21.852Z: JOB_MESSAGE_DETAILED: Unzipping flatten s21 for input s19.out
root: INFO: 2018-11-25T12:12:21.914Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of CoGroupByKey/GroupByKey/Reify, through flatten CoGroupByKey/Flatten, into producer CoGroupByKey/pair_with_avro
root: INFO: 2018-11-25T12:12:21.966Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/Map(_merge_tagged_vals_under_key) into CoGroupByKey/GroupByKey/GroupByWindow
root: INFO: 2018-11-25T12:12:22.006Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(check) into CoGroupByKey/Map(_merge_tagged_vals_under_key)
root: INFO: 2018-11-25T12:12:22.061Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/GroupByKey/GroupByWindow into CoGroupByKey/GroupByKey/Read
root: INFO: 2018-11-25T12:12:22.094Z: JOB_MESSAGE_DETAILED: Unzipping flatten s21-u31 for input s22-reify-value9-c29
root: INFO: 2018-11-25T12:12:22.136Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of CoGroupByKey/GroupByKey/Write, through flatten s21-u31, into producer CoGroupByKey/GroupByKey/Reify
root: INFO: 2018-11-25T12:12:22.177Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/GroupByKey/Reify into CoGroupByKey/pair_with_fastavro
root: INFO: 2018-11-25T12:12:22.217Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/GroupByKey/Write into CoGroupByKey/GroupByKey/Reify
root: INFO: 2018-11-25T12:12:22.264Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/Map(reify_timestamps) into read-fastavro/read-fastavro/Reshard/AddRandomKeys
root: INFO: 2018-11-25T12:12:22.309Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/ExpandIntoRanges into create-fastavro/Read
root: INFO: 2018-11-25T12:12:22.355Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/AddRandomKeys into read-fastavro/read-fastavro/ExpandIntoRanges
root: INFO: 2018-11-25T12:12:22.402Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/RemoveRandomKeys into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps)
root: INFO: 2018-11-25T12:12:22.443Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at fastavro_it_test.py:164>) into read-fastavro/read-fastavro/ReadRange
root: INFO: 2018-11-25T12:12:22.490Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/pair_with_fastavro into Map(<lambda at fastavro_it_test.py:164>)
root: INFO: 2018-11-25T12:12:22.536Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/ReadRange into read-fastavro/read-fastavro/Reshard/RemoveRandomKeys
root: INFO: 2018-11-25T12:12:22.586Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Read
root: INFO: 2018-11-25T12:12:22.627Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps) into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow
root: INFO: 2018-11-25T12:12:22.678Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Reify into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/Map(reify_timestamps)
root: INFO: 2018-11-25T12:12:22.716Z: JOB_MESSAGE_DETAILED: Fusing consumer read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Write into read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Reify
root: INFO: 2018-11-25T12:12:22.764Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps) into read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow
root: INFO: 2018-11-25T12:12:22.814Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/GroupByWindow into read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Read
root: INFO: 2018-11-25T12:12:22.861Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Write into read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Reify
root: INFO: 2018-11-25T12:12:22.910Z: JOB_MESSAGE_DETAILED: Fusing consumer CoGroupByKey/pair_with_avro into Map(<lambda at fastavro_it_test.py:170>)
root: INFO: 2018-11-25T12:12:22.958Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/AddRandomKeys into read-avro/read-avro/ExpandIntoRanges
root: INFO: 2018-11-25T12:12:23.006Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/ReadRange into read-avro/read-avro/Reshard/RemoveRandomKeys
root: INFO: 2018-11-25T12:12:23.055Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/Map(reify_timestamps) into read-avro/read-avro/Reshard/AddRandomKeys
root: INFO: 2018-11-25T12:12:23.093Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/ExpandIntoRanges into create-avro/Read
root: INFO: 2018-11-25T12:12:23.131Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Reify into read-avro/read-avro/Reshard/ReshufflePerKey/Map(reify_timestamps)
root: INFO: 2018-11-25T12:12:23.179Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at fastavro_it_test.py:170>) into read-avro/read-avro/ReadRange
root: INFO: 2018-11-25T12:12:23.225Z: JOB_MESSAGE_DETAILED: Fusing consumer read-avro/read-avro/Reshard/RemoveRandomKeys into read-avro/read-avro/Reshard/ReshufflePerKey/FlatMap(restore_timestamps)
root: INFO: 2018-11-25T12:12:23.276Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-11-25T12:12:23.311Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-11-25T12:12:23.350Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-11-25T12:12:23.394Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-11-25T12:12:23.597Z: JOB_MESSAGE_DEBUG: Executing wait step start41
root: INFO: 2018-11-25T12:12:23.674Z: JOB_MESSAGE_BASIC: Executing operation read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Create
root: INFO: 2018-11-25T12:12:23.710Z: JOB_MESSAGE_BASIC: Executing operation CoGroupByKey/GroupByKey/Create
root: INFO: 2018-11-25T12:12:23.724Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-11-25T12:12:23.757Z: JOB_MESSAGE_BASIC: Executing operation read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Create
root: INFO: 2018-11-25T12:12:23.769Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b...
root: INFO: 2018-11-25T12:12:23.879Z: JOB_MESSAGE_DEBUG: Value "read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Session" materialized.
root: INFO: 2018-11-25T12:12:23.926Z: JOB_MESSAGE_DEBUG: Value "CoGroupByKey/GroupByKey/Session" materialized.
root: INFO: 2018-11-25T12:12:23.974Z: JOB_MESSAGE_DEBUG: Value "read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Session" materialized.
root: INFO: 2018-11-25T12:12:24.013Z: JOB_MESSAGE_BASIC: Executing operation create-avro/Read+read-avro/read-avro/ExpandIntoRanges+read-avro/read-avro/Reshard/AddRandomKeys+read-avro/read-avro/Reshard/ReshufflePerKey/Map(reify_timestamps)+read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Reify+read-avro/read-avro/Reshard/ReshufflePerKey/GroupByKey/Write
root: INFO: 2018-11-25T12:12:24.063Z: JOB_MESSAGE_BASIC: Executing operation create-fastavro/Read+read-fastavro/read-fastavro/ExpandIntoRanges+read-fastavro/read-fastavro/Reshard/AddRandomKeys+read-fastavro/read-fastavro/Reshard/ReshufflePerKey/Map(reify_timestamps)+read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Reify+read-fastavro/read-fastavro/Reshard/ReshufflePerKey/GroupByKey/Write
root: INFO: 2018-11-25T12:12:32.051Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-11-25T12:12:54.630Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-11-25T12:12:54.657Z: JOB_MESSAGE_DETAILED: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
root: INFO: 2018-11-25T12:14:50.753Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-11-25T12:14:50.791Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
oauth2client.transport: INFO: Refreshing due to a 401 (attempt 1/2)
root: INFO: 2018-11-25T13:12:24.014Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support.
root: INFO: 2018-11-25T13:12:24.211Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2018-11-25_04_12_16-5133104896937027182.
root: INFO: 2018-11-25T13:12:24.339Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-11-25T13:12:24.395Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-11-25T13:12:24.425Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-11-25T13:14:27.232Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-11-25T13:14:27.273Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-11-25T13:14:27.303Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-11-25_04_12_16-5133104896937027182 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 18 tests in 4219.543s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_39-13209760391495388955?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_18_53-11994966591657021439?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_25_26-7827209307283404873?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_36-11846844913868688746?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_38-11099311151463883943?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_18_13-14462982979914831944?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_24_34-5155139721679248950?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_30_29-16512367415133044086?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_36-1773449835415957041?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_36-9123242504191138850?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_11_47-8120278429861501661?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_36-15927463982479389778?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_10_55-11361752767653066576?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_18_18-3195433839844848248?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_36-509059572946958627?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_11_27-8730519684316803463?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_18_38-13080712804304957626?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_24_43-8491484322972524746?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_31_28-14541105594692575385?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_38_03-5366597258549564364?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_44_03-17448299476875821087?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_04_36-5956517685182612016?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_04_12_16-5133104896937027182?project=apache-beam-testing.
> Task :beam-sdks-python:postCommitIT FAILED
:beam-sdks-python:postCommitIT (Thread[Task worker for ':',5,main]) completed. Took 1 hrs 10 mins 20.473 secs.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 319
* What went wrong:
Execution failed for task ':beam-sdks-python:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 1h 14m 32s
6 actionable tasks: 6 executed
Publishing build scan...
https://gradle.com/s/7274r2pcnnvke
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_Verify
#6655
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6655/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python_Verify #6654
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6654/display/redirect>
------------------------------------------
[...truncated 509.45 KB...]
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "monthly count/Combine.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s3"
},
"serialized_fn": "<string of 236 bytes>",
"user_name": "monthly count/Combine"
}
},
{
"kind": "ParallelDo",
"name": "s5",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "format.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s4"
},
"serialized_fn": "<string of 1028 bytes>",
"user_name": "format"
}
},
{
"kind": "ParallelWrite",
"name": "s6",
"properties": {
"create_disposition": "CREATE_IF_NEEDED",
"dataset": "BigQueryTornadoesIT",
"display_data": [],
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "RowAsDictJsonCoder$eNprYEpOLEhMzkiNT0pNzNXLzNdLTy7QS8pMLyxNLarkCsovdyx2yUwu8SrOz3POT0kt4ipk0GwsZKwtZErSAwCu1BVY",
"component_encodings": []
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"format": "bigquery",
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s5"
},
"schema": "{\"fields\": [{\"type\": \"INTEGER\", \"name\": \"month\", \"mode\": \"NULLABLE\"}, {\"type\": \"INTEGER\", \"name\": \"tornado_count\", \"mode\": \"NULLABLE\"}]}",
"table": "monthly_tornadoes_1543169064064",
"user_name": "Write/WriteToBigQuery/NativeWrite",
"write_disposition": "WRITE_TRUNCATE"
}
}
],
"type": "JOB_TYPE_BATCH"
}
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
oauth2client.transport: INFO: Attempting refresh to obtain initial access_token
root: INFO: Create job: <Job
createTime: u'2018-11-25T18:04:38.287442Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-11-25_10_04_37-7849068734969825661'
location: u'us-central1'
name: u'beamapp-jenkins-1125180424-116725'
projectId: u'apache-beam-testing'
stageStates: []
startTime: u'2018-11-25T18:04:38.287442Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-11-25_10_04_37-7849068734969825661]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_37-7849068734969825661?project=apache-beam-testing
root: INFO: Job 2018-11-25_10_04_37-7849068734969825661 is in state JOB_STATE_RUNNING
root: INFO: 2018-11-25T18:04:37.385Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-11-25_10_04_37-7849068734969825661. The number of workers will be between 1 and 1000.
root: INFO: 2018-11-25T18:04:37.435Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-11-25_10_04_37-7849068734969825661.
root: INFO: 2018-11-25T18:04:40.165Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-11-25T18:04:41.701Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-b.
root: INFO: 2018-11-25T18:04:42.250Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-11-25T18:04:42.309Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-11-25T18:04:42.358Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-11-25T18:04:42.459Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-11-25T18:04:42.584Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-11-25T18:04:42.625Z: JOB_MESSAGE_DETAILED: Fusing consumer months with tornadoes into read
root: INFO: 2018-11-25T18:04:42.672Z: JOB_MESSAGE_DETAILED: Fusing consumer monthly count/GroupByKey/Reify into monthly count/GroupByKey+monthly count/Combine/Partial
root: INFO: 2018-11-25T18:04:42.722Z: JOB_MESSAGE_DETAILED: Fusing consumer format into monthly count/Combine/Extract
root: INFO: 2018-11-25T18:04:42.774Z: JOB_MESSAGE_DETAILED: Fusing consumer monthly count/Combine/Extract into monthly count/Combine
root: INFO: 2018-11-25T18:04:42.824Z: JOB_MESSAGE_DETAILED: Fusing consumer Write/WriteToBigQuery/NativeWrite into format
root: INFO: 2018-11-25T18:04:42.881Z: JOB_MESSAGE_DETAILED: Fusing consumer monthly count/Combine into monthly count/GroupByKey/Read
root: INFO: 2018-11-25T18:04:42.928Z: JOB_MESSAGE_DETAILED: Fusing consumer monthly count/GroupByKey+monthly count/Combine/Partial into months with tornadoes
root: INFO: 2018-11-25T18:04:42.976Z: JOB_MESSAGE_DETAILED: Fusing consumer monthly count/GroupByKey/Write into monthly count/GroupByKey/Reify
root: INFO: 2018-11-25T18:04:43.024Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-11-25T18:04:43.074Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-11-25T18:04:43.108Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-11-25T18:04:43.148Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-11-25T18:04:43.354Z: JOB_MESSAGE_DEBUG: Executing wait step start22
root: INFO: 2018-11-25T18:04:43.451Z: JOB_MESSAGE_BASIC: Executing operation monthly count/GroupByKey/Create
root: INFO: 2018-11-25T18:04:43.508Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-11-25T18:04:43.557Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b...
root: INFO: 2018-11-25T18:04:43.656Z: JOB_MESSAGE_DEBUG: Value "monthly count/GroupByKey/Session" materialized.
root: INFO: 2018-11-25T18:04:43.751Z: JOB_MESSAGE_BASIC: Executing operation read+months with tornadoes+monthly count/GroupByKey+monthly count/Combine/Partial+monthly count/GroupByKey/Reify+monthly count/GroupByKey/Write
root: INFO: 2018-11-25T18:04:44.242Z: JOB_MESSAGE_BASIC: BigQuery export job "dataflow_job_13973052911007792222" started. You can check its status with the bq tool: "bq show -j --project_id=clouddataflow-readonly dataflow_job_13973052911007792222".
root: INFO: 2018-11-25T18:04:55.580Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-11-25T18:05:14.682Z: JOB_MESSAGE_DETAILED: BigQuery export job progress: "dataflow_job_13973052911007792222" observed total of 1 exported files thus far.
root: INFO: 2018-11-25T18:05:14.734Z: JOB_MESSAGE_BASIC: BigQuery export job finished: "dataflow_job_13973052911007792222"
root: INFO: 2018-11-25T18:05:35.487Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-11-25T18:05:35.524Z: JOB_MESSAGE_DETAILED: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
root: INFO: 2018-11-25T18:07:27.532Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-11-25T18:07:27.571Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-11-25T18:07:28.682Z: JOB_MESSAGE_ERROR: A setup error was detected in beamapp-jenkins-112518042-11251004-4yem-harness-zk3v. Please refer to the worker-startup log for detailed information.
root: INFO: 2018-11-25T18:07:32.184Z: JOB_MESSAGE_ERROR: A setup error was detected in beamapp-jenkins-112518042-11251004-4yem-harness-zk3v. Please refer to the worker-startup log for detailed information.
root: INFO: 2018-11-25T18:07:48.003Z: JOB_MESSAGE_ERROR: A setup error was detected in beamapp-jenkins-112518042-11251004-4yem-harness-zk3v. Please refer to the worker-startup log for detailed information.
root: INFO: 2018-11-25T18:08:18.985Z: JOB_MESSAGE_ERROR: A setup error was detected in beamapp-jenkins-112518042-11251004-4yem-harness-zk3v. Please refer to the worker-startup log for detailed information.
root: INFO: 2018-11-25T18:08:19.149Z: JOB_MESSAGE_DEBUG: Executing failure step failure21
root: INFO: 2018-11-25T18:08:19.195Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S02:read+months with tornadoes+monthly count/GroupByKey+monthly count/Combine/Partial+monthly count/GroupByKey/Reify+monthly count/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-112518042-11251004-4yem-harness-zk3v,
beamapp-jenkins-112518042-11251004-4yem-harness-zk3v,
beamapp-jenkins-112518042-11251004-4yem-harness-zk3v,
beamapp-jenkins-112518042-11251004-4yem-harness-zk3v
root: INFO: 2018-11-25T18:08:19.328Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-11-25T18:08:19.404Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-11-25T18:08:19.450Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-11-25T18:10:11.019Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
root: INFO: 2018-11-25T18:10:11.066Z: JOB_MESSAGE_DETAILED: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job.
root: INFO: 2018-11-25T18:10:11.127Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-11-25T18:10:11.169Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-11-25_10_04_37-7849068734969825661 is in state JOB_STATE_FAILED
root: INFO: Clean up a BigQuery table with project: apache-beam-testing, dataset: BigQueryTornadoesIT, table: monthly_tornadoes_1543169064064.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
urllib3.util.retry: DEBUG: Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 173
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): www.googleapis.com:443
urllib3.connectionpool: DEBUG: https://www.googleapis.com:443 "DELETE /bigquery/v2/projects/apache-beam-testing/datasets/BigQueryTornadoesIT/tables/monthly_tornadoes_1543169064064 HTTP/1.1" 404 None
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 18 tests in 2683.738s
FAILED (errors=2)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_40-10619501220103224677?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_38-7927878155071309540?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_40-7161695053630940031?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_16_59-17704416867251687273?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_24_24-5742703706997750185?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_30_20-11186609359868357226?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_37-12176387962678726745?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_37-3706068116252383299?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_11_28-16762436658842793616?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_18_28-4550887450801010421?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_37-7849068734969825661?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_10_40-87527565036137448?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_18_30-1681529530696514830?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_24_25-15269715405729410454?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_30_35-9409211484788036621?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_37_19-9802234884212112180?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_43_29-12885495800942882741?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_38-3294149779166662752?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_13_07-5354828996564125796?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_04_38-37398875133442728?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_11_19-10545049789630682067?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_18_38-6784660283229927990?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-25_10_24_50-8518900843500055600?project=apache-beam-testing.
> Task :beam-sdks-python:postCommitIT FAILED
:beam-sdks-python:postCommitIT (Thread[Task worker for ':',5,main]) completed. Took 44 mins 44.576 secs.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 319
* What went wrong:
Execution failed for task ':beam-sdks-python:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 48m 54s
6 actionable tasks: 6 executed
Publishing build scan...
https://gradle.com/s/y5rocr35ubw2i
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org