You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/05/01 01:17:48 UTC
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py35
#1390
See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/1390/display/redirect?page=changes>
Changes:
[sniemitz] [BEAM-9795] Support custom avro DatumWriters when writing to BigQuery
[github] skip pulling licenses by default (#11548)
[boyuanz] Update container version
[github] [BEAM-8078] streaming_wordcount_debugging.py is missing a test (#11568)
[github] Merge pull request #11538 from [BEAM-9831] Improve UX for HL7v2IO
------------------------------------------
[...truncated 153.04 KB...]
},
{
"@type": "FastPrimitivesCoder$eNprYE5OLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqYIfgYGhvi0xJycpMTk7HiwlkJ8pgVkJmfnpEJNYQGawlpbyJZUnKQHACYlLgM=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "write/Write/WriteImpl/FinalizeWrite.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s7"
},
"serialized_fn": "eNrNWHmcHEUV7pnZJJtOgJBIJKIwBqKzkZnJQTBEhIRJAnHMZOldSHvEtqe7Zqqzfb2q6t0spoEk7m6MCioqHnjf4n3gfd8HeAveird4n3jGV9Uzu5m4WfMf/Ha3a+p4r99733vvq9nrCyXHjm2HEqtJ7KAimB3yVsQCXnEiRvSa7ft20ye7mR3HhG2Ntoc6aAMHIJdCvmQu0DQtZpFDOIdCjyIvwt+mzYlutbzQ9r1riDXGPEF06DMXoZglxmNiUS8UHOY5ruf7FUs+dcthxBbECu2AuCKJfRSZr0R27BpGmSuUyAK14oVxIpQmDv3mYlyJEjGztNCcL5eY1/ZC0KdgkVnEeY+/eE7ZUHEJOmyLiHFYPAWnGHBqo7EHTpuCJQacrlRbrQSDwdo8Jg4sbZgFtRbCMtqXNPfAA0rHB0CQfcKLdGsYxyEvHNHhDIzc8hQeWDJPR2FObeYqPy0ZclvAmeZ5uF5eVepsJcHAmg1uOWrhEk4stczlGqwwl+DRlucTK7YFtWJGWt4+eFCPEVGMBoS8Mmr7CZ5j0ajnEqYPCVt4ztVycbC7BmehbQ9O4SElU0fFmYQMD5zdg44f2a5a1+EcFQIuGBQn4KEGrDTndSXhXHMXfm7zTdWqIEFc5hhZu03K6GiZhG5ZRNlAuODVeLzsibLjR4lbzQCsrt2wceO6izasuWD9uvXrqozwxEfUz0uaKucsSmw0GlY1ZqKg4siTlozCw6j05uEplEr0bLqSnmviKQ0GUFya6ERSeHVPqNQa7wz6cHTZONpWi1RoHoHKzk+h3DQXonTgBZ3IVFSoJMzV2Lcxx6pqYQYpWFPXzOW9ULf9qNnFe63aLK+eFeF15grpqiy8EEPObM/3wrYVkjEcMbvXH1bOO1GA2HOOQGdWXWD2ySxPRAQbkmZvUoaCMKzGSiI8X9/C2klAQjHo2w6hka98vRB9fSSVz431nBovIils2gOPKpkXynIfFxTfxDFpLFV+a8qqrqu7Z547gtivbu+UvVqBi3vsiFWS6NZVYew5Iz5xh1DdDqlNh0encElWH2Ne6EZjVoARkI5jqV16omYlzVHWcF0F2Pat/5HWYbOKjGsLG7bMZs+0FVvxiA6XofO1FLZmfW7UI2PShm2zNatWEjqy1HTYXqLnmP14XuaO7Fdw+QRcYcCOUj1X1/CvUF9WO+Wwpu3XtMM57VBeG4LHNCagPqCkMFZMNlx47ATsNBmuVGkUkOpeEo54Ie+OZe7bo6Q6FrERjn6QqnTDGiRMJVbokGFZWNbuiLm1KAnFjmFrcHz9hipnTpW7I7LkJIzVY4JQzYJQicehoUy52LeDpmtfArt2HsnVNBg0z5C1xqLAYqhSVsG0tVeqDqlC1Ok5YEzC0ICAYQOu6olYmwjLFgJT7Wr1mmbi+QJdgt0qzLgtd8GchMcZ8PgeUS+IIyasIHITyQpPMJce184zF+CJE7DHgCcp9RbKOsKywJqEJxtg012N2QB0CE6gSRE+RCqPSBXqC+q12kGBBZ7T9uYlXq7C61BOS3Ga1/habT9uFTQ3r4k+7ZCm0BTz5B4ecgvaSF5jdTl1+7QVQ2K+5s7TpvfFgu7OzKSgJq2CthyHg6hDw/RwSo16XgXHJS0bGyG4MpfMa3FlsBb5PlG5V4xaRY4FV1zlFsc8QYsBMnhRUBt3QlIkPpHFXrQdSdfELdq8aKNA2PaJQGkJXqW43WNcFMVY1D3PiyR0ZAoRJmVQ48pVfOX56lkBIqBVUlXle1xAWzVImRUiinwOVBGwx33PIeApukB8Ya95Kn7aFsRifLrkYERt+yQEX3VRRU/bGIsYBLQoIDTzSjdEKhTdNIvV2yUfAEwBow3VUq3Z05TvvDdXW6Llz8zNzy3LLc315wq5Qh7EACZqYsAotSlvNFIYawjYZ8D4BFxjwFNoM4X9J2pJKd18DKdcOwen7FayxFWOdZjlOmwx16dwoKTqp6M9U3VwDlWXqxaXKexoOoSanprChIq4ldXB5InaZfaiHjU6TKGGwyk8TQXUQs6BIz3ykjN4RQaUCzuI9eHpT/B0FH1GCs9ULw88h0UcbjjSf9ctpbvvOXr0Ot6UP+Zpkiy7Qh0vb5yLhLtnOy4+C9/y7BSe0zSXyWCpK6mbudrRdtMc2rbbXAwyL/CENzrN7M9Flc9L4fnKNquFt92m7Yx0tN08h7ZBxVsdLS9ALS9M4UXoZNJMJuDFBtwyCS9J4aWYRy8z4OUq37PCk7c1ScLwCvMs2f1Q9aYZMt3UTdVNo2vhlfRSujlp0tVUpsmrUnh1iR6kEujXpPBaOkkP8ya9kcqwvC6F1zfpTVT684YU3khvptKoW1N4U2bUFLx5dvpee1L0/RaKtPzWkjSIbqGSGN+WwttLdFunYWbUlqsP1fr2y5b1DmS0dw5QJLF33Vck9u5eErtt58o8HZSF/h4D3ouFfpss9PchQO834AP0/6PxwR40PpTCh7tofCSFj/ag8bEUPt5F4xMpfBLRuLWDwqdmR2HdSaHwaYnCZ45F4bMpfO54FGa5YHwe4fiCguOL9xUct/fCcQfeKeggvZLiNeFLCMqXDfgKgnJHg94/OfirkoPp/YZ3vybg6yXappR6dC8doT5VHPkNGtGYIg9+k94+Fw/eOTsP3iXL41sGfBuRuFOWx3ewPL5rwPcm4PsG/EDy4A9PxIM/6uHBu1WR/DiFn3SL5Kcp/KynSH6ewi+6RfLLFH7VaVn3pPDrbh/9jQG/nYTfpfB7tOMPBvzxJMr0Tz1l+ucU/tK14K8p/K3HgntT+HvXgn+k8M9jyvRfZM5/i2SUiZ7r8G8U/k8KR0vZfzU8bnUuaUzLYQGqaCH0SZD4tswWeXslLId79Zy6vx7LiEETv9kxls925V1KMK/dxhIMWQEXT2RU55S+NXv1cGfK+lBm4ACbh4P6roj8Jm8gFppC8CskZ/OPV3o8yW9NmDJbZwsyXf04pGwhPukNdQ1ZvX86HdBIfQ4jZ7l0cJ0tytQuxiFpCnYKjpX/AjxAYWw=",
"user_name": "write/Write/WriteImpl/FinalizeWrite/FinalizeWrite"
}
}
],
"type": "JOB_TYPE_BATCH"
}
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
createTime: '2020-05-01T01:04:08.264151Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-04-30_18_04_06-7473479605852147951'
location: 'us-central1'
name: 'beamapp-jenkins-0501010404-643319'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-05-01T01:04:08.264151Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2020-04-30_18_04_06-7473479605852147951]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2020-04-30_18_04_06-7473479605852147951
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-04-30_18_04_06-7473479605852147951?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-04-30_18_04_06-7473479605852147951 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:10.122Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:10.677Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-f.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.325Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.363Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.401Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.439Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.472Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.567Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.631Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.663Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.696Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.730Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.768Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.810Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.843Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.882Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.916Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into format
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.950Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into write/Write/WriteImpl/WindowInto(WindowIntoFn)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:11.990Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.032Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/Pair
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.060Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.098Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.128Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.164Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.207Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.239Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.278Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.313Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.513Z: JOB_MESSAGE_DEBUG: Executing wait step start26
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.582Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.615Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.637Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.652Z: JOB_MESSAGE_BASIC: Executing operation group/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.677Z: JOB_MESSAGE_BASIC: Starting 10 workers in us-central1-f...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.741Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.741Z: JOB_MESSAGE_BASIC: Finished operation group/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.816Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.857Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:12.890Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:36.906Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 8 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:36.938Z: JOB_MESSAGE_DETAILED: Resized worker pool to 8, though goal was 10. This could be a quota issue.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:38.879Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:04:42.343Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 10 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:06:10.470Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:06:10.510Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:12.449Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:50.837Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:50.899Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:50.931Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/InitializeWrite.out" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:50.998Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(InitializeWrite.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.031Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(InitializeWrite.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.046Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(InitializeWrite.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.060Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(InitializeWrite.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.077Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(InitializeWrite.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.110Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(InitializeWrite.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.117Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_UnpickledSideInput(InitializeWrite.out.0).output" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.143Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(InitializeWrite.out.0).output" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:10:51.175Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(InitializeWrite.out.0).output" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:11:20.094Z: JOB_MESSAGE_BASIC: Finished operation read/Read+split+pair_with_one+group/Reify+group/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:11:20.165Z: JOB_MESSAGE_BASIC: Executing operation group/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:11:20.224Z: JOB_MESSAGE_BASIC: Finished operation group/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:11:20.286Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:13.400Z: JOB_MESSAGE_BASIC: Finished operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:13.474Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:13.535Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:13.614Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Read+write/Write/WriteImpl/GroupByKey/GroupByWindow+write/Write/WriteImpl/Extract
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.251Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/GroupByKey/Read+write/Write/WriteImpl/GroupByKey/GroupByWindow+write/Write/WriteImpl/Extract
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.308Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/Extract.out" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.357Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(Extract.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.385Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(Extract.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.412Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(Extract.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.440Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(Extract.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.492Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(Extract.out.0).output" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.517Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_UnpickledSideInput(Extract.out.0).output" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:16.576Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/PreFinalize
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:18.913Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/PreFinalize/PreFinalize
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:18.981Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize.out" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:19.051Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(PreFinalize.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:19.102Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(PreFinalize.out.0)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:19.234Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_UnpickledSideInput(PreFinalize.out.0).output" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:19.311Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/FinalizeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:21.956Z: JOB_MESSAGE_BASIC: Finished operation write/Write/WriteImpl/FinalizeWrite/FinalizeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:22.015Z: JOB_MESSAGE_DEBUG: Executing success step success24
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:22.120Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:22.249Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:14:22.281Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:16:28.686Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 10 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:16:28.737Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-05-01T01:16:28.774Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-04-30_18_04_06-7473479605852147951 is in state JOB_STATE_DONE
DEBUG:apache_beam.io.filesystem:Listing files in 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results'
DEBUG:apache_beam.io.filesystem:translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results*-of-*' -> 'gs\\:\\/\\/temp\\-storage\\-for\\-end\\-to\\-end\\-tests\\/py\\-it\\-cloud\\/output\\/1588295043232\\/results[^/\\\\]*\\-of\\-[^/\\\\]*'
INFO:apache_beam.io.gcp.gcsio:Starting the size estimation of the input
INFO:apache_beam.io.gcp.gcsio:Finished listing 30 files in 0.06351923942565918 seconds.
INFO:apache_beam.testing.pipeline_verifiers:Find 30 files in gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results*-of-*:
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00009-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00025-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00023-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00028-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00029-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00012-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00010-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00011-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00027-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00026-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00021-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00017-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00000-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00016-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00004-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00020-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00005-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00015-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00024-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00014-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00022-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00008-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00018-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00003-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00019-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00007-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00002-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00001-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00006-of-00030
gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1588295043232/results-00013-of-00030
Terminated
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=6e1d4781-9d15-459c-a950-248fc3ecd99c, currentDir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 6176
log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-6176.out.log
----- Last 20 lines from daemon log file - daemon-6176.out.log -----
at org.gradle.process.internal.DefaultExecHandle.execExceptionFor(DefaultExecHandle.java:232)
at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:209)
at org.gradle.process.internal.DefaultExecHandle.failed(DefaultExecHandle.java:356)
at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:86)
at org.gradle.internal.operations.CurrentBuildOperationPreservingRunnable.run(CurrentBuildOperationPreservingRunnable.java:42)
at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Shutdown in progress
at java.lang.ApplicationShutdownHooks.remove(ApplicationShutdownHooks.java:82)
at java.lang.Runtime.removeShutdownHook(Runtime.java:239)
at org.gradle.process.internal.shutdown.ShutdownHooks.removeShutdownHook(ShutdownHooks.java:33)
at org.gradle.process.internal.DefaultExecHandle.setEndStateInfo(DefaultExecHandle.java:199)
at org.gradle.process.internal.DefaultExecHandle.aborted(DefaultExecHandle.java:352)
at org.gradle.process.internal.ExecHandleRunner.completed(ExecHandleRunner.java:107)
at org.gradle.process.internal.ExecHandleRunner.run(ExecHandleRunner.java:83)
... 7 more
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed)
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
2020-05-01 01:17:47,640 72714596 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 846, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 689, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 161, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 96, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2020-05-01 01:17:47,642 72714596 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2020-05-01 01:17:47,645 72714596 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 995, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 846, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 689, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 161, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 96, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2020-05-01 01:17:47,646 72714596 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2020-05-01 01:17:47,646 72714596 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2020-05-01 01:17:47,646 72714596 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/runs/72714596/pkb.log>
2020-05-01 01:17:47,647 72714596 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/runs/72714596/completion_statuses.json>
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_WordCountIT_Py35 #1391
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/1391/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org