You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/08/14 13:09:20 UTC
Build failed in Jenkins: beam_PostCommit_Python35 #2816
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2816/display/redirect>
Changes:
------------------------------------------
[...truncated 21.74 MB...]
"output_name": "None",
"user_name": "m_out.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s4"
},
"serialized_fn": "QlpoOTFBWSZTWb8iNBkAAp9/8H/////////////cwr///+ZrwCAAAEBAAvzlidAu7uw1NENRPU9TQ0DIbTRAD0hpoADQNGnpAGIaGhpoANBk00GoJPQxTKepoZP1TT1AANAAaAAAAAAAAAAPUaDUxNVPyUNAAGgAAAAAAZAAAAAAaeoAAEogQJowmiaamgyDTQAAA0AAMh6g0AaAZGhiAYl/spPbZGxqV18/Knju0x0vWVzJ71dctTwQ00UE/CUaTQzomIJFfsoYjlVByKiQmcNQuFxiX/T7kbMhVKgtuEkz5YivWIwfDVUKaIhojEMwYM2DqMy6YYfV7VkMEIRxCA085NgcTCBEC2jMilgbJBMYEIAUVLQ1TZ+LZJi4e9i83qgFS0X0GpgXG1GKCqLo4zmvnY1Yaee6YI1mXOUAOy8yfkBW8DxloiENEcUiOTBLQjwqLj5ahQWvIcNDC+iRl+IIrxdzjwktl6iNH2ZLnJM5Z2Vchrxg3GKdrTwY+olfJkONSUyHPZWXRlvJsqemi3WLom7zYeUNZqEQggCVAEWJGMNgOglYg6OiKdQdF7JCSEQ8ZltmQOY8PpRmQ1rSBJPGNzQh1QVfY2K2EBjVW5H9x1OtTeiAmnb1oNm2fy0tT6x9P3+vRkfjatTQJyq/UApggBtmXIIRAdhdkgqyqMUEdIJSgFpRHFOwIcZDGhhngbJxOMpEJiJ+htZuC96R+cffdcMmmOYfrjHI0gyMcKXiwwAyiioGluSQGtivhH8fDp2wJ5DYWFyiUrgwGCD7qjoGqY5gbVXrkeE2ysTAZFqsplEqMBVXSIYFy1lswrbsvmEQkesWLMCWEFWCIbQW44jKaoNID1oCPFBCCtgiSE7FHOGlpFJAV6guTOTbucvYGxjBaIPRmRaDHshoQwToKk5jUgfkGLbFlUvF2KKW88DVsu2iifOGfsXEcKeMadMbkfmEhKl0k5ppaTyYxp5xspKF8xV/jOVJVVW06PJ84j0SLQSkvMRHOgSBrXOIgQFpR1j1BiwB7pJs4lQaAylRJlQyzDsWQ9dNICFG6jDAt10BYCYnGtFGCktMdTK8YpMjrlqd8sthYEY9iZQ67NNLBHmoufmw39SQFgqjvgKFM1VkQUJ2lKY5MSIDUAetYQ9KjnDsDRCNogQ+J6EKskYiDsNqGwrWriVmH5gk3x806dSp+1bb+rUp/+LuSKcKEhfkRoMg",
"user_name": "m_out"
}
}
],
"type": "JOB_TYPE_BATCH"
}
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
createTime: '2020-08-14T13:01:35.744781Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-14_06_01_34-7371017702575864641'
location: 'us-central1'
name: 'beamapp-jenkins-0814130125-923877'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-14T13:01:35.744781Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2020-08-14_06_01_34-7371017702575864641]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2020-08-14_06_01_34-7371017702575864641
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-14_06_01_34-7371017702575864641?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-14_06_01_34-7371017702575864641?project=apache-beam-testing
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 2/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 2/2)
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_06_01_34-7371017702575864641 is in state JOB_STATE_RUNNING
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 2/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 2/2)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:34.331Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-08-14_06_01_34-7371017702575864641. The number of workers will be between 1 and 1000.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:34.331Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-08-14_06_01_34-7371017702575864641.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:38.460Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-f.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.169Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.205Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step GroupByKey: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.244Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.270Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.338Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.380Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.408Z: JOB_MESSAGE_DETAILED: Fusing consumer metrics into Create/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.461Z: JOB_MESSAGE_DETAILED: Fusing consumer map_to_common_key into metrics
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.494Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Reify into map_to_common_key
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.521Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Write into GroupByKey/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.560Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/GroupByWindow into GroupByKey/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.583Z: JOB_MESSAGE_DETAILED: Fusing consumer m_out into GroupByKey/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.606Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.629Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.664Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.701Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:40.978Z: JOB_MESSAGE_DEBUG: Executing wait step start13
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:41.031Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:41.074Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:41.110Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:41.157Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:41.212Z: JOB_MESSAGE_DEBUG: Value "GroupByKey/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:41.282Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:52.074Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:56.490Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:01:56.577Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:02:10.676Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:42.043Z: JOB_MESSAGE_BASIC: Executing BigQuery import job "dataflow_job_15425648569970780419". You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_15425648569970780419".
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:48.738Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:48.764Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:52.782Z: JOB_MESSAGE_BASIC: BigQuery import job "dataflow_job_15425648569970780419" done.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:53.529Z: JOB_MESSAGE_BASIC: Finished operation read+write/NativeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:53.586Z: JOB_MESSAGE_DEBUG: Executing success step success1
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:53.691Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:53.863Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:03:53.881Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:23.174Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Create/Read+Type matches/Group/pair_with_0+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:26.978Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+InspectForDetails/ParDo(_InspectFn)+ParDo(CallableWrapperDoFn)/ParDo(CallableWrapperDoFn)+Type matches/WindowInto(WindowIntoFn)+Type matches/ToVoidKey+Type matches/Group/pair_with_1+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:27.072Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:27.125Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:27.196Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:36.398Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:36.481Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:36.619Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:36.682Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:36.718Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:43.188Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:43.225Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:04:43.261Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_05_58_22-1942598312627804815 is in state JOB_STATE_DONE
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Attempting to perform query SELECT fruit from `python_query_to_table_15974098907285.output_table`; to BQ
DEBUG:google.auth._default:Checking None for explicit credentials as part of auth process...
DEBUG:google.auth._default:Checking Cloud SDK credentials as part of auth process...
DEBUG:google.auth._default:Cloud SDK credentials not found on disk; not using them
DEBUG:google.auth._default:Checking for App Engine runtime as part of auth process...
DEBUG:google.auth._default:No App Engine library was found so cannot authentication via App Engine Identity Credentials.
DEBUG:google.auth.transport._http_client:Making request: GET http://169.254.169.254
DEBUG:google.auth.transport._http_client:Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): metadata.google.internal:80
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bigquery.googleapis.com:443
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "POST /bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/22cc2e77-bbde-4a23-af64-39efebd2df99?maxResults=0&location=US HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anonb2b8bf5459c05afad1634d7483ba041e156812cd/data HTTP/1.1" 200 None
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Read from given query (SELECT fruit from `python_query_to_table_15974098907285.output_table`;), total rows 2
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Generate checksum: 158a8ea1c254fcf40d4ed3e7c0242c3ea0a29e72
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:26.871Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:26.918Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:26.950Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:34.545Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_05_58_59-9778407124261489443 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:37.701Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+ExternalTransform(simple)/Map(<lambda at external_it_test.py:43>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:37.755Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:37.801Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:37.882Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:47.125Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:47.195Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:47.306Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:47.364Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:05:47.385Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:06:37.240Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:06:37.277Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:06:37.300Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_05_59_28-6720190228985869397 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:26.840Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:26.910Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:26.959Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:27.019Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:36.150Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:36.218Z: JOB_MESSAGE_DEBUG: Executing success step success11
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:36.327Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:36.388Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:07:36.415Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:09:03.996Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:09:04.045Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T13:09:04.080Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_06_01_34-7371017702575864641 is in state JOB_STATE_DONE
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_streaming_wordcount_debugging_it (apache_beam.examples.streaming_wordcount_debugging_it_test.StreamingWordcountDebuggingIT) ... SKIP: Skipped due to [BEAM-3377]: assert_that not working for streaming
test_datastore_wordcount_it (apache_beam.examples.cookbook.datastore_wordcount_it_test.DatastoreWordCountIT) ... ok
test_autocomplete_it (apache_beam.examples.complete.autocomplete_test.AutocompleteTest) ... ok
test_leader_board_it (apache_beam.examples.complete.game.leader_board_it_test.LeaderBoardIT) ... ok
test_game_stats_it (apache_beam.examples.complete.game.game_stats_it_test.GameStatsIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_avro_it (apache_beam.examples.fastavro_it_test.FastavroIT) ... ok
test_user_score_it (apache_beam.examples.complete.game.user_score_it_test.UserScoreIT) ... ok
test_hourly_team_score_it (apache_beam.examples.complete.game.hourly_team_score_it_test.HourlyTeamScoreIT) ... ok
test_read_via_sql (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_read_via_table (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_bqfl_streaming (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... SKIP: TestStream is not supported on TestDataflowRunner
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_one_job_fails_all_jobs_fail (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_bigquery_read_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_bigquery_read_custom_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_avro_file_load (apache_beam.io.gcp.bigquery_test.BigQueryFileLoadsIntegrationTests) ... ok
test_spanner_error (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_spanner_update (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_write_batches (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_copy (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_value_provider_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_transform_on_gcs (apache_beam.io.fileio_test.MatchIntegrationTest) ... ok
test_datastore_write_limit (apache_beam.io.gcp.datastore.v1new.datastore_write_it_test.DatastoreWriteIT) ... ok
test_parquetio_it (apache_beam.io.parquetio_it_test.TestParquetIT) ... ok
test_dicom_search_instances (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_dicom_store_instance_from_gcs (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_file_loads (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... SKIP: https://issuetracker.google.com/issues/118375066
test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... ok
test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_analyzing_syntax (apache_beam.ml.gcp.naturallanguageml_test_it.NaturalLanguageMlTestIT) ... ok
test_text_detection_with_language_hint (apache_beam.ml.gcp.visionml_test_it.VisionMlTestIT) ... ok
test_basic_execution (apache_beam.testing.test_stream_it_test.TestStreamIntegrationTests) ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream supports emitting to multiple PCollections. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream can independently control output watermarks. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
test_label_detection_with_video_context (apache_beam.ml.gcp.videointelligenceml_test_it.VideoIntelligenceMlTestIT) ... ok
test_big_query_write (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_new_types (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_schema_autodetect (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... SKIP: DataflowRunner does not support schema autodetection
test_big_query_write_without_schema (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
Runs streaming Dataflow job and verifies that user metrics are reported ... ok
test_big_query_legacy_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_avro (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql_kms_key_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_deidentification (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_inspection (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_job_python_from_python_it (apache_beam.transforms.external_it_test.ExternalTransformIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
test_metrics_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3998.096s
OK (SKIP=7)
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 235
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py35:postCommitPy35IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 8m 51s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6tjoo5snhj46m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python35 #2831
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2831/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2830
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2830/display/redirect?page=changes>
Changes:
[yoshiki.obata] [BEAM-9980] add groovy functions for python versions
[yoshiki.obata] [BEAM-9980] update dataflow test-suites to switch python versions using
[yoshiki.obata] [BEAM-9980] version switchable dataflow tasks to be invoked
[yoshiki.obata] [BEAM-9980] :sdks:python:test-suites:dataflow included in
[Luke Cwik] [BEAM-10670] Make key coder deterministic by using upstream PCollection
[Udi Meiri] [BEAM-10697] Remove testPy2Cython from precommit
[noreply] [BEAM-9891] Generate query execution summary table after finishing jobs
------------------------------------------
[...truncated 21.50 MB...]
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "unbatchable",
"user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn).unbatchable"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s2"
},
"serialized_fn": "QlpoOTFBWSZTWazGXbsAAXl/wP//////+RAAFfuUwr/n//JgwAQAQAG8lZiw0iZNU2jQ9TRk0JoGI9RoZGag2oGNJk0BoNPUyDSDVHkj0yp5T0j1ABoMgBkZAAZGQNMgAc0xGRk0yaAZDRkMmQAAAyNMjQMIZA01NFPKMkY9UwIBoAA0AAADQGQ0NGnIZZTUjFaCrlxdhiZNpxjutQIPQyEADfKHAWi+UpAgkk3Ll63d9rq+vvBs6cASCCQRhMYCShKICUA4a+0wmC3dvpE5sUF6EIORjA2B3PZDtI5568FiKDdtcmS5Hcs/OVdPq77ZuaZy9mGFN2Krrh9u5vpmoic0tbxFY4kwRpqq0GKFDQa+kqBYhkCLPV4SDQ56fAEwvtkQyZhPyLSUPrbtYZRHJeRLD+TNmzqyqdAYBHXUwsfjyUoWZCwGWaNIP1AUh5r4JnZjn9FUY2GM6mKEoOkEsgFpCWCWAdHmFQNpSAPBBksSGgRh3qpIcPgQTI6YYWQaPp0swnCtDIeVQHNiYtFFKDBQRgxVruSMxooI+pAOV4EDIXQYLIYjQqPDGCSvYUSsE+akWrYgUWDzIEjfTOIo0Zc/+/oIpR2Bh/cDGLTDXl8Fgq0Y0nOdLOVYLOcUBSfVEWtwFqgpVdWa2zVfWYGY0CbnxNaEiSJ9NZKa8IMTgl5J0nGSjzTANhVHrQNu+5LChRZoWtwNOKMR2zlKJx6UBPenaZNUzyIV5P7Vr/xdyRThQkKzGXbs",
"user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)"
}
},
{
"kind": "ParallelDo",
"name": "s4",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_BatchFn",
"type": "STRING",
"value": "apache_beam.io.gcp.experimental.spannerio._BatchFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s3"
},
"serialized_fn": "QlpoOTFBWSZTWbi88tEAAWF/wP//////4RAAFfuUwr/n//JgwAQAQAG8ju5s4go0mRMZCbQJgA01NNpppoTAIwAGgAGkTJPalP0aT0o9NTRiAAyBiGhoABoaA000ImmmiUxPU9J6B6ppkaMhoYAmjCYIYEaaBptBppNQ1J5Ib0pk09TQAAAAaNAAAyNBpo5DMK087lXMnamIPqwhvMiAehlIROAof4sLxSoCCSbdv58Lntcd6+72pYABJBIIwVUElCUQEoBp5GS6KmvJaTfBBgcTGOEiAv1XUsHAoicC7ZvLz6ebKxQc0Jq3MX2/ZrX8jde9G9N78L23FNf+es0RaXMtlQ+lHCFszwHiyCIF8AJz49EBSMCCIuADotCSUx0RcgYFToywImE86Ljz59PPMjDA8BOUj4z+ipmp4VNAFrjR28gI2pdaCFzMjfcmOuGE03whALHgYkEsCaUNjzyhWZPAkADJokGBII0oDR9hyZWzD4Y4xia+cVw7KrVQ2JdkYxiIJIiih1eNIRsMJJLrxFIA8ylnqM0KjByRhVEuNQ4TKKdJIM6h5Rz5DKEheTQIhUm0b99xBCg4Ej/wJSRLFbCYRPccUzOHwEThRzEAFHDJB9SoBVAEFUXQpWjUpUJDKcpHXiMwkPic1RQG4IWM0ChWVGooKWksBbCncpAvB8QhE1PV0Ab4UElqSYT5zAdPJi/f5uAQk9/Hn17F3JFOFCQuLzy0QA==",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn)"
}
},
{
"kind": "Flatten",
"name": "s5",
"properties": {
"display_data": [],
"inputs": [
{
"@type": "OutputReference",
"output_name": "unbatchable",
"step_name": "s3"
},
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s4"
}
],
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable.out"
}
],
"user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable"
}
},
{
"kind": "ParallelDo",
"name": "s6",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_WriteToSpannerDoFn",
"type": "STRING",
"value": "apache_beam.io.gcp.experimental.spannerio._WriteToSpannerDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/Writing to spanner.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s5"
},
"serialized_fn": "QlpoOTFBWSZTWeXpTGIAAs9/wH/////////////+wr/3/+JhwEAC7Os5XFIMQkMVP1EwZPUTCZpMgAaAA2ppoNGjRoDTQGEDRkAzUGiYhJ6aEmpsCg09RoHqAaAAAAAAAAABo02p6g1P1RFGg0AAAAAAA0AAA2pkAAA0B6gABJFNJppNT2qb1TzU9UeUZGjAg0AMIxAAGTEAMmRoMh6mTFMi7p7Deq3xCv4DWPJYSlBHSy6yxEvzqPFTsrxo0VDkoiIBZIDElHGSBNTgp/prUdg1AwEgYQww+8qGU2X9IU+9EmB53k88/NJkQQhCAQAMAABgJAxk2HUybmhjYfJlq0YOT6fV7fhIrTNtp6aS+C2olGohggndMwdUtASNlsAo4pJsDoGzr8lyVMMVgd41ZVm5tU8muVGhQjghSVu6vZWE45Q7cCSrkGZIANT6EODTXkJBIfHi7YlRAqywWNU3Z5Wtaaq10b9CxJnZNREuhWb5kWD4tGi8pd9LtO45cRljBwgAZumU02AgsHUP/HZbI9jZziOQItR6lE201AArtAMQiAKihIwZEZsKBI/la3a8uhDLeU6Y/g1hx39X7s4Z/2QBcKhboGBXr9liz7wrSNh9Vqv5TIFARiAkI5Y4mWTegN4dBAUWkGQQsRQQFAFDa7YaGtr9NE0CAE5z8ZEV12x1NH1rLSfOSeOpZwAhRGcODtCmo1l2B7xOomjnIEREoEY/rGGYKKQoJCeewoiEalUk18FRjS/M6SlkrE1dFhkQYMY4gR4kE6sXpdLjwITvWioMGUtKoh9yR1f8ZGAEJrdqHFHYOd4IRNmg43AAKYxKTiMp2GQOSlSUY8QwzzPAIEqKwDcIkHTQAdyq9JBOowrDOmZF+XSa3NeXJE2BCIstAvbCoqUlUj49dlXlTWZ0K6Dh/shctMUSicRfsTSy5cL1N6Cdu85b+b2bJfKc4UnhzRVERq77yRK4nZOKKAquNcznOecYpBEw3JszVSRIpSxmYAMrpZwx2BmIhoGyAtrtwhXscYQDYFieJ7iVBC5iFwpBBKrRKi2sDpBjPWtBEyeDEDVDqzhNSiCegqIyUcUG+dVL6KXoQOX5aD8lloqgQNkpKQwTeY1dXL2qb1At54nk2YQgdmM9IKr5SCRgQPFcgDy4vdbnOqNwgDdbbc2rdtv/F3JFOFCQ5elMYg==",
"user_name": "WriteToSpanner/Writing to spanner"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-18T00:27:12.936731Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-17_17_27_11-17673970446702328785'
location: 'us-central1'
name: 'beamapp-jenkins-0818002702-918260'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-18T00:27:12.936731Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-17_17_27_11-17673970446702328785]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-17_17_27_11-17673970446702328785
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-17_17_27_11-17673970446702328785?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3840.790s
FAILED (SKIP=7, failures=1)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 118
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 6m 14s
153 actionable tasks: 129 executed, 22 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/c6mbcozyhqdyo
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2829
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2829/display/redirect?page=changes>
Changes:
[katarzyna.kucharczyk] [BEAM-10672] Added streaming option to combine test
[katarzyna.kucharczyk] [BEAM-10672] Added experimental dataflow param
[katarzyna.kucharczyk] [BEAM-10672] Spottless Apply
[katarzyna.kucharczyk] [BEAM-10672] Updated streaming commands
[katarzyna.kucharczyk] [BEAM-10672] Fixes after review in combine python load test
[katarzyna.kucharczyk] [BEAM-10672] Changed jobType variable into mode to declare if it is
------------------------------------------
[...truncated 20.64 MB...]
======================================================================
ERROR: test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py",> line 1055, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py",> line 151, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py",> line 151, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Runs streaming Dataflow job and verifies that user metrics are reported
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py",> line 76, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3644.391s
FAILED (SKIP=6, errors=8)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 5s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qexadmm5pazde
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2828
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2828/display/redirect>
Changes:
------------------------------------------
[...truncated 20.98 MB...]
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_merge_tagged_vals_under_key"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Group/Map(_merge_tagged_vals_under_key).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "QlpoOTFBWSZTWaE4BakABBp/zH//////////////////////wSAABABQBHeXbpsW6bsHdYrg0SaU09TQNBoNNBpkyNAGgAAaaNNNAA0AA0aAAaHqZAeoBpBMk8mUepip+hJmp6EGE0AG0TQMgyAABpoGmhoaDE0AAGINBCaKZqE2hqMBAaGaNJowEMIAMEBiYExNBiYJp6hhMAEGAAmAAIwAAjAARoxNMATAABMIwjATJiMQMCRKMgTUMTU9U9PQGpp6U09EPSGmgBoAAAD1AaAAA0BoAMjTsGR6Ca0WzPMalTPZacTz2ReVYN2FSYMD1k9NWahcTY60yxfitEe78HRKEB0GIP6aXTp+d7Nmr0KkGGmPPCMroOS99iDI6XjcDEeRdCLGBJkrYg5deacuLfKqLap0pK9H7FBq321bFAiDLoX0wLwpwbDx6/KG0zWFMJZHTU/URJiDWrqhoaTWm1QElMyJbnExyqCeEN6hYj1Z07aX9gpwiToevTT0bQPrthbRBDbbelEOh3uHDDWcpERCJQ1TE0aqqAgGXqZVwDVq/TOuXnWYzY9zYTizqCU+vI+mGQDZT563qc4pBXnoKOcJtt83jKSotTUJrGuFW1qkkqPQZWmeoms7M7G7pjGRWfnD3hwuQ+T1Op3Ff3E9rALUljCskmjBvKaCiY5RMsCrZvwKCzs0sY2rNfCteF6j5Pt3ahSCfKSqe0kLqtq+oXZDI1r7tWEgEYxtHVhZ1jxaTrs7u+P5w766aZIOweAItPKzUSYfYCU/cl+Md9FjacSbz8WJp/fhwcvtuwtvki56X/g13e/L8UhGp1StKrjsRh0+bus5u74UJ6DOGiAUvkqQytCZHooRLgFCfEoH+XtgoMo3wexA9WRXCrcNdExHIGCeVIwhTUtnT4IsWAYu9lhOkrxKxadZbhEVFbbb+9RRhK6PitVEm5WfMUqpL1atYoyIOI+DE+OQnUheP1db1Nusv6+z3sUUshyIHddiYx0LpmvBmyKjJOx7SutsiqErBayoRUXOeU2MxFazLZUtyepuJGwSH3mISuVNb3JQXceVF7smc4VWWVuc06v+ugciPo2CQiiEmiWwejlLMjlimQ4ZVMQCiW0RI6RbhiE5zduAyQlKgFN6G6ONIcyZPtVblZ+M+trU05EG08Gb0nYJw5VoAElAJmhlO2eGdZGvtboqt84XC5VuktGTnvELBN6BYljVE8qFoNEbydmW9PfyuywXFYrZuvpXF0ySmEODYTSLOJAs4PFdWamRTVJMliQXevMC51U1OoNRtOiBSo5g2mKlA6WD4Ozwhgi8wZ8KpVhAnPXkjDtrSQUmWfrJqebSa0senGZY0jmdqFBMjA2yCcxQZXfvCslbt6GOtI2OL3eUd0o15eXBq4MkpV/clL1op3qkOXUXYM4pjlnlOSyQkVPCkg5U/GZUFEhtnIkRwmb4HOa6oR7WqtpMoZjzvhRQ+RDpgszEqVA5zuq10QQhCKVDq08cbUIQhZntD4m9FkkHBuSvTWsnNVG2ivsXJCu0V8rbJzsZvYlx1LcgKFy1BQd1bq304dCsQRwq1aYU4DTNaMhhtUiE0e/dJYL1jnQXXZSjdssKsPVBuirDkVWYJjHLxsL5oYGVvZmAlEZiIAMFpMCUYU9aS+cHXLNxJORpUSVygN3aGqYiUzHatXVk9iCqcVpxLWURHTd/GabL6Bo4Fs1G/AlgTsyCTBHZt/02d3AlBOmHBA1gKJCDEdb4+UML4tiluswuHFEx+U/7z/zxn8n/UDQv8XckU4UJChOAWpA=",
"user_name": "assert_that/Group/Map(_merge_tagged_vals_under_key)"
}
},
{
"kind": "ParallelDo",
"name": "s22",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Unkey.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s21"
},
"serialized_fn": "QlpoOTFBWSZTWRP1du4AAtF/wH///////////////////+ZrwFADNmom9u2uxO8NTRJoIwmTTTTNQ0GRo0ANDIAZAAZANA0yNNMamjTEDIDUIaT00ETyExMgZAAAaAAANAAAAANAAaAA01NNBJPJqnhRo9JoyA0NGgANAAeoDQaaAAAGgGhkaAgwAmAAABMACYAAAEwAmhgAAAAAACUUmiemiaaBoPUYjRoAAANAAAAAAAAAAABrF6JqQ2Ur5wxHno0ilfQnHUKuhKrk/BO6qCATighP4yg8FSDKCuAAJRL5UhMH1D2/tgm/m6DnB2io95UVOcCQmY56uGbnZ2gv1CZwcxU2Xv+8wkyDbJc6wAXEkmyUByQ2I5yQRkEDkAGYUj972/CcAsHNf6TKTLn0V4DcKOgZCgXbz8h5QE4Rd9I6kRD6gQ4EMMoREmEkkCOoClgCAJgcMSMIEzLQ4Tqg92kcgvqnQxOtIYAn7YSHo9mph6FwggtjmMhMyR3fx5rIM1aKQBCFC19Hc4YEeR19smHMaZzS34Dvp94g17jootYT6jJjKxo3LxsN/C7rGlJoSilrU6dJ2JjqV0HMMYy0jxQ8F0SdUiDLxU3u6zAkeeYwIk5e26+9pNAPGfSj8ZqQE5Ok2z9DAASNOAOYEhWCQTiBa4yQqSsc8PFzi2dLEIKA7oM82VkNSLH2nTGI+vIzOFg4nnTAgM0uHSmUJ7iLFlQTokJYYMUiNCTg2D568hERwYaHCGO4rzMEIoyLBBHqOni7b3zZZsS9AELrTjlhTa1iihZCgQFoXbBsVXQih80iirdAiJbqcrOxKDxX1ualOK5Bg4bB6HIFsok3ASQAYgoQSdiQHh0hyerwdRj1VhI7cA2YIN0IQSVKRBI1Mw4r6ZoxY8JoSbUJNjHCmwYlqygTGQ2WFdoMKBANWEnwYIkFZBSUUGWLEVUUGhFZUFqIA3ZPyJOjoaGAV2yhKQx+EjQj8YPFaKRoRBABB8gGBQgoeWWfQ2ZIjiX9/Z1BE/Jss38Nf5qm+qVFvTf176YriM5qllCmiOC90DXGZSn/OLe5zqDMmUYQaBi96rhviZ3FZVVa71u3TKVKqqxJBCY97W2AUqQwvCOaXoBh4sXxYYtQ1aNp3Ioxxo0XMQMEviAyArSQUQzOhxAWBgUBQNsh+qhDwXCrwElNEAcikBcMpfEPMGAFq+AwQMlSo4AwI8ohyisSwksReqQH5mUUAcaENtAZoMk0OmCOvUIxEF4D8RFmZZ1lf3+ZOTBcqu+fr8rxIeVWrtSp1PHmBXQehdyRThQkBP1du4A=",
"user_name": "assert_that/Unkey"
}
},
{
"kind": "ParallelDo",
"name": "s23",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_equal"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s22"
},
"serialized_fn": "QlpoOTFBWSZTWUdgzUcABHR/8v//////////////////////+QAAgIAACAAA0AUXndsNobaa0HcwODU0CjJTyYI1GnplPGpqe1JsmkNGnomjT0g009Q8kMmgPUNPUGjTIPSZoT0nqemo8jSFVP00pvST00nian6p+lPUBiADTBDQ0AaNDRkGQBkMmmgMQAANBoANBGmkRPKjR6T1PRAGgaNAANDQAGgAAAAAAGhoAAAgwJphNMTE0ZMATAE0GAmmAAmTAAAjBGJiMAmhiGTRglNIQAhMmQMpHtJptU9Q9Q9TRtQyaNAAANAADQaBpo0aAABiGiEisrgQKFZNIRiLFkKgKaVhUtDU1DyIK0NqKmXFVOROPPCmFMxdqV682xdsV3lQzfajmCZhnTAQQ38kD9ubAh0Pd5NBbkyL6LGaSbzmTqK537x5ERg5cPgWSbGTMxFNTZDLCIHlpCY2azesUDvtjiTgQZke2gQ6DvmEv7TK6SvINYm0v9KlTFAZW7irJwhwZ0hDpK0TTDItGf1bTXDIH8aOHIB3bttsNzZcCMsSNTsao6ibgmczyRbyLI8XrNfF0Oi+mh8eTnR1lTeCppqZNV9pO4Z9c8cWVbuA7vQJsRRhTIXcs+YGR68KKClRQd7GIJYzhUIgRjBUF3Akhi42N8F0QK/CRNTzkIe7TWQVulBWCRAhKqqERERK1VVVXRHRpJA7YM0TbBAkzE1NAHdFhztPYEmtC61AWZn1TQsMAxnSxNLyOfL54OqE9Hw8dFaboakSxJy7kVl8VlyDxAXulWEHBkJAbRSQRgRRiPw13OGKCVYhxH6nvFJVIoagRzBbyDgTV+42p12iV4X6CZ5EOxj1p91TS7wED81JygqOqGpAUtSBLxit1MyecOFFiF483FU60845bZ6Ji2jK42BaheH3r0WAyL4gcUPZn1JPxYrP92nhc6RRw3tCMAfjn3HCTZJNzpinAuauZs90+bJnZUxGzrHqeS5v/itrZOn6fv593VzvzT6NKzB4LNLQK1+s9mux/tevVgaW0NfUxsWX9kXhBJfsVZ5ntxWCVL1n6YyxshYPwomERDx4ZUcHJEUnOG3R5GJorBMzCM9o0hEeWqAUpWgyn9fe5eNcmZ2viuYaovXjGNPOJCWyPBWzvz6LJkrBEtiqEiNCeP+QHIMHgPQvlvXYQ8YDb6tK4HUenbr7zKzDzbYDELto008G6Y7GaYzYxt1Eho9WV1VPxHZqRtgrClISsU+rrG1wh6TMaCRNtz3DGckLAMeMitoyMFJiy5kKcBmtX4qmUH9gEwJBo0q1pDOjvhnS1eCBVCRSTEKKXcxkHRXfrGjExcGWNIVNNDVCioKd7a5W9xW2pqdG4zb5OFgvoYML+9EFsQwMBlUIB2qUoAxxiEFxR1jbeyRlzemENB0U4S3a8G4I25GIMLsuGGE0yMb9LNpobUcfuRW5JhbmSjVaueA0ENVOo9Ksri0wmmdWYIsw6DYZYK2mnLN3EUFxSTaQ09HK4KDMgu1nrnqC53dxwcIvxh06ZBaMoggRr72IL/BpF2zeIlQ4KZa0mMWyXhprZthocMlPmvJrxOaQx9TDnYMPWghAReMYCCJTouQMwFvNbzGIB3XtRjGSgP1SAkeNKiYL1oBprEYmkUuNWGleSqsTqsEouI9xa43SIqmh5bAwYYUa1suqVGm1O4qZO8tGVVtDZ0Sk3M3kzWWkbxiq5q7AjM6b1WVVWN/Xx3Z6abowhChKc+J30lEbRHaz3CbAyjmCfqKLBly6VErmmp4ruILjcmMJxGfM7QOzIG/PdB9wwk41GOEukJqjOE9heML0F+wx+3foJCBywOeiqkV7BMY6LptUoI2tNISTOdbe0BQ0LaSyig1t16PBOnR1Ff35cosy6t9jSWCFI1xgNvA06KsjUCs/63hU79hbbDY41+3DqGHCT4Cwspj1UnJovOKMM6ysIs4YmSLA0E7SNCYDcQkaYSSBh5hpJZlSGpbBoBCOYOjkACIhJLcj8F0/V+R4k5qQzdr9wtvi6W/RjsXtghlWUjIIJgjoX//F3JFOFCQR2DNRwA==",
"user_name": "assert_that/Match"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-17T12:23:04.308086Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-17_05_23_03-14139662453571485059'
location: 'us-central1'
name: 'beamapp-jenkins-0817122250-786804'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-17T12:23:04.308086Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-17_05_23_03-14139662453571485059]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-17_05_23_03-14139662453571485059
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-17_05_23_03-14139662453571485059?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3662.864s
FAILED (SKIP=6, errors=8, failures=2)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 27s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/65ycpex4e6c7m
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2827
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2827/display/redirect>
Changes:
------------------------------------------
[...truncated 20.55 MB...]
"user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn).unbatchable"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s2"
},
"serialized_fn": "QlpoOTFBWSZTWXEEg5EAAXl/wP//////+RAAFfuUwr/n//JgwAQAQAG8lYyEQm1ECY9U2mjSbQRtAamAGjQJgRtCGRkyYNJpPUxAJ6U2o9RoaAAAAAAAAAYgc0xGRk0yaAZDRkMmQAAAyNMjQMIZA01NJkjFMPVDIAAABoANAA0BkNDTanMZZThwgtNVzIRUg6hhQhvtQIPUyEADhKGctF4pVBBJJt27tq573F9mP+KNEAkEEgjAYwElCUQEoAxTlpDSrW7whCfh4o4HOYhSgVxZ1kFlTGhtXbeHzr0Gl9Wmwzx90R23GsfabX+YTZbA3LzGbHobev8SvN7OIRloaekZKnApLp3wPvwVAWIZAizK8JG0RPT5AcX2iI8txP0LCU/vesCkQkSXSClK1u7XVPhRYASAhkSMyXKMInQU6ABNNWKC8gCdDQVwImx1V+i2TNQYkghpCRg20BQgNopoE01ooUcTwJwQbTEqICYSeqzEo+xQb5bI+G0OFyWmyKwu3fzlUEs/LYFMNSAmkYwl1oVMMAoJlTQi2ANVGpGmMcGUAWTAZiOvBWJWCagkGrixlFjeZAkLyaBFSpLo379UUGlHTsP9Oxiory6NakKr3OcsskUTGMlaUBSasINbOWqClaKu1ubWfXYG2JidisEQfEcViRZLdOFIKwUGAkcqEtMNAEaVU8ChsB8QhFKPyrYc9iiOQycT6nAT1T3L12TbIWrt79/v8XckU4UJBxBIORA=",
"user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)"
}
},
{
"kind": "ParallelDo",
"name": "s4",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_BatchFn",
"type": "STRING",
"value": "apache_beam.io.gcp.experimental.spannerio._BatchFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s3"
},
"serialized_fn": "QlpoOTFBWSZTWdfYJHEAAWF/wP//////4RAAFfuUwr/n//JgwAQAQAG8ju4mIISekyTZNRtI9AQ2o9Iwjym0DRGEep6QNpNGgGkTIxU/RqPSj01MmEAAZGEaGjTTIAANBhqRNpqA00AeoaAAAAAAAAAGgGmiTJJ6Ib0pk00AAAAAAAAMjQabU5DTFeedlXLndUEZa0Y7rkQD1MxCJvlDQXC6Uqggkm1a+vG37229lh8Ur4AkgkEX6qCShKICUAxtLIaTpuP32FwaobEIMJEBYm5LQfBUmHXX8lfns+Op61LGw3Djfy/0Hu1fgNghczxacPGvFxfXKIwdSHtSlRiUhhQsCzyiQJcBNwHSAqoBRIygEwo1VbEwi2heFnd23hFAnNVz+ckfzEmiBwEzLngfc2UqSqCRwE03bw8AEXRUOCJraD8mBlGJRDK6DMIGVCAMiYS0BHHpFClZPAkACpWGYBIGnMGj6Dj0Gyj3U5YytfMLAbJr1g7CuQcXiQJBFFlrD0i9wwEhclEkAJTMXSqMwKjgyPCqJsSywpqKlJIuazKUaWBmCRupnkRq09C9elYpJQp/qFVkZ5fBsGNWD3vaaaSRVWs4gFKmGJ3OoKIAYqSZ0I06UU5wqjIS60QYHsOyi2AoFuBkjRAnRnRoKCLUSAlRTOQYWw9ghEr9ewFvhMR2nJRPmWA6aTL+frfEgXW+ff38XckU4UJDX2CRxA==",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn)"
}
},
{
"kind": "Flatten",
"name": "s5",
"properties": {
"display_data": [],
"inputs": [
{
"@type": "OutputReference",
"output_name": "unbatchable",
"step_name": "s3"
},
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s4"
}
],
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable.out"
}
],
"user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable"
}
},
{
"kind": "ParallelDo",
"name": "s6",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_WriteToSpannerDoFn",
"type": "STRING",
"value": "apache_beam.io.gcp.experimental.spannerio._WriteToSpannerDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/Writing to spanner.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s5"
},
"serialized_fn": "QlpoOTFBWSZTWVdTwDwAAs9/wH/////////////+wr/3/+JhwEAC9nXNEDdjhpE0ymQ1MR6QGmjamgAAaAAAA9Qeo0bUaNANAGnpBTQSaRtTYCjCYhiNDQMI0xAGQaGRpkaYmhoMCGjIGmiSTyEABoAAAAAAAAAAAAaA9QBpoJJBNEyAmJlPRDag0bUAAMQAaAAAAAANMgKYKpJuUy5QHXZ3NLOWYYagkZUxgYXaEblaPlXjx21xzjGMQrQCQAbBTbIUMTI/FUHuKglCQCUMMMPzJhkr7QhzTD5c3o856LGCEggggkgkkoSSSShIBjqAN7pcLQ7epjlQ1/JxO14PL55BePunYMBeDEnqKeMEE5yZg9kRPLZUetBuR3JVAhKEhKjzVRi1jLIcFYTwVRAXj19HfTQSivCn42UtHSGTFkztTH3eePLrhXD4carZlkKLu+93aG5np2HnvC7X/teatP4OdG3zJdd8u9F9Qfao8NF9VY9e3Dd1dgFp5a6dNQUhR2E+/ZjupotFzj1M6oS15QVDR1YAFqkIonAsqVTDJGMuGBENgM4SNJhYxYcTVH22YQsdrYjKwD1IYBTmUSZSjk520Oyl5v2tNiQ9SmrW4MQKzDYlryyShtkFCVZGB0TEsGXtDhQYAYXtZdtKfjONHCwBHOlBETh3Pyb1oZdTEhrYkhEVQCpK6wMWoYJmuuYHUpye0nlwePUCI7RGGYL+AN/lmfQZV2ynkZKlUW8ITMfHPupKiVYt10WmRBgyF4I6EE5WLZrGxdAhcdWflnOoLymQ79Scs7MRjCFnNvQwjmHO/Ep2jGTmcAQYxQTkyr2mQ1MFUp5/IxGZmwkihFYBq5IcmgA4neYCCgohWGcmZGcaxZxWa2ZJNjg8utAt2FfmwE5HNqZVUJrtxC1gcGvwVt0xfpnZ8Uk42BKlR2KRJanq/lVnjRS3OZmggn4iM1TGMEV9g4TKg7LohnaKMA3kDZRIMgpXKyySCCBUVDnIQihgABCEA2RpizVyMUjZtF4s/cj1fxzykRwQnbFM5QeSysRbVI8psbZUjy80mpull5OyiMRaD2sXCvBTimeWEygaI01exVNRVM9DU6UZTZLVZWBDRfUqTDXmY19X96lWXQW7xXyZxhGkpjGJaOevNWkFWkMCsqSIKuHFpFVMBBBBdVYt9/f4u5IpwoSCup4B4A==",
"user_name": "WriteToSpanner/Writing to spanner"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-17T06:11:27.250439Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-16_23_11_25-13995232395380010163'
location: 'us-central1'
name: 'beamapp-jenkins-0817061117-910965'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-17T06:11:27.250439Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-16_23_11_25-13995232395380010163]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-16_23_11_25-13995232395380010163
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-16_23_11_25-13995232395380010163?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3188.798s
FAILED (SKIP=6, errors=8, failures=2)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 55m 25s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/2564mghv22mpa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2826
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2826/display/redirect>
Changes:
------------------------------------------
[...truncated 20.53 MB...]
"parallel_input": {
"@type": "OutputReference",
"output_name": "SINGLE_PARTITION",
"step_name": "s23"
},
"serialized_fn": "QlpoOTFBWSZTWcl+VMEABeJ/+///////////////////////////////wABAEAgAIOAGV8r063OHCgrIOE0q7iJoUyano00mo9GE9UeptTGoekxBsSep6TTNRoNDIMQPUyaGgANA3qmjE00A00eo0eowmCaDRp4k9RoDU0CBGATSGQEZGgYgA0NAAAAAAAAAANADQAAAAAA0AAQNDRoBhAaDQMCAA0BpkBoDAIDJpoAABpgmmmCAyaMg0YQAGQwhpkET0QJoVPKGmj1GQAaBkNAABoAANAAAAANMQ9IA0A0AAAAAADIEDQ0aAYQGg0DAgANAaZAaAwCAyaaAAAaYJppggMmjINGEABkMIaZAxIBBCnoxNJkGU0wJpoZlNANADQAAAAABppoAAAAAAANAAaAAzhahtmE7UD09PCVApKI1pD7MlM5LWVC5jxlTROU5QRKp1TU+euMEJNj5nKdpZX7KYb1rrLBgF3Ma4SMtEkeAiQd0iT5fjvvaS1LdSAHNBHEkiyAIzlF7kMTwHIEIPYgcmSgs4B6CwgxjILBSLJKwsOIMdgi47wgfOBBDI/VUksfN/3JIxau0XDuVc3PjOEMmdBeqO4qqWEeRITkSIDC5wDnByEo2ohEhMRFKWfQQjFZPn13GAFahqNwaRICBtjrqxPeosKUY98qSrBrRSWrYBkEizMAkbjM11wckFgTZ7OSCciFc5Fcl34hZkYBHwnxujBjjN86aIoKBxBA1WBTCIcQOr14vBu8yxZTr3i7uwUNh1wmf23NReWUa9vq6H5YGCggc7/q/HeftfGehl9VoaIL9GBHmkIbJiNjR5cQlJBh/UGnsXTlm0+dtV397BbAUQpqQzIKJsHosRgqcICraqq093f0du/F5YsItJO0JD0M9HaMQWzcaFwnLhn4slqTTTSlAg3Ke1fYsprVolBlHDjLQbbdYMwxhhLgS6mM2nKmW/xTIlm0GgdhtaW25anhHTBaSzE5RgrzGB+hxmyV9SYh7xTwipYsnh5+hbCJrJ8459re3+iV8UTZMvhilYi/m4TtuTsOOGMMDpU8B0mAjD0dE8WSBqmqJoE4CYDC/Cc1Eq4oceLEoaVcTLolQwbdf0YVw6rKa3UrfHd7fZxpPprW3duir3Vz3MBrIjz0FmdOvlukiUccslGPv568yo1tuoMGEWzelAJvyNKk+xI0a2tVOIMzBDIQAqRLaF6lYDE8VxPggxFQ2+2FSe9TCrZha9hxr2keV5+b3ztt0glbXZUGbSUftoO6QB+l3k5LJoiQMu+ZwvuFyBS4SHXHmgjIgiqQuVA6liORIFEQkNO7AYpXbz1m6bCM66BddJlVTHXkGOm97LzCz8YFVCQMnIkKQ5IGEZD5Jfkq93vJuCv3fmzvK3cr/WyMBtIleaXn5aBNdjYXatFEG4rZL8KA5CACwnBg7EAGfAgFfF1ei+CEQ+NXaxADh8FQYpbRnhTOsQsfW5416IIcTWChsbtwA1KbCe921Z2QobFO8mpoYLu+bScEqXi5W7QkCkUKKURQTfLAQRWBGDX22opTZyDq2ydAOsoNrchibdCFhosassk50RftZo5qBRkQkGBwoEMHjDGYe0xJ1AZUZKLVmvKxXcZexGLC2Ih7C5SbHS1kQiIgwMVJYFcPExT8IPqhRvWE1cOJ1mxMQgAqLdVEtQgAZqdPnU0yihO5VQfg8/Zb3i1ndHVHFtp648Tmg23srip2AFw2CI30ITs2A04QCSDh4TPqFVU3TFhy7WI9Z2UmAnRobiEtJEL+pYKGNmEMqmIOJ79aEIrrAEGnbm+YGvjBGFTqYad5i80KKqejNDB1iFRhTtwpZBigbtitHQmlkRG1kJEEuEjO+94iGfHJZzyZNkWZUKOiNCQE0FHb2EWZ9RkjYhBVV1TqALQZkQg3idy8JJOCrEFRBwrIgygZuQYMVp2sXWi+EgO6HL5ARGIABsnUPtvCL31HUuDJSiwD8GDNoK3XskGk5FtPPMtpqCBfRsMUBHESBcG/mxEZjHHISEgMAdElNBXgroCEy25yop3YyKUVBsZVo8KSwMV+0M7QT2MO6oMCKRZmZmyExiOWkZxBq1oT6+OM0E6fQLkw9pigu5sWuhdGujabZYTgUcVKSFNlIyZcbW7dMkoDOaEhClmULFoiQREkRElata0RERESELOkiSZuJ7QAAAJkESWW1Oic4zOzGb5CoEgZoHKcRrNTnKpmgt6AkO+0tNqVHW1hiZDXDX5Fc4qJOeiQ6KbUBC5MDCp6ayDtuL2VIjWwWvCNUNnlW23spKB7iBHuqWTCG/VthOBdaY26cOxRA4PAcTRETjz6jMJnIMarG9VhrkkNRXWwSZmsnmUhGyQrwRiC4MpoJCpBgJi9B2wi2XgeXVmYjhCF27YlI78FZefVU24p9uknLFVKyDNGOAGgO426A6aZFBIG2zi3b880SvADVnq01brxrGlraigMWg7AAkMBZhaLRc0dVA4UrubjxjLsOmQSKRuB80XLfrE3ElPCJZA76K8jEQfhKvJa4DtmAIiRr/R6chcBL7PbXZSk+1Ll6jN++d+ZMqXn/qY0cuf8V8IQCEAFi7goLgISBIcGMxzZ7ageIk7SuqbFjP1+7FItzMsn2QqQ6wMwoABRK/gIlK49N/W0f+/4u5IpwoSGS/KmC",
"user_name": "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/TriggerLoadJobsWithoutTempTables"
}
},
{
"kind": "CollectionToSingleton",
"name": "SideInput-s40",
"properties": {
"output_info": [
{
"encoding": {
"@type": "kind:stream",
"component_encodings": [
{
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
],
"is_stream_like": {
"value": true
}
},
"output_name": "out",
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0).output"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s39"
},
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0)",
"windowing_strategy": "%0A%8B%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C6%10%0A%25ref_Environment_default_environment_1%12%9C%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3C%0A%3Agcr.io/cloud-dataflow/v1beta3/python3%3Abeam-master-20200630%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%13beam%3Acoder%3Abytes%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.5_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1">
}
},
{
"kind": "ParallelDo",
"name": "s41",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "WaitForBQJobs",
"type": "STRING",
"value": "apache_beam.io.gcp.bigquery_file_loads.WaitForBQJobs"
}
],
"non_parallel_inputs": {
"python_side_input0-write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "SideInput-s40"
}
},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s7"
},
"serialized_fn": "QlpoOTFBWSZTWaFnJDgAAxV/4///////////////wr/v/6Li0AAEAEAQCAAA0AM3N6S9nkZNwamkajKaZDQGj1Bpp6g0PUAANAaDTRkGnpBoehMjIyGQYgGkUNlHqGnop6NE2o0ABoAAAADQAAAAAA0AAim2pPQqNNANAA09QAAAGgAAaAAAAAAGgAifqlE9TJoBpoAADRoADCaAAGgwIAyMmAgAABJITJMSek9KPKGTBBpp6gADQAAAAAAAANNNNGgFQGThLK1zJcSCwk6Q1mP1ONtMRW46yBF1mAITjEAYHE85VACgA+VrmUaPd5AS2S1LYGGQLY8O/tZs0atVqnjSlbKRsIIICACAApVAFrUgIiY969jYrlj6LC3ydSBtbvDE5mXva06AhX4vEljD1MCHscA5iMCJBA4mofJLpD7MGSyHyi8Wa2t0HX2my6XVwotWmeNTAe9NFtW41z7udGlSUB+ocbGDKWUQHVgDtMZ2jDQLJQykxMUEIWeg4KPDg0Y/ZAZmw4Td5vtoJV7fvb2qAoky7ippxU3xgBcsHpMBGRIDAylwq2VrmI5EHzGB1DpoyHOyH7f2QIYSAw94H0KHhny3pnMViCNsVtGeJSYdvyHN4dm4osnpc6ys6mheTR04bZAWYtnGicqDq2JTZflPmMv5Hc6akO6FGc2DUw665wYCmFliAcAwJ8diH2sR5SmLImIdBSKIniBNKAiefcTqGBToIZhQqCOOgIQgQmwCCUIbQjr8yZ9brlESu7bjpmE0WYcixhEDBSUzRoFVTVYMFyvLRaixeuJ4SaXuxs+sQVSZl5a0BkkR26yKA6qbNkgPgPQGDBnRZAxGMYJPGEQS23ZLwnHUTSW6MM3rqJRPIAQQoYMx/SNuXEEGhOPgFCENAnFQCoikiJU5+VMK00ZhWIjizg+aILUMzKHY6bxmUiTFpEiDMmbk2xmDAX98i6ktW0k6nKIFltGqmflAVMqVJlWgLuasRlfcX5k9FTY5Vm/jRjsIMpaTm0ZBmb7WhFhhyakWsO+XLjxEa0ACjAEQAQkWtYAAAEMAMYjkQzNpmyEUVxEUUlB4q2aWU8/ISwU/WNN4kMmdwA9i4GG0+ZO9GNBscZRlRdxKFpXkZGDHtlBhT3KYGMwFu8DFU2GzoEXiYmYaFFeTJWx5POp2mnhahpBJYYJC4wYMJ/l9QlEN7YkKD0qguqoEyTp4co4WJEdxBB4RgqE2xBIox7oOb0gHER3Sp7fzJ+vupiVcn+tqQMatUq1sa3n/ku0/XP9/i7kinChIULOSHAA=",
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/WaitForDestinationLoadJobs"
}
},
{
"kind": "Flatten",
"name": "s42",
"properties": {
"display_data": [],
"inputs": [
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s39"
},
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s25"
}
],
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/BigQueryBatchFileLoads/Flatten.out"
}
],
"user_name": "write/BigQueryBatchFileLoads/Flatten"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-17T00:19:48.405131Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-16_17_19_47-13023423307180331343'
location: 'us-central1'
name: 'beamapp-jenkins-0817001937-610473'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-17T00:19:48.405131Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-16_17_19_47-13023423307180331343]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-16_17_19_47-13023423307180331343
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-16_17_19_47-13023423307180331343?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3219.252s
FAILED (SKIP=6, errors=8, failures=2)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 56m 5s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/qerv6rej3whc2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2825
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2825/display/redirect>
Changes:
------------------------------------------
[...truncated 21.49 MB...]
"parallel_input": {
"@type": "OutputReference",
"output_name": "SINGLE_PARTITION",
"step_name": "s23"
},
"serialized_fn": "QlpoOTFBWSZTWayQpmkABbr/+//////////////////////////////wAABAEAgAIOAGPweraHXcaDoBxAORE0CqfiNTaU8ap5Mo8oeU9I9IxPUepmiA9QAD1DagGgNA9QADT1NGj1DT9UNpNGT1ANG1A0ZHiQCio9IGmgaHqZDT01AANAGhkDCAGgABoBkAwgMgAyNNBoAA0YQA0AgDTRoGTTI00GQAyGjAgBpkNBk0DQNBkGmENBkwRoNMIxAMjE0wTQaDJoCJmkQ01NU9I9IPUBo0AAABoANDQ0DQAAABoAHpAAAABoAADTQAgDTRoGTTI00GQAyGjAgBpkNBk0DQNBkGmENBkwRoNMIxAMjE0wTQaDJoBiQCAQyCT0npMk8in6KfqnqPUHqA0AAA0AANANNA09QGgMjQADQGgaBoADR61dvVLO2a9vm24PfLRseIzy51eri3RsyELdMK9sX6o3Rpr1xjBCTbPU63c6WezTmtsssGQv2tcCN5EEd2iQeygT33ePwzWpdmRPbBHUkgyJA4VF7kNTy5EhB7ED0agIsA29EOBLl5PKKfERFbi0ku8vGbBgM2fLDobNWP1/DxI1clouPdK7uvpOEMZ0GFR+JVUtI72QnIAQGlzi5wc4louBECaAxip1gSHxKVKw5ZmfFCMQmkSGRo2Xh2CqbgGCc/lvfSusFIpLkYBkEizMAkbmZr3BySyTcSAzIwbCObNHWK+00CbyVpTyp7c6NY5MSUhIxMqSMri3Vbvcbn2aUVUIcwPT77y4TxpkK33cF7m/C1Y0EpSlOJ9MamwEIQV4S0cCR0IIPqkIXMR06PLiEpIMP9yi7ptpc0W3vdP5ZwX2EOapugiGEErKGIdsUo2AkuumiZmEUMvZ6kbRRIruhrX+4dWrCpmDD2i9W7ayUgHDLjstn1qoBiLFSsusJzktgKzohlaiaorTxTrnUkhbt3c6eZcHL411fPHzE06WLjeOltf6jddurBrdo3nohQ3QioeXmol6e959dOhT7FmMvf7/1soeSDE6LkH9m1oJEBYBG0ar3TaC2Kw4AsoFgGTj38LyUOXRjvYsYSdCDJQ8amQ5iTKI8yLba/KQU93So/Zkt2HERqQGbvVI6LrWDcoq5+MB7fHo+3URgwb74tYEnCtiyxAGnruGfOBRj6rTIbGCUQgBpxKM7WXIqErqrmEyInlWVshkqnGRyohTlQqtUiZvNvGqxzp1MUU6WDyRM1H+sh24Dt7+k4rGiJA2ZzOGdwsuiUvbR7g+YCMyCK5C+sH2bEdyQKIhIds7IxSwzPXW5/ltQ9jgBhNKuresxMepq0d9vjNHeAsrJA05S7ufDLuQZToODwqhRCLC/Efb5/6d3fsuaLl5UwKtP5JJZe2jzcOsS7GBNrwiHIQAgCcEQBABeAQCxSvY74IRD41eeiAHDwKhucWXWaCoeiha+xzxtRBDibAUOrheAalNhOynFoT+oncNGhldydGcEqXly5SQJwQmowExJ8sSCKgIwbM3XFKc0hqfY7HrB1tQ698NTfhELTRbFXYIDRazP30CjUQkGB0oEMHjTGYUxKNAaJKDVmvXnv2F7EatLaiHslbSbHnVkQiIgwc1LvfQ0KnLvkE6jDBCADyIoVbAbucs7AAVLeZk2SKU95Mw4KORocggnICQEc7PA+R0A25eSlWAXDjQHSCEq+MfACASQqbMb4Dg3+PtRX0uUczTeQMsXVaBp16B4MIhZ8Z5xPTG17DiG1lx8oQpdy4EHlB4PQZ77o2dXbvx5+/aJtEZ4Ec+vO+YMUDhYrh8Y0siI2shIAm/c0BQ1aHvEwz55M54Mmt1vm6A5ogSQUfNVkWWVcSE0RBVV3VzrALRZkQg3tPTPCSTkq4KpF4rIgygZuQYMVuqtePajQEgP3DyGIRGsABspvtwEXvqPQcGSlFgH5Zb9BW7DEGk5Ft09ttOAgZ0bDFAR1EgXDzJsRG1jskJCQGQdEjBDkHEgr6NXtcxCQsU/GTE51elRGdSd4dA2P7SHx3oge3fuinz3LE0TI0RgoV8uHQHRrqdYZehI9bs1Vc8XJqNhJRMnyIU0pIS4Aqi2Rbh0LUiTzEs0DoKABgVVVAAAAeAIACZ76ZYCHfqykUkkkr63Otse99uNIQo5zrBQJAxQOpxHT4eJW7XOiu0AmOz0quwVHxFgYmQ5R1NFc4qJPGgQ5RZpdAMLqAaVTdZB3mxoza5kcsV1QjXDr7Lrrc+yDx9xDwnc0KiMex0vF7AvyW1YMMM2IYZBWjJV34QMX4uJqs7VDqJIcNdbBJmayW6kI2SFeUYguDKaCQqTATF8HQWjxJaoyGQiLrq0pHrhV3vqqaHq6ZsKT/hKXpBPbozA5mrquAuOvHPkKqmHAPB4eh+zAZgB4EnbI3XnxnO5N0hq7DsQEhiWYWDoscUr7dvJr1jZWZQ3OCRSNojUi6d/E/tFCrPFBm5RIIgwEYTsOCiqQAKI3NhS8zz4YMVdesxaVKyi/jGx/z+qdSrwHz8R/0QwSCEAMsVGyMHfAQvBIhAhhv87LRJTU3WFkHp1KuQrGY/agYnzvdagAyIH/USR3vceHHf/9/8XckU4UJCskKZpA",
"user_name": "write/BigQueryBatchFileLoads/TriggerLoadJobsWithoutTempTables/TriggerLoadJobsWithoutTempTables"
}
},
{
"kind": "CollectionToSingleton",
"name": "SideInput-s40",
"properties": {
"output_info": [
{
"encoding": {
"@type": "kind:stream",
"component_encodings": [
{
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
}
],
"is_stream_like": {
"value": true
}
},
"output_name": "out",
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0).output"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s39"
},
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/_UnpickledSideInput(TriggerLoadJobsWithoutTempTables.out.0)",
"windowing_strategy": "%0A%8B%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C6%10%0A%25ref_Environment_default_environment_1%12%9C%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3C%0A%3Agcr.io/cloud-dataflow/v1beta3/python3%3Abeam-master-20200630%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%13beam%3Acoder%3Abytes%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.5_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1">
}
},
{
"kind": "ParallelDo",
"name": "s41",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "WaitForBQJobs",
"type": "STRING",
"value": "apache_beam.io.gcp.bigquery_file_loads.WaitForBQJobs"
}
],
"non_parallel_inputs": {
"python_side_input0-write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "SideInput-s40"
}
},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s7"
},
"serialized_fn": "QlpoOTFBWSZTWYwoIRoAAxV/4///////////////wr/v/6Li0AAEAEAQCAAA0AM3MPKOR6N3DU0TSaaRoAyPSaNNANDRoA0BoaHqGgABppibSaDTT1AZANIoehPUTzU00yamRoAA0AA0AAAGgAAAAAACDT/1U1PIBNGARiMTCZBpgmhphMAAJkwjE00wCDAEaET9UppHqaNA00NADTQMQGg0AAaGmQNGI0aGQMQAAAlEaEJk0mSekME2p6mjJo0DQNAAAAyAAANAGg00AmEycLsqVMlRWELnXEbLgpcbjIoG5CiBF1GAIZpiAMDj0JKgBQAfK19dCh3eQHU0WpaNVgtr4TWnewpGWZzDDLalUgIIICACAAiICkBST0FPb95w5V5RfRXWmFF0I0dmRwcvTJluwNq5D9DBh6GBCkcA5iMCJJA4aTBRdoDZGAOqlBjRYEH2eJCq5O71R0u5JAJdQIQYnBWxxdteiZU+agQljjHnPtN+kVlaKpEMs3Q00Vyxlp6g80pfQAcFL45HFK7oyWXmxQUZ2GaPGXUS7jmen5pHDWLcL29MAH5NxIhJxpIiDIv3BKuVyCt9nxM11DoRkOdffnaTDWUAwOCHyKHhpyzz5qViBGoSpDTESSjuGN0+Rb3tFuaw51us7Prun2ldDOQC42Lc0YznIOqcu7vWntSYU2ZVtUvHbpUVR10D3l4cGA9gwwQFiDAoJ4b4TSiirJglF2HjKCDyYvgkJyfEvrPfsuer8kdoIAzMNDMECTNmkdllwfW61REruVRwVEWKqOQtqIMZlgsQjQJTYptiharyUJ4qXbSPCSyuY3qrECmS16ClYYaJZ2PYsgMpmzZIEADzBggzwtAYjGMFztCKJTb0mWKY6SjLt0YZqHlnylrALEKFiZBpG3LhgGhuQAEiGJ5OJhCIRREIlLn3oCTrGAltCOJMD4RBNaqqjdrsPFVJSVJ0JDKqKujUKoaRhcBC4iJirJHWLwxbqQ18H3gKVSwklStALmemGqYTjCgj0KVxynP1PxtHqkdVy+DUc6gbpRQJLg1uEAwCdJgu7LEIixRQAAAAAAACgAIgAbsszRgzNGZmme99JenAvCvQy8FjXQ68dssMqZyETImcAPUshWs2VM9DGZccVIyowcOjVU1iGw2uPUUFmVqwxjKBVdBSmGArmIvEUgorUV5EkqHk0yTLCZp6ZgS6EEspoIMMaf9Q0kLzZdSJb8e6qgTJPHiPnCg7IcWISTGDkKKkEFunYFXbkA63a9v11PeZ8fP1908v+s2wY1SnEqYLyP+K2H6b2f4u5IpwoSEYUEI0",
"user_name": "write/BigQueryBatchFileLoads/WaitForDestinationLoadJobs/WaitForDestinationLoadJobs"
}
},
{
"kind": "Flatten",
"name": "s42",
"properties": {
"display_data": [],
"inputs": [
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s25"
},
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s39"
}
],
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/BigQueryBatchFileLoads/Flatten.out"
}
],
"user_name": "write/BigQueryBatchFileLoads/Flatten"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-16T18:11:05.455978Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-16_11_11_04-9649642234018829906'
location: 'us-central1'
name: 'beamapp-jenkins-0816181054-289999'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-16T18:11:05.455978Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-16_11_11_04-9649642234018829906]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-16_11_11_04-9649642234018829906
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-16_11_11_04-9649642234018829906?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3300.368s
FAILED (SKIP=6, errors=9, failures=3)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 57m 5s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/nzmlmceqdm3pi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2824
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2824/display/redirect>
Changes:
------------------------------------------
[...truncated 21.24 MB...]
"user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn).unbatchable"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s2"
},
"serialized_fn": "QlpoOTFBWSZTWdrWYAYAAXl/wP//////+RAAFfuUwr/n//JgwAQAQAG8l3M2xQmUGINBoAADRppoMmjQAAAaAANIT1GSbRqNT0mQ00NMmEAAAAYRkGjIARE2p6kaIejQxR6JppgAATJkxMTE9AmmAANNQjJMk2j1RkyA0AA0AAAA0GmQ0PTSc5kkNV71yrXZfBSEMWM9/AxAg9zGQAOIocJYJilQEEkm7dv24L3xeZcV8xUAHEEEgjEUoElCUQEgCpJlGAKlXtMFA8PA+QaIQYRCAJlHdQAjAGN6mveWVRVrKadCanXWhDYZM4rHL4RqksY4pg8H5Zdyffd+TpgQzUi0s5YjdoQbZDQG9itBUhjCLoraEcwQNT6AhLbZDsqEn7FpJfzctUiiQJfMmhvIdxwvwoIAgDJLNX0cISaYrHFYAIl4AMtAbml4sgYm+2l6KgjWYqRB+UHOCVuCA8lYlcGx55PmwqAEgILlhQwCMReqkhoyhyaDZh7rcwfTZZhTCqubIVEHN8LeRAlBhHIoZC68CPhYJUbVcIFtAcYzA5QshSMC0aFKEdewsSKFGJHsXYcUW5pjCPmTQIp05NGed1QFhSHCo4MKlLCFDk6Q+XVUIiQqIvH4iIqGA5vBgFxHscUAczCbIjGYUZSFz4yZVfgEIciGfEon2SBBimCepHOaZKOoYBrKjI8gTzvjDRiwv0rIoPaUVRUkSPrRAS1t/+wTSXEE2CafD/i7kinChIbWswAw",
"user_name": "WriteToSpanner/make batches/Filtering Batchable Mutations/ParDo(_BatchableFilterFn)"
}
},
{
"kind": "ParallelDo",
"name": "s4",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_BatchFn",
"type": "STRING",
"value": "apache_beam.io.gcp.experimental.spannerio._BatchFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s3"
},
"serialized_fn": "QlpoOTFBWSZTWT0oOb0AAWF/wP//////4RAAFfuUwr/n//JgwAQAQAG8jMTEEIKZpP0oZoEMmjxTDUY0ajTTJpk09RkZPSeiNoNEmBJ6maj1JsUGjQAAAA0AAABkBzRo0NMIBpgTTQBkNDEAaMRoYIyADTSap4o0Q3pTJpoAAAAAAAAZGg0acZpivPO5Vyp2qCUa0pbjIgHoZiETeKG8WF0pVBBJNq18+DW/a23qvvRpARJBIIvlUElCUQEgDRxsdwUdeuQJYDl5PxCDCRAWBr5rhrKeltvA/1tPZ/Z23FClqDys/d29iNcgyUUGwyPpnMYT7agjb7UOZlKLMRC+iUEpxRYClgJph1gFdAKLDEAKlCuv0KkWwHhZj73hFAnNSyfEPv+51pwHATM0sZ47alJgaagFrtYVWGCwImqBLxuerzkZM1QuKiJQbIAwxDBGAfXxSWpxWQJgA2MpuAmD0GHj6E6IPiPds7hffZriwHZFesGwbkGLxQCQRRZdYeknsL9IXIihACJmLRUZYVGDkeFUTYdlwpqKlFJM6zEo6MDMEldTOIlVp5/9/RDilC8p/byq4OeXwdgSrQe97qTNNJmZoAFKmEJ2b+NMgMqFUpTdoZSgNsTE64tglEDlsPkJbpwahUBSmtXSUjMlQCmlbnSY/dONYMFqObdEsVmSK6CaUaHAQo2r+D8Y0CG7+/98nAXckU4UJA9KDm9A",
"user_name": "WriteToSpanner/make batches/ParDo(_BatchFn)"
}
},
{
"kind": "Flatten",
"name": "s5",
"properties": {
"display_data": [],
"inputs": [
{
"@type": "OutputReference",
"output_name": "unbatchable",
"step_name": "s3"
},
{
"@type": "OutputReference",
"output_name": "None",
"step_name": "s4"
}
],
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable.out"
}
],
"user_name": "WriteToSpanner/make batches/Merging batchable and unbatchable"
}
},
{
"kind": "ParallelDo",
"name": "s6",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_WriteToSpannerDoFn",
"type": "STRING",
"value": "apache_beam.io.gcp.experimental.spannerio._WriteToSpannerDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "WriteToSpanner/Writing to spanner.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s5"
},
"serialized_fn": "QlpoOTFBWSZTWTxUMekAAs9/wH/////////////+wr/3/+JhwEAC7Os5XAkhE1GTU9SNPKe0SaZHpPU0aNAA0AyA00MgNHpqYQDQ0AABomjSaYk0p+qep6nqbUGjQNAAGjTQAAAAAAAHqeSeaoNMqFBoAAAAAAAAAAB6mgAAGg2p+qAAEkQmkDSnkxPUaR6I0NAGgAAAAAAAAABoBTFmExFYViCZqHNw5CW20DCKyUottHUXVPeMuOXSLQxCEALIgwA2i0chB4mm+kgQQSxIBLFzne8h0hejg/Ky0CfUmCCCNMBiQQQQSREkSWJJJJYlFkWA2OnhydnW6FNOLJr+x3s3zTWE+qcrrMQY1BSUBgindMw3ZKNDChFHQ2zCZqJ95hRkNWSUhi2Dyp3wnhQBIRjAerBrZpQOQSiIbzSkqmhYAypetRivMOJBIevaul25CvdzqHU6zOGbq0EcZp9Hse4H1q1TiVRP6f4ttyvL1JfNSyIFKVIhycAAJMzjLTDgcp2QXT7Tt4rjcxhHEEWRcLiga4nAAVxAcQgALhPkYMiM3Dm0iZ72O/bqUoZcCeIU49cYhxLn9u+4HqyALkQbfA0H33+fu0/GyhivySVXQEgEjAkI5o5FipggSAeILoqmvTwRNGUCgUgUu2O0zs+v03KkCAExi1kRbZmfk3PrbLurOKcWxs3gPvvJmvNGuhsLsD2k6g075EgQUSQ/0GGYMvMDLJl+/UoEZKwp3awoY9XvvpKxOyXbaKmRFg2hlBLSinVV41DOeJG+72cRzrBhVCH/VDrPzUZ4Ru48Mcwdh3+06WlKbs4BFjHFOmVzVMhrUVbVNPiYkUGYTLCLIDXCY6aID0wHrIp1ILIzpmRkNQu47tnOmmz4wMDRL1SxUVlJLV22VuwmwX0LUBw/OmtFMYrVB0DX1px8uWSHZm9jURFXCqIlJ0axRbQqHJ4fe2DG50IaDbp1PAi9hvtYySXDqoTBYsFVUpa2NjWta8zABleKs0MBKSRkaUBbDSILFoUzmSrjS2bQ6jAnlVl5WiBaq0U8msYLZAwQuwKWUxibRg1V8uRVIqIFSZROCNROqSwkqEDjjc9dGukqgQNySKIwTUxix6lsr8BdvCejtRgFSrWZJdZfOwg/DEDs5Plmt4U/2UzA/24py5revp/8XckU4UJA8VDHpA==",
"user_name": "WriteToSpanner/Writing to spanner"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-16T12:18:07.178113Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-16_05_18_05-5164784433465604065'
location: 'us-central1'
name: 'beamapp-jenkins-0816121755-083271'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-16T12:18:07.178113Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-16_05_18_05-5164784433465604065]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-16_05_18_05-5164784433465604065
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-16_05_18_05-5164784433465604065?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3210.706s
FAILED (SKIP=6, errors=9, failures=3)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 55m 36s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/6e4v7wxwpxzhm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2823
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2823/display/redirect?page=changes>
Changes:
[Boyuan Zhang] Remove redundant setMaxNumRecords and consumerFactoryFn.
[noreply] Merge pull request #12575: [BEAM-10707] Adding Python docs precommit as
------------------------------------------
[...truncated 20.37 MB...]
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "str"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "StrUtf8Coder$QlpoOTFBWSZTWUUL7GYAABnfwHgQACEAQAgACgC/QvwCYAAgAEiE1B6gbRA9R+qbUKAAaAABzsBennDtsriTt3V+SBhgf2i+oSUiKLItyiLVj4u5IpwoSCKF9jMA",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_StrUtf8Coder_9"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "To String.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s1"
},
"serialized_fn": "QlpoOTFBWSZTWQqwKxgAA1x/wH///////////////////+ZjwVADl7yuZ0oHkHEU1PUagZGQNMmg2jUNGR6jNJkYgZGBAZlHk1DEDRghieiY0QNRMg0U/Qo9NqagDQAAAA0AAAAAAAAAAABlPyemmiSD1PRGgAAAZAxNNAAAANANMQMgGhoANA1PSKelDTQBoAA9QMmgA0AAAAAAAAABtQAAlCBATU9Jkw0JlT2iNQ2k0eoMmgBvVAAPUAAAABkeoaPUadKA8mPEdR25VZkohhmpD7bL8ELa8YkoukRKUhpSiAEH7795hPSgwgKqB5bmEHW+99vankk8HMyf49zmZlVOTC5wpCiSQ91vI979qw+jBTyEuFfqAkq1rX78KJB8yiiCSSgRDBIQkgEgShQqUxRib0HL1IzaWF0RIVHoavBzzfHVoVDKucRkMywQVBRF/uGeD61Zd315nySVwx6yoISDHlXkQswy7gItrsgCWMYXTHM9iFlrhDi2BEhvpFu2S1f4YRBA+/deYqZ8PthB+AIIXBEkdPYcgjOgQK1lMpowDTKHsrKgiSFhg0Tuvv55Ypm71IG9pKSNB46om7icEYHroJiu0eqW1PuirmlJCIL/LT2z9nDw4GYWCCe3z01dTfEl1VlGlidz5fy6mEYRio7YvFEjPJdlUycVFiCbHhf72HZsQSbasJhL5JRVQ8h1sl8hBDLlKu18A6sF+il2gCJUY4DAdKIEsOzjsD2FyEj9js7wY/1SqjcbmJwJc63OZFZye6EzorLFPNMyokRLpgnx0SxuNzCo092ODlgKppWWkE0EBY576CUpCdZ92ruoQQEIDeUGZDDhXCkR6Q6AOpwhljBKzgOM0KEaJ4sD6QQwO3GdHvxhIPx+/X2OXpz9jrcrb/06cYJuIExwXGEy6jRHCDAkdSj8x8hW2Uu0EudkRU1iDK4N+natvi0v0pbffrQSteussG9RrdhZVUi2sTIolEec1HgTRiqwz0sIkwtsSzbhSRIWiUfvEKLmmsIzBUrlUdB2VTpIK5ahFYFCKoiLwbt8s7u01Gh04wsFcD7VDA14TRjm1xz1qYVxWGbCCO7wRwoiUqYwjGievoaePm5q3Kku0y9X02Z6GKucF8ecpgnOdtpLa3Sqf+AHtCQWYnSkyGTGNRqQ4ZokgK2CA6AIiASFLACJxEUEdDjaaBR2qwSMtpl1PrQhamWUuumJRjJ6qIoh0buCdQrRY3BLkV4GjXJ6SgYnBvWGlHamYFHc+NGbVniJ7kukUF4yuIvyYS2mYZSIVHEwR2zav2umjexEw/EHWTeIcF6qmQqw5Kk8WO1gvBShtrU95MCUmCGNJICiYPmr6fC5rIFmanuazA1VukXo6i3Pt3qcD3brEYsZcbOiSzVVoqIKolR0HyTZ/XZ4/05v9yd9wYW5ABab+47xdJQu8pxDvuoWBR/fwf2XrNf8XckU4UJAKsCsYA==",
"user_name": "To String"
}
},
{
"kind": "ParallelDo",
"name": "s3",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "make_entity"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "To Entity.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s2"
},
"serialized_fn": "QlpoOTFBWSZTWYKm4gcABEB/4H//////////////////////wEAAUAS3l7dd3G67YgRCuIiT0U008poPU9RoGmTCGg0MQHqD1GgNGQPUD1GhoBo9Q9TEDRskbU0DUyBA0EwqfpTaNGUaaNGgAANANNNNAGhkAAGjQ0aDRpoaNEGAAmAAhiYJgAAjACZMEyYABGRiYjAQwAAET0U0jU02oDTEBoAAAANBoAAAAAAAAD1AAAEiUxAQE0aIEemm1MUaNBoAAANAaAaAAAAGgaA0aGUWrm7CIa6KWGVaUzHISKqq8XAigpcK6UjWRSExJSFWwU1wFbxuHdox8K1JLpMP1GhHQ/6qfC++gHOGSxwgMmxhUE2DZVBE2I5rrYSnOpKHGTWieVzZR6+3n+dmZ5xZyTzS39oTAbON1TnWdKJzHoA8AoLkb+nmBTUpCUpSEJARFFFGaiY0URTBnB53HD8vA3CV3mAyEP0fMssPHhEQBsEflVGKCBtuqIiM9SqdTJshoY8L+vukpsrYxxAHsqFu2x8d7DDu5sA3N1Hkvvs6D+BXNrEYXR/wQCbhE3YW7wBFC1LUR0VbRWHJnUhujkqunyCoqtpbpLJlBnROeSksJMudOVl0rXmbHBe0gNE4YH36Qlbnd2dX3vBIVpUcb1C52CwqeB07ZehoKeikCRZkVpVYArIi2qkgaUAJEKYCB+wZVs986a4TDQwkWob5yBxhoRiikgLKWAqhNbvnRia1SDUAGEiPuqJ2Up+2mHTl4N2xWOAfer2EWJyjGLJIi8qEnIWaK42TJ8Jn5xJXnZ5IHdco/tx1qNIxHoczTQR82+ive+ktrWrsTiK0YBFfloAQ8UKtQgt8IgYgxjhCARcMXb5X0CImPZZG0g+aUoSfAVjKWswH+s1QUFojgyGW2yAAedmz4TvSVeMxHninmbTY3+ZUYGazLYlkSvCVK4bWNzAsWISp6M89EICJRjMX2cNNBTCfS4dyXU72pM6/0PZoaMLBUH4USoSSMfOFBG6RItUAnSSr5pW4vBiNu259tUYAFhsyHABYxbZgjLfXl403x9T1T3dVK2sDdI9s9+/fwtBYc5zGB5FSEIIBLSz8GLHWuqo0Sxy30cQELrkLEsWmBRRTxHfqIiUYaQssUoPhgkLPWBT4hUG4mPeizaooLW0yhFnJrYGiYX6MClFbGGA1sIdbtw4OnhXmnlbTdVvRdC9s0a+6gIO9rF1jbwMKXcWm7ZSNoGCjmMlubZ0iLVrStrw26wq1H2vjLNJby38mcawU0X4C6q0NByrJ1xuhsFxoQq7MtXkOzTsmeNO0WNbwmxXzdnHunNv5dFaS1nCee6KzLTYKzAoUziv7ehcwudl0qWCI3ghQFIN9DC8TkSf9NtVJtsOXmMetq3M5IiRIrIByk2HDSeXjmQUtqnwlOLia2Md4RHEWhC02HNCQ8qZiNiFRbNtpaS4U1wX44mT9ZUkhuqZYuoZqWLfuV8T4JUcmw+qZ6B19qqU5qaFnExjFR0dyJD19h4UC1iSRN1QMsg3NjOUq1nNZUZmrEd8HPwlBDdM4HrVpdlxr1zGlLKl08C1wPpS1NV41jGvkQkIwjci5uXjEcGVbhVZBZ03J8CgDkm1vRbQtoMrzG8p78Ko7Eu1+AZITyeGUL9svIOHZFRoMl5IgYXJPusNnghRYZsprWYjHJVbJWYJVNSTKZ765U3Qtlv0uwwtL0SAivnyPBn0+wn3Nru5WzjRsvJfJ4kZDka5pVgyFpniNXJjvoMBosHJvLgsS2yRRLAJp2XoCzDXjeFCDWxZRBJXSTGsHIbcLmEyguW4iHps5Oi/a4LVlZxEneA10KqkzTsNVxa02QwnTOH+wR/yX+LuSKcKEhBU3EDg=",
"user_name": "To Entity"
}
},
{
"kind": "ParallelDo",
"name": "s4",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "_DatastoreWriteFn",
"type": "STRING",
"value": "apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreWriteFn"
},
{
"key": "project",
"namespace": "apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreWriteFn",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "mutation",
"namespace": "apache_beam.io.gcp.datastore.v1new.datastoreio._DatastoreWriteFn",
"type": "STRING",
"value": "Write (upsert)"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_6"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "Write to Datastore/Write Batch to Datastore.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s3"
},
"serialized_fn": "QlpoOTFBWSZTWdh3TowADI//////////////////////////////////////////////4A499ntHuc99O+y30d99l597ob33u++6D6HoaAGfd998332t7uife3PGavFU9QegRGgU9HqaJ6j01PJqPU8U9TYoaeUaPJPRBpp5J6J6g8oabFD0ym0m9U02p6jTaam01PKbUe0p+hMAKe1Mp6Yao8aaGin6m1PTTE1MU8jU8TGqeCZqYp4DFQqYgGhEamp5Nk0EhtpT1H6o8SeT1NQPUZqPUDR6TaTY1T1G0nqN5U/SNNNT9TU0/VPxNU8mpo9NoU/SmjajyJ7VPEeqbUeCmE/VM9SeoDT1PTUZGanojEeo9R6m0TTIxpBUyk2CbUmKYxJp+onpqZppPUbUnpPyBMmU/JN6E0J6JNkT9SbQeiZJk9Gp6R+pNGmmR6mjTCBiYhtR6nqaY9TUG0CaNGjBPUegRiYyTzUMASaeCAipjTAQTQapspNpptJpqZqb1TaTT0jaG1AJieoaepkyaZHqMgDT0GhN6k/UAAEPSYhpp6I9JpjUPSYgzSaPUD0ymj1A0GjT1PahMmjT00g9NGoRRhNITTTUeibUyZMjJkeoAekNGmgZGmhk0aZABk0yDI0AaeoGhoaZGg0xAaNGmg9JkA9EADQAGmQNMTRgRoeiGhoEkiBMgAJo00RoMSnmqPZNU9MKek9R6T1HqPU2p6mnoMhDymT0mnqep6mmnqDyagNNPTU0ek9Q2o0HqHqNkgGm0Q9TTTQ00DQyPSDQ9IM1G1NMQ9T1PSGMs1QfMqNtMsvZQjj4YxDdXKI8B2M8l0SsKGwy6kIUpDVfQTiTDFepJJhhJhCYGQwMkMhmSZto4QB3O84CqUmZW0mkFPmVX5nDOpqqKMzYCMrs/ZTzdBW4VwpsKUhFTLKO7GwNHIJHTaeu6lW7lurq1EzYeJaePsuJg853zossyMHwNa1Iozs15SPqj+vFxyjtzf6mR4FkBtXe7dzWDh4o5Tddfn4ie9ROGbz+5oR8awZs2khZsIqIjlIxzN8SqQuH8HEzitswvHsJKT2mv9R42+AElzaNYwdyz2QgYASTCZjRsk7phECCQEIPsCQABsYO0gpGzzOBhx6hojiCZ1vb3driWZLvOTLV+5jbu0tibhtOtwupvO5FSjmLWPAE5TMeaib6C5NkYRzoicxki6HIQsu5aYSDdtDIFr5FRPeFnCuIFJSw+BTC8GYg83o6OOlszf5RTOXBOilxFJrpC9Gyd0mJPyt4DQsqekXrm1HSyXRiZeO7adkWs9PSs13MWt1UjFybX4P5Z1Ni8qnFV6Lp3XVdXYa+v2NfsK97XVFhZeq+mUE3+qGbnJ2elOtP0FDRUdJS01PUftUouvVXNc/JEdxdXa1csUqUtym7K1Leq0yZUiRK1qdPdXalSqXK7zbK9usWrly7Qhwba124DBYJZ6d4IfF974cmjmjb2sad4UX+PT81r53DPm/t1M000kkVr0nb9/3k5sdkICVko2EmZC02dcBMwghYXyGQkg9EwIpEvf72b7svLX/ew0OJt9l3cNFUY9B7PmsivW15lkj4PdJkhMgDIuEn+qYi9p7K07nkAixLWkqKwTKmvMBvlXkNCqj72rcqmmqFNSWq4xCglKCY8QzzA0FSke25IqgxHM4HIClXpoH5dL7Pdb7wgESTn4kiyMFcuY0R8M9FULAVT6ox3hy+noyFtFSASwqTUzcH/LekvfIRJ+ZP7tc45XhTWpdOW8RVddNoeIBFSPqqOa8S7rz+3e7LvV76yzak8xafbCBx2PyXtOLjm0pPIdxGzbO5MyRNGYFSlTpm+G4TloDDtBO8mKFVdG1Glyk4Dd37DovyE7X6FBsBZLveHrkKL757pprWoGtPOzZUqSoDkYv2UXCRkhqVSSa/6k2emanOH3NtMYNxhuij69IuB900Uy454NvgI9T2tO9qzpTxbJm4jDPtlWXvMfnoBdT63swYVso5nEsBhK/1iMHVAhA6G01UkZLyZqwPZYViulvUp+sZBLz15lamWTOV7rjjE00mPZT+ppGnLhgKKEyECuFAJZHmdcqgjZ2iMGB9aWI/gwjpxmXjLpwMHF7MwAcL/tc9JY0fndHyYb7N6kpJI9W2/mprV+5s5V8qP+lJ7NtbO82m3sL0J/Rv7F/fd4y6Pib6ln7mzz7KYs+lsql505lroH/3YM1C8vTajL5lFlfxZQW3N5j1pr9Sqz0PypZrMl47NiZ6WsqyUq56tsNPl6yvY0+xopFTKrn2Z9JrTqXTz5th2M9bO9Fas6ddLs+qkomNdeV+l26vaVd3BqalQjvdFHTJf800l+kv9f/tVlX2a5Oy17jawbFTs32LlAAWAWUB9HDzleSvEmr+yzmO0IAEIGKfuh6YpjLxucgaQD/2hyzrSDfVv4fT/PHBZZRSCAXVgGlAaoNDMCaaCXmBAbmDOJvu8yIkQnaYfHHHZ57gSfJmj17dO2ulj7PKrYReH8sxflG/E4HEYqQnDAzJme1MDht6lKDKxbaZThl9AkRK4mJTaPTmiJFBJMAcfNz9k6ehpUz8VHv0cGThmTRn0/mkaJ9rJ3Vo+NGTmm0a3p2PI7JBMAXO4T8jy+oNAimoZDC8TSc3sMRVJzBa6r0vCE3o6WejIcHfcldYuIpSHMzmBZFpVjynsfgni47VFk6kwIxptYKk/v3jtS1Dhc1cnmLFeoTOZ6FgwradujZrMowrJKR6eXWGsxi4IBkpTRowMZBiQWNiFG3J1bjwsrZROmQ2iEmoqtBZYfb9JBwXKIhURuDGedQGfLUkOWZDYRH4aXd8mZwGJCTytL6M9WFYkN5wef+qz2k84n4w1doFv4Ut2BZrdByAGPJO7Y887KfoZ+/VuzAGfcb1iqNPr3nI9FDVHVzAcUmahxxTmeJg34gVbEWEFjbCIpQgO+rOt8zxDiwB/1uq9ZZ3+FD8bQ8h4uS0jF1tf4bl/ie4au7lbDjPJ29qCEAHiQFsGozyoKFZgBAxpOo8Uha92b8liSnBC1wnQ9U8i+B4BkDwWtVY87u9bmYFm22uHsXik+dwtlgwhmmMyxn2F/XNOX9sTI8KBYrUNtxqsG0Yr8Z31GNZDLjQY192Ln7eNy27Bcws3yIL68dcb07cpiy3C7XsHsxnP1ODjt6vZuWyzvZPL5vEu2HnnmqY398KDStMyMjq9U9WKbkbFsnIcc6xz7a75+hfS+w7L1XGg6mXSACS+nCAJJm6Q9K4vAgPlZd8uncAHC8uv2Ahm3P85fVxPEdZ1Xp/UOyg7kFUAEKsI7NhVvgDSGrXd/QZZ/DKWcs46dlDrCmA1VarbPrpO1gm/M/Im8jtKFh9cvfVWwauQYw7FwkH6cyBNDH+hDw8g8ArZ/Hs/VkG5W3UE63hhdqsUEOZDM8Wj8o/Zbh/1XWNVYDtbNVoM1eRXFOpno8xq5M/kCZQQGxe3dwur82CsUauCuSeGGNyhhvh5SjsRAN1EJHHBkvElwiigOsDj4w2hgSy0UJ0BcQ/WEYykYLa7vaNvNV2nHYw44lN7m1ZJssvkgRVOii5fPmMfQkPbIVDhT1rHHYAL89Gn4pPT3v1fX7J5v50UutVShRRQCihOckhLHyOt6LYV/80aO16XV6LkXzo46Bz1NJOMy1PLOPrYBFq4XSCEnHDAiBQAtuAQCSEGBTwQCiov05oRfcXTSqHzjSrPJoGZpOAA4qvLdvDTAMO+C0Xe0bfso74ZMAzX5NGgOveJkwzA5TYD9pOezNRi/cbrhVsi1xrd7rNxoww+xcS2tjUSUB5Jk5Xvj6rUaWrLlsfzcNaBzM1H6Prtvo37umEmJWXBxpIM3BUTAF5GrRhkWZFJ/GGeKIloQD/yWP4ZXSce4+HdSVm8h1UVAYLjUbFZxUP9PSoVnT+P2H79fVxM6Y+La5+AWQFje910HUcSNHRkjq1wSQlMkraRkezwAAG3E8/9uj3zrrYT5RNOJAF4zjh1wlUXIQDXBE2VVVVh1h8GUnTqRWJlDAR5wl4LQacYZgeRCw6N75nUbbx+v5f+msxNbgE2DcvA4O17TZ7nInNfXni8Cm/TsU74Uawsx1uGHayUeb9VGP5g051biAp5A81B4m8fk0Nbha3z+OAW7Tsc7hmbAhq+30Nq9s7PYYqMlkUtA4KOSDcsxnKUeMdkYLopdE6PDdy511oM0KAI59MevW9d08MBVGA1k4joO5w4gBhm1dxaqLIp3Zm8NZHkbHjJUQPyzX6olx4QTh6wJCgIx7E4dTwd5MRSs0PK1GAQWMGtQAOR8zwI5ITQsqBiXWQ1qAi6SuoCcV872fDs5r4e7nliHNvnlMgqqomCFrnSiciCCF/kMzmOdIVBGqwzlK7VyGDDk0s89ByYtL30m6bE0l2/MVpk57nGKgLdlOhA6EgsdDOnsvfaL6UNHIrlqmJ2JovB2/UTuYyoBAQArOI8CJEdIDEKqwVtMw3dK9bn3BJWWf8og1Hg4qqg6VVVsQznXOetE9742muXIyfOmfLLbuQRUZM5RhnTn7Wokt9+tyQiqMIpMlXZfFz7hFSBwzObqmA4LIRzNA1jU46cSPdMCFesJFIssnCFnGC+YFB5WaaVmdOt3r4YWmc+1HHHLE1uc+dakhhnzWIIJILuNJFFJdy7lmHYCSgYKA8oxJGeaHmiByyMiQnX6JSdIcNp42uuz13lTuKF5h8STP1Oc5zCfHVconkUdh99nbN0v0zrL544qULsBKxCQkll6UqAYlJvz6qxjt+Kq78NnQWp9hNdKhTQDk+09MyhNzVXNRmprxyzQvWWZrxEKAfBNwYbknQTKmIafFIpoRr1E8v8epKxeHqLVvecbN6et+auOZFTcM9SjeczBWIrNssl5uHl+adXg+LbcnfVOR1l7XlFcr7nrPfwYipFh5sOmn+j7qHSSOpbXFFnoSrlXEe5fe9tLs5WakZeDK+2puDcGDNzf/l1qurj5lqmkFRkkIFZWOfJLKX8oru940FdYC2FCb1GFVnttq+Ve48gjeapKB6OwzXB9LwzdeejZZdJkDiZfdNT2PVKYl4675tZlobXzBqw36gykODFObJpszfPIHBBgLFoGxM4ELLkMUDhrSNNycg6x/kvvjbi1e6Hy/fixS7C3w8qDcho06cDzE8VYfU2i7+wlDklata/UeTGwHJu2Ly9OoB9bTmvdpdq9210CVb1u5H/cOB4bTg6cXytCTm0oOqKZhj/v3jV+Z+00J6EDILcOpDfBgBePIDBWZO14gVAcMl61EWQgpyhEp2c6lu2UQ9B9tgxHCj7OMISMVDA5dACBYwbGsgHPDuvGzHhf6pxxeicuLlHYzWGWpZGA2e71x/7wdE/J0zisxA2XZQMdHn3e83rvCa01plpm+AxKyqu8DtoCFju+euvPKDFtix+lyRlG6mZwRmLLpUPgxBxoV9Jbjm80L3AytyLYB2oSt2Fm1WDBRr34yiokPa9eZflgupwXZDJBOCQ6/qWWsEccEAFUmKtCvD2wsQqwkGakRDqayvQes7xYTnOmt334XY8EPum838fHaq5efu5EpsA+O+DnQZjqBEN+XrbvZh8vEGkuCThBWzksM0mgo9ZdxnbacQui0fFdCtk6vGvMZFbouUoySfJdSVNAurF5q96K9j6LruGQBbg5WGpZYmKzzRSZXtYuVyDgwQCYcVS0cY0D91j06mSW+eMHPtypM7aHhthzUVDQBvjKDQcetfFHSkF8peC1viiXhYtQgLUJ3EsYjuoxs9n3mHXvW9ukhTKpLE/TntMUwthhwvMsPDHqFytxcJJsT4vgLWCm/bWfRI1s3yHLDAoDOiIyDHIUIkGKNBV2LCw573XousPDmk4KvBfuHuQYkGX0/4TDlM7XR4+zkGMhoMnO7hcclD93obYalNAMaceX+4VgUXazTOJirfQ4s8SSQ/pqCR1RhgYVl6b22ixhrwIP0eDWdknRP8ZK1h/BfHFSFdC4R0bGFXUbezG88djBRVW8ULp6HIVHYjpdqX1wbDRu+5FSZxJv3jqfWVsPBD3UUS8EDSeR7+Bn0D+hkPiwWjmj5yFXtSbNB0HgBBuLzbrIxxa7+LTC5Jd1mDCrs31HxLtLJDue93UlrGxeaWEJxm7OAapihcMLfI5Cacmej4bKmL4nQliSWJLIeOPF1XNR6pWiShkOF9VUjfk7CINoQ+u85/30hpqrA30ceXxb0OMC2fc75m8XfkLjgYHEPjSbXmySjKXy8oRdZaLZ5cVb7kcOCGf+cu2B3oYA95D4IkARA+jedRXwCVsj4TwfFwVtv9xC7FNM+lsLQMM2GKdomc/Ss+FRXt/7jEKq09af8R+ROR0MXFYgu3UGecdam1J+7x646MSY3qQ9jIPvmk6eygn5265AgJgH/o4LgJZ5QFwAU9NKmdLA4gxUFCKzIB8MuIPc4D2Tv+5K7GNAqH0409KKe9+vjO0OPCeFGqe2YAKyXH2uLosnnZZxhyKNaroAFu2blVR6Rq0TgqRiVoYVLGdIZgfhzItL3CymQMzP7xGuwrWxnahoQgNOzsx6gylh+CZQBwMl2ft+B6l/HINKo8fmPJwZbb7WGYmd+nf0RLI1NHXwrOZ88Zgkm8ReXApCEaOUQIkstNvMokf0JF2/vJ00SNGdUA1XiJGVkEDkfXTw69AqCWTnhkmec6S62RNT8hopFBX39437fXrG10UqYJhQFQayxbsXKrEkEiKsztalhyss56l5G193Q09W4riaRkbpVEZQPwM9uYGjoTIoiqfxhQlWXGS6hLxELxHInMk0pBp+fFra5X03GgIbLYZ5DuXtkidaTBK/D+G4qiNe4YMhAz5xiOloQfoVHqV0HXcPvOnVJxe8iQxboJtApxHJ2YCE4OIUFpfiFQde9tZTMcXC92tIqYxGlGq+I0QBrXYoDqJ3Jx93SfJs+yJccJ3NyMwkc1U3Rk/zaZeeQnDyctsNI0ffiPGdiYAzAtDbWsfgXkXIut0r+G4Ldw43n7g2aBQxebzBIF7VM45Qzts5TW6pe423DITRhznLkBpGiE/lY7Y31lQ5shPpI7WqDBlmiv3os83/v/SXccmkS88ESSY9Zeo11XM0O6nZwyJZUJXFmsRfp/4u5IpwoSGw7p0YA=",
"user_name": "Write to Datastore/Write Batch to Datastore"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-16T06:11:14.649383Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-15_23_11_13-14652902676795304793'
location: 'us-central1'
name: 'beamapp-jenkins-0816061100-214890'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-16T06:11:14.649383Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-15_23_11_13-14652902676795304793]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-15_23_11_13-14652902676795304793
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-15_23_11_13-14652902676795304793?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3348.509s
FAILED (SKIP=6, errors=8, failures=1)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 58m 14s
153 actionable tasks: 118 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kmjyzfiqyeljk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2822
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2822/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10670] Make Read execute as a splittable DoFn by default for the
------------------------------------------
[...truncated 20.84 MB...]
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py",> line 1055, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py",> line 151, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py",> line 151, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Runs streaming Dataflow job and verifies that user metrics are reported
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py",> line 76, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3528.134s
FAILED (SKIP=6, errors=8)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build failed with an exception.
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 6m 9s
153 actionable tasks: 141 executed, 10 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tk7pg2decrtz2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2821
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2821/display/redirect>
Changes:
------------------------------------------
[...truncated 21.53 MB...]
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s17"
},
"serialized_fn": "ref_AppliedPTransform_Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0_39",
"user_name": "Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0"
}
},
{
"kind": "ParallelDo",
"name": "s41",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s24"
},
"serialized_fn": "ref_AppliedPTransform_Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1_40",
"user_name": "Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1"
}
},
{
"kind": "ParallelDo",
"name": "s42",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3"
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s29"
},
"serialized_fn": "ref_AppliedPTransform_Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2_41",
"user_name": "Write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-15T18:11:17.256327Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-15_11_11_15-1889596981539631066'
location: 'us-central1'
name: 'beamapp-jenkins-0815181104-180802'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-15T18:11:17.256327Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-15_11_11_15-1889596981539631066]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-15_11_11_15-1889596981539631066
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-15_11_11_15-1889596981539631066?project=apache-beam-testing
apache_beam.io.filesystem: DEBUG: Listing files in 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1597515054782/results'
apache_beam.io.filesystem: DEBUG: translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1597515054782/results*' -> 'gs\\:\\/\\/temp\\-storage\\-for\\-end\\-to\\-end\\-tests\\/py\\-it\\-cloud\\/output\\/1597515054782\\/results[^/\\\\]*'
apache_beam.io.gcp.gcsio: INFO: Starting the size estimation of the input
apache_beam.io.gcp.gcsio: INFO: Finished listing 0 files in 0.058342933654785156 seconds.
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3595.456s
FAILED (SKIP=6, errors=6, failures=2)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 2m 14s
153 actionable tasks: 117 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/f2slwhzucfrm6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2820
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2820/display/redirect?page=changes>
Changes:
[neville.lyh] [BEAM-10612] Add flink 1.11 runner
[Luke Cwik] [BEAM-8025] Update tests to use TemporaryFolder instead of rolling their
------------------------------------------
[...truncated 20.97 MB...]
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
}
],
"is_pair_like": true
}
],
"is_stream_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "CoGroupByKey/GroupByKey.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s21"
},
"serialized_fn": "%0A%8B%11%22%40%0A%1Dref_Coder_GlobalWindowCoder_1%12%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%C6%10%0A%25ref_Environment_default_environment_1%12%9C%10%12%12beam%3Aenv%3Adocker%3Av1%1A%3C%0A%3Agcr.io/cloud-dataflow/v1beta3/python3%3Abeam-master-20200630%2A%13beam%3Acoder%3Abytes%3Av1%2A%13beam%3Acoder%3Atimer%3Av1%2A%19beam%3Acoder%3Astring_utf8%3Av1%2A%11beam%3Acoder%3Arow%3Av1%2A%10beam%3Acoder%3Akv%3Av1%2A%12beam%3Acoder%3Abool%3Av1%2A%16beam%3Acoder%3Aiterable%3Av1%2A%1Dbeam%3Acoder%3Ainterval_window%3Av1%2A%14beam%3Acoder%3Adouble%3Av1%2A%22beam%3Acoder%3Aparam_windowed_value%3Av1%2A%14beam%3Acoder%3Avarint%3Av1%2A%1Cbeam%3Acoder%3Awindowed_value%3Av1%2A%1Bbeam%3Acoder%3Alength_prefix%3Av1%2A%23beam%3Acoder%3Astate_backed_iterable%3Av1%2A%1Bbeam%3Acoder%3Aglobal_window%3Av1%2A%23beam%3Aprotocol%3Aprogress_reporting%3Av0%2A%1Ebeam%3Aprotocol%3Aworker_status%3Av1%2A%3Abeam%3Aversion%3Asdk_base%3Aapache/beam_python3.5_sdk%3A2.25.0.dev2q%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%1D%0A%1Bpostcommit_requirements.txt%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10requirements.txt2%9B%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3D%0A%3B/tmp/dataflow-requirements-cache/parameterized-0.7.4.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1C%0A%1Aparameterized-0.7.4.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/mock-2.0.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11mock-2.0.0.tar.gz2%89%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%124%0A2/tmp/dataflow-requirements-cache/six-1.15.0.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%13%0A%11six-1.15.0.tar.gz2%91%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%128%0A6/tmp/dataflow-requirements-cache/funcsigs-1.0.2.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%17%0A%15funcsigs-1.0.2.tar.gz2%87%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%123%0A1/tmp/dataflow-requirements-cache/pbr-5.4.5.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%12%0A%10pbr-5.4.5.tar.gz2%97%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%3B%0A9/tmp/dataflow-requirements-cache/PyHamcrest-1.10.1.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%1A%0A%18PyHamcrest-1.10.1.tar.gz2%C4%01%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12i%0Ag<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/build/apache-beam.tar.gz%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%19%0A%17dataflow_python_sdk.tar2%9C%02%0A%1Abeam%3Aartifact%3Atype%3Afile%3Av1%12%C4%01%0A%C1%01/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python35/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.25.0-SNAPSHOT.jar%1A%20beam%3Aartifact%3Arole%3Astaging_to%3Av1%22%15%0A%13dataflow-worker.jarjx%0A%22%0A%20beam%3Awindow_fn%3Aglobal_windows%3Av1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01Z%25ref_Environment_default_environment_1",>
"user_name": "CoGroupByKey/GroupByKey"
}
},
{
"kind": "ParallelDo",
"name": "s23",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_merge_tagged_vals_under_key"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s22"
},
"serialized_fn": "QlpoOTFBWSZTWeHcbfMABB9/yH//////////////////////4SACUAR3g0hNGgxFYNCIRJ6Taj1HpM0T0nkTTaTPUntSZMRieoYjT1ADR6janojRk2mkwI9NTZNJtNMahAgU8EBT01GpjUBkBoDQaNANA0YEMgAAYQaAAAACDTEwCYAmCNNMAAmAE0NDEwAAAACMIwCNMTIYCDTEwCYAmCNNMAAmAE0NDEwAAAACMIwCNMTIYAkUCBNE0aATJ6TRpqPSNMh6QA0AGgABkyANADTRppp6jRoMmmaSNEXvDCKQibKdsgqqthqqJwcVk5bgHBFgxTPWtK3XNFnBoWoOo/kgQQHRZ87SR1v9n9mvZk6NaDMZ64T0XGHEhuMQZ7mzOagMR6F0AsYptTthA49erSeW+dULaoxXB/rQeln9jqwJF+udpnC+GXE07z7jnl2F6dLalCWHrTRKYTnHoE5zm5xCGdLm6NKKVIxSrIOuJG19Dp9Pej+YumQm4vVlLqWgWNaxAg2230MMYuTvcGoM03OZCEoxZMrQ2FoEBlSMsACCkFeYqLe7hj2T+1gP3l5nl1KUOo40BbkzzltS2BTDq8CJHkibbfY1tlUUrk1BNby5ausUiaj7LK0z3U1ssuY3dQYyFZvQe2OC3H23Z7PgdKx0y4DLJXRCl2Zosf9RoIC2VBvCKNzSiasVUUbLjjxbaCKb75QuVXpPaJhd1PJXGzcVbxkSZkie8FQEYz5Uv1aDc353f94KFHi9uP325IgXoDaOUo6mDDj1a3cweVybszMfQfyNGVXoa37b1Ob7TpsCwxK/yxQ8/CoVfj/JMM3Z20N+nLv9yhIUV+DP0Jcla6MdcskJGkjImEATMclHKwbgquQ66vWgVxlbmxjyp0tdJki6MOLhinu0xCXe1LN8SeM+JXiVixVluNBUVttv9FCOMrj9e7cpUbpbMkoMmpyKLkWiIRE+eqxAWxaGtX49L/Ovej8/N7XLGiBiIHHUhSRxXZN9Ahq56lkpY9+rrbYVQrYrBaSkisudWia2qQrWotdTy02EjXJD6OaJWqVT2JwLczhUle7ajpCryTu4BZUShCmSRbCJUpmhI8zmrQ1LxuBpwdmdnIIkiyd3eDTDEKEAyi1qAV0LnhOKf64olOnxu20y+rvnbSJDIhcQQ+jFdgrOKT0gkRBM4LJZTwzhw1t/siq2z23BbluFZOdjFAquo9oWNZqjxELaK9qPDTs0NtPc0bBajFZN1de0toTVAg4HPTQHFB47KGHFnqpTKimNBbzKAWOqVTqDE2mxThujaYpoHJg+NyLMwMEbzgaSirCAnNb6aMeVYUEjSpy01TVvavzsUNVZyRvd+EShDA2yFKAsHXUmCNsd76vliMSF3idbFONIdSnFneyd0G3WklMjES6taIsmZaK0b8BiIIKRMTfduOJVTSkM9wZK9xm4mkVhi1qWTEpRqEppBvGhLXXB6IIsPJKFSGcL8EnNaQutylKRQlJmdVcrYt5R6d8JIONsSwJrSTsVRlRXuuaFdtdwWdvlKqrWbeRbSnsQCK46gROTbfHHw1oWIOYrViCOAxG+hoTeO1UIJmg17U1hvxLJSRffpEdvNLSp4A4Iqg7Wld1BjVjTlhASiNeDU4BYJORMAPDTzCsg/uxx7MQjet2r6hKlELSzO62TIZpPFUZLlkZPXZVOFadcXqKD67v4TTZfEaDhNE19/WgK+MgswWH17B2UbBaLpmIhA3pdZEMcD2pypWo5vcW3g2VaiH6q1eHYnO21XuvRa9IucXckU4UJDh3G3zA=",
"user_name": "CoGroupByKey/Map(_merge_tagged_vals_under_key)"
}
},
{
"kind": "ParallelDo",
"name": "s24",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "check"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_4"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "Map(check).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s23"
},
"serialized_fn": "QlpoOTFBWSZTWcB8YyMAA83/0H////////////////////5/wAAE0ARXjrpss63YN1g4RNTSTTDSehPQjQyeoPUxANABoDQyNADJoB6hpoZMj1BkyaY0gETRGozSaGk9PVPEgANAAANAAAAAA0AAAAAAA1MTQSptT0R+iaaGoZNAPQg0ZDEMAQNBo09RhDQDQY1GCYmhkIMATCYEwmE0wTEYAmAI0MmATAAAAIwEwAAAlNJNNCZGjRU/TVPxJtTQ9U8oGj9UeoDQDQAA0AAaaANGgB6g09Qepnj28iJZJbWGUUNFIlMeZnlSNLRCuOqNpfHZipCEeKoo84ZAqgHSEMHD+DjMf7CC4uJ7rcQVPj/G8B0Gi4MJCJ008B0ynccTN5qyKS5tA7E6imhQiEJh3HhNNuhh6fFb1cLoSIv9z7N6+K1h1p34GS/U3UqrLFmtspsaoqwgI7r3MoNDnVrqsgg8G1GUjMEQZmm4IdFhVdjY6Cawb9B4qCyTTcNTBSirVB1jmTukkkla7Z02BJ2mgIkKNuJeGMwrgWHCcJFo4AMTAQJdGH8E22SZhEjo4+uDehRSdnk2kZjBGG4NYRDvlqn6cJmEha6NskTRWARARwnsEZiTSEeuJjeWpVdAflbrlh+rlcnF3nH4nH9u5J5ZSE2+RoATaR2anPVUFPlFHKDt2u+rWufeofLElfUO/KOkxaXkmMLaUywVwTRcBSADAhQt+JxJd0qX6ez+dRpU9UESNEBfMHrc0H2UaVXtuZuhHLmSjJkVe1gJpRn8jq8b61nWAe9/MUiow58CSKsiS2l9AqJqOiA5k/0oMYXIPnmRCmxg9VyztWPXDH0Ce4hA07jMNMpXRMK8c4KCyPBPfBo9LF0Y62tOIwMNVbgNs9AamgSEs5C6iORa7QraMkpXokw8ESSWMy23bUhi+P6saaymykjuMNtojSfHO51zhEdgGAgONQgOJgbEpiSQgvUL8CAdsV5dhF50zUjZC8FFanynI0D0GczEdyfOMaSYVox46Kmaoeb8+EmM6c+fwYw+IBxVXVkeQEKWcwRFoFEFrBwAUA4cpst4ppQsgcmCzQZgQoWKwGRjEhprkArwUdup6LzGoJ0nitRs10gz3GY0BHTqjkDegDT6kR0nVNb6NPJCWs5ydjfqMAijCGF1c/JB8Jca2Gxr91Vk5Yuu6zmZr8xAaCGqnVGi8XqYtJEnTlvyOzDpuxZYpyWMiVk4RswjXt3ZQBRXGhihIIvsHhCDIKhlBAp+yvDWgq7DLnIFLOCikTMW8gsG0Zc0vdJZ76a+TmIY6IOIpITlYsJaEy3FIV/T/uk9BDeqe47sq7RmxbNhJLQ32tmPS0U+Y6aCyqH7qFIJq1lg06BoyEfz1G/VB8uK4slgCk8MSMMFFX9KVYYlROMHvc8oNalq1ryksUhK5VVJGt6TERLCWjIhEZVqBubq2qxNaylqJe8pmDMNu63KI2UyQIWvn3G20o7cGeY1ExqsvY+WXMUDdQjSbCa/yrDAI23qMVZlb+yTTCaDCsbBbQ1QYoGSUcE8TMTEUxU0VzN5YQlCyuuVC61S9k4tj2c8q4Mt9jKsEMYWHJuadGvKD8dZXuUdpUZXs7bKX9FhfpLcLgcE8USi9wptBvxhZrTJFhOjYRLltYcMSAIgBsMwQK5PQgsGlsQFxAqiAeq6nUqnvdJ+vVrHGff4d+/yPS96w/xdyRThQkMB8YyM",
"user_name": "Map(check)"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-15T12:12:49.418616Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-15_05_12_48-16976394693021471610'
location: 'us-central1'
name: 'beamapp-jenkins-0815121235-564831'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-15T12:12:49.418616Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-15_05_12_48-16976394693021471610]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-15_05_12_48-16976394693021471610
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-15_05_12_48-16976394693021471610?project=apache-beam-testing
apache_beam.io.filesystem: DEBUG: translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/6e8e1a7e-d65f-411d-a2a2-f0310f873e67' -> 'gs\\:\\/\\/temp\\-storage\\-for\\-end\\-to\\-end\\-tests\\/py\\-it\\-cloud\\/output\\/6e8e1a7e\\-d65f\\-411d\\-a2a2\\-f0310f873e67'
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3494.335s
FAILED (SKIP=6, errors=7, failures=1)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 0m 29s
153 actionable tasks: 118 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/meacnbqht4mqk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2819
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2819/display/redirect?page=changes>
Changes:
[Boyuan Zhang] Scale progress with respect to windows observation.
[Robert Burke] Fix broken build.
------------------------------------------
[...truncated 21.24 MB...]
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Group/Map(_merge_tagged_vals_under_key).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "QlpoOTFBWSZTWfuFNCwABBp/zH//////////////////////wSAABABQBHeXbpsW6Og1RWDRJpE0yIzU2gZTJ6ZMkw0myAAg2mm1R6AAaATaBoAaG1G0iZPamoGkEyTyZTJtSejVDyjEGjIDQZAaAGgyAMmgAAaMJpoAYhtQNQ0JqnqNqAAAAAGQGmgAAAAANAAANAeoAABBgAJgACMAAIwAEaMTTAEwAATCMIwEyYjEDAxIJiET0FPQ0NMpp6U09EHqDagGmgAAAZAeoGgANAaAGnpNO0ZHsJrRhmeY1Sqe204r17YvK0zbqWAYHrJ6a0KFxNjsQWLcFAR7/R6YcQB0kCB/aJ4n/QtqeLpVEC57ekA2ROHKW8gQMaesKYIEeXWxE0AIIQozDflljDXthU1KovSV6NQUGsfjVpoEQZaF9AF4k39Lx7/QG1TUqYSyOmXTiJMQUooQUFGUo6iARHJgyS1mSsiBmBB2ECbPCdd8S7QZ0NBOWw/pwoAPsoxzBgySSV5mTlamTIDWUIBmZDQ1THuNVVAQDJgytwHTqKly+g9RjNm38KpbP1iqp0/+stQHZjwndfoBgBLQ4O5wKSS4OOYF1CixRwnoGki8QLvTQkUOeUdCGhBKuIQQaQ/RluhMeSuV1ut3kvvEc1gfmJwEl4dCR7EdAjUrIVFSaifZxmrisQ9cUT5kMVOCnWPMv0+Six8hKpXmEpOaO4T1oI8nF7KQTwRiNo6sjOueDSf9cztm+F7h39QsDhQQEQ17pRJxMVKUs+WOI0Thl6kn352PJ1KHdK5Iu5+dvi4NhMXtdImYHckONLo0/irGlcQ5psGBL6/4oVqDOQhyTiOpIK6JqeghDgAloZKBl7SAzUE7GslAYSW4BFAUttKFoCRDkhwIM9Q/XEgxtBoYOdC4dQ2gmZvyFLgRUJJJL7izrhJ3RoXQShP5Q8yz9WtYKMiDiPfxPjkJ1QXj7lz2ttdz6+7QYop5DkQO67EDHQf9Gwwy4y7HGazGuk2qYmYOsXEVCtRyDZyhpHKdowzx1M5I2RALm4ATWXyWeDCvkQdapxHfg1ZIU0C/V1a2EWaWN4sZwmYDVePH6p4b2qMrLFTKQHDVgKNCzuQ9jGLx4A1QlKgFgub8+Oc+YYn2e385reg6srEiFf8A3tSgAnr5WrASHAFDSg/bHEOvbYzbgNW8OgmPLpeOnHwrADZFaQcBwl0chB0jS26VPJaVvZFOYOugaRUupWK4iBiAyYc8okT4zA8cBYK5DUxmJeIiGAgV+zEAVqp9SqA1EinMDB3MCRQLyAnoBb/BcBY1os0XF5mGBUdiBF22bxAeMkfYKMct5G9hvtlOEkczugHCIaxJBhGIUGWX4JWy4OHl4q0jW8Pu887px/p8WZq5mSVLOglL1oq3qkOXKulKnYRdW5WvsamxNrFiv3kdTCyh+TNRTSlVGMI7LSzqMUnnDOVXfNRQ9iGwCzMSpUxzndWsolQhCKi6HQjjsIQhSzLMFxt1pwIHZ54WlHWKiahtkS7RQINemXL2xGM0N3AeQYZ2Acd8sHDm0xWvu0mZAb1zQ3wH2C+NbG5XUMAxRHw1wNlpwxcK68gduTmKrtUDcBkByap2RCCh5Vy4AYGVgwYCURmImAYNgmYlGFXVubVwdaZuZLojQRJSUw3l2MQwCERhocWKC2mFUWkU0NcszcSt3EUha4IjfOaoSo9KCgmQSYI4dhRNvhR2gcmLIgbYCtQgwu29PVDLGR9EvGzLAe1rPtY0eh3Ab+p/6rqC/4u5IpwoSH3CmhYA",
"user_name": "assert_that/Group/Map(_merge_tagged_vals_under_key)"
}
},
{
"kind": "ParallelDo",
"name": "s22",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Unkey.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s21"
},
"serialized_fn": "QlpoOTFBWSZTWS7+JmYAAtF/wH///////////////////+ZrwFADN73aJ0108nvBqZJNCMIGmmmnqGmj1BkAGj1AAaABoGgD0QGm1Gg0aAAahE0zIKafpI09R5QGhoAAAAAADQAAAAAD1AA5+mgJR5T1NqAaDQyNAYgABoDBMjIAA0BoyaGgZAAaakn6lH6oHlAAAAAAAGgAAAAAAAAD1AABKICE00JPEaeo0yE0Bo00aNAAA0Bo0AAAAAAyGg1S8/UgNlKu4Yjrs7BRrzTiWFUhCrkiOslUEAhKCE/jKDwVIaI1gAqomgrVEwvQevVeJu5WQYwZ+2nuVpQxgqiarITjB1wQe7nkEgDFLheheitCNIMiSxkWAWEkl4oDJNORmSSQkgZAB6FtuWvahW3KKxbZLyV0NeDkCpC0EIS0LVLsxyoKuIrPnHFIjqBRgo80SJI8kSQU6IqUYIAqIw7JAt+vBS/VoA4ahkHNA0k7bmIga0woPJeYqF3BFGBaElCepuhslb2UjdiodgEGGI+Pp7EXa4ePlZw+rED1bXNebDSixvE+FKwvOZkdsiRu7dF43DLo2bWU6l7Tf0n1g6YMqSaA6Q3IxmivF9VW6iGlfTOzeqJHlrGCkjG9dnKc+R8Bxp1R2vfVBOJYy3ak4JGrOccSFcVRVvja8ZEVqq2OmOLPArW4iEwzQiOtlZDUFdDDknf1IMreOsJlJgQGaihJTKE9w89JjrMQIOcxUSQS4TBUlhbMakZIUl0fehzxC8OFrgkqNgvcl+jnVJPIELT5Y6Q1cDIaTNkJiBgFqotE9oRo6VIo1toICXBmNTL+bCanV+x5T4AQH9OFxAAq1lHwCiQEEFiClYOAQjcU4maDcg6ysTKmoO1XCbHCuWDXIJkbBlK1LWtFyrcgmEQjVMRMNUKSr5QJToXlD8gFEUHQr4Rt06iOuKgjVRQczcCqihIIrlBdlQTZ05jYY0kGAr3IVrpOJTbh4SGHVVKpcLAh+gYKSqWXvkwZ8kxTP1dWDS5/PTnk/AZosKKwlZqt/SlXQNqYhmBSddZFcUhwZQoG6/8QDdhCLAoASg5zHBFmBjFIgFVQnERFlTlqnSloRE6ABsDZvfOXdMKldFhSR9SuQLuPF0XmPQXkfcYjTLNSazfHicwgZg2rUFMHWNWtKPGCg0onK7pZbJEdZDJqXggjbESeouRbLF+IlbGOQMlQo4AcPySLFFV9nQV6LUsCMZlh8ONCQ2wHqUKUhqgjc1pIIg5AiCO2YffLX5+vKtAcNOKHt8fUfFjfP1TF5z/v8/Wf7/F3JFOFCQLv4mZg",
"user_name": "assert_that/Unkey"
}
},
{
"kind": "ParallelDo",
"name": "s23",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "_equal"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "FastPrimitivesCoder$QlpoOTFBWSZTWYQR6NMAAEDXwH8QgCEJAEBAv279AmAAIABqEqnqGgaABpoyNAGVHpGgMgDQBk0oR6IeoECBiqqU5NY23ndshzT2UPUOGrg42YPi9VyA8lbwwPJgtghxs5Qq1aWwExCDeMa0RHC2QigTCdizz1nx+LuSKcKEhCCPRpg=",
"component_encodings": [],
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
}
],
"is_pair_like": true,
"pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_5"
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "None",
"user_name": "assert_that/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "None",
"step_name": "s22"
},
"serialized_fn": "QlpoOTFBWSZTWagiL3QABHR/8v//////////////////////+QAAgIAACAAA0AUXndBaG2mbB3GDg1NEymalPKeTKeU0yeU9NqnptSPU8iNHqPU009TQGm1D0Q0ZNBoeiGg0aPUaep5NJ6ZE8mSFVP00m1JtBp6SfqZTCGQaAaAMmQ0NGQAADRiNNNAGENAZADTTQNBGhIMqNppk01Gj0mhpo0DQ0NDQAGgAAAAAaAaAAAAgwJphNMTE0ZMATAE0GAmmAAmTAAAjBGJiMAmhiGTRglNIRpMmQRkGmpHkybVPUPUPUG0TRo0AAA0AANBoA0AAAGQa4Sp8XKsSCyIvEYgtRFTJGpK2rc0jA8qxNRaiqTkk1KCk88JAkMO1K9ejNbmruU2b7Ec4TMM6YCCG/ggfrz4EPn9nlzL+XKuhYzSTeUydRXx/tHtIjBzYe4stGQoZiKaqyGxCIHjpCY2apfMTjt7HJk4gzJGygQ5jtsIf2lCqlFZqcmh/oUlMUBankVROkOjO0IdsKRMMJ26a+p7rd2ONxs4ZAO8eOOByZKgOfWMWNNM6wZYzILjzFTYU3YuFarebLS7MJXvMp16cpwJiaT2n+0IxDR10X5cKIxAjGMwkxE91KAuoYRgXfXdNMUJpjvnvBK+Tpw8B73KgunEjsv2ez4LpAWCEeann3e5+oqArNJBQCRAhKqqERERKFVVVYokEaCOOyDNE2wQJIxJTQCMUV3O1NMQauKuKFkZ9U0LIAMaAsnT8jnw+eJqxLS8OaipMz9aJYkT7kVb8rLIPEBasmwg4MhgBxGagjAijEe7XZ5YmSrEOI/Q9oqL0ibTEc4W+g4U1fsNqdVolcL8xM9iHam1Mq8ltXDBA+MwcoKTpwUoCVJQJWOVvUu5Rw6SUstDLxUu6WYcqp80xdaoZTyJveP3p8rQWIRA4oe3w6uHrNfx/tafK50ejKh96MBAcPWZYNkFiTpaXQ0vn2Nnvny5E7Jlo2dc+po3LX4qa/apen7+itSofrTm51mCjcxs99arZ2xtL3rtemrR/Y+vxx8WVsIhEGC/opwzPrifMWT7D5AnjZCmeUiY5EOLkFNwbBFCJu26RgYkisEuOfLaNAPHkncFKV8GVPp7/NyLl0O2AVrDXi64yDU0iQlsjwV+l/lorMwoESmqYYEaG9vr8Mgweg9CEp88CHrQcf4dTfd4Xqt19tajHz78BiFvFNNPBukOxnoM+QbeRIaPTld68/GdmqGzFYVJCVip1dY4vEHqM5oJFG5TaMbRIWEY8JFbRgYKDFnDIUsNmr4InkTo+sCQEAz6StXQzm74aKV7wOEyvEgwWMkQVwqGKKdIE5wrY1t0gJiZbIEZASxMDkbfBbbmMeS4u3gYiH2ADC/gjkuDBA460wgFpkpAMcSyCoonm4+aRsZ/PCGg+pOEt6vDuiNyRpBjdlthjNMjHBUzaaG1XH7UV/LQLdyz1mrpgNBDXqVHo1lcWoE1DqzDFmHQa7LDW1FJZvaRMtKijENTPmcMzOgt1nrpvBa7u44OEX446dMgvjKIIEa+/pBg4cRbs3ES8OCoWtJjS2S4ai/RmaG2Spz3JrrlMxDH0MOdYw9gQhAVUMYCiKzX3QGwMCl6nCAPv34phEQTEctA8aCpXTsoJpq0Ym70tNQGhXhPTlPTJRaSN6tD6qIqmh3+HiOx30LUiqTmm1NDs17syq2ENoIkxxM438YQqQicsA2Z10Asx075YKqq+VFqpclK8cqwiZwHeRAoLQrgXKgMsyRuzQEP4biAt26IyvtRV2DuILdVbtJjOMz53aB15A4Jzui+6aRMap49ETXjaCiwuMc4LBWZPXumSEDlgdBF6oWCRkpvy1SkjY1EhJM51NugJtCyosnM1t5596dKf+LBwS5hZsamBjEsMKhrTCbG5iaaK4tMS/6ziT4KyyyGbj3V49QxYinAWFlUemk5RF6RRhtLYYRZtiZIsDQUtI0JgN1CRuYTBAw0hoMLkx25TRoBYRgTsiABEQkFVb37x+r8jxOk3HXer5hIq8HRtUYEGwQ6dlYnEGII57P/F3JFOFCQqCIvdAA==",
"user_name": "assert_that/Match"
}
}
],
"type": "JOB_TYPE_BATCH"
}
apache_beam.runners.dataflow.internal.apiclient: INFO: Create job: <Job
createTime: '2020-08-15T06:21:30.134563Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-14_23_21_22-2877197456356957604'
location: 'us-central1'
name: 'beamapp-jenkins-0815062112-967019'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-15T06:21:30.134563Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
apache_beam.runners.dataflow.internal.apiclient: INFO: Created job with id: [2020-08-14_23_21_22-2877197456356957604]
apache_beam.runners.dataflow.internal.apiclient: INFO: Submitted job: 2020-08-14_23_21_22-2877197456356957604
apache_beam.runners.dataflow.internal.apiclient: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-14_23_21_22-2877197456356957604?project=apache-beam-testing
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3355.839s
FAILED (SKIP=6, errors=8, failures=2)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 58m 15s
153 actionable tasks: 118 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i6p53f5kxpzu6
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2818
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2818/display/redirect?page=changes>
Changes:
[Luke Cwik] [BEAM-10688] Euphoria assumes that all type descriptors are resolvable
[Luke Cwik] [BEAM-10670] Use fraction of remainder if consumed fraction is unknown
[Luke Cwik] [BEAM-10670] Improve splitting logic to prefer splits upto the the
[Luke Cwik] [BEAM-10670] Fix passing forward the self-checkpoint from the
[noreply] [BEAM-9547] Implement some methods for deferred Series. (#12534)
------------------------------------------
[...truncated 15.24 MB...]
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py",> line 151, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/io/gcp/pubsub_integration_test.py",> line 151, in setUp
self.input_topic.name)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: Runs streaming Dataflow job and verifies that user metrics are reported
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_streaming_metrics_pipeline_test.py",> line 81, in setUp
ack_deadline_seconds=60)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/_gapic.py",> line 40, in <lambda>
fx = lambda self, *a, **kw: wrapped_fx(self.api, *a, **kw) # noqa
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/cloud/pubsub_v1/gapic/subscriber_client.py",> line 439, in create_subscription
request, retry=retry, timeout=timeout, metadata=metadata
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/gapic_v1/method.py",> line 145, in __call__
return wrapped_func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 286, in retry_wrapped_func
on_error=on_error,
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/retry.py",> line 184, in retry_target
return target()
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/timeout.py",> line 214, in func_with_timeout
return func(*args, **kwargs)
File "<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/google/api_core/grpc_helpers.py",> line 59, in error_remapped_callable
six.raise_from(exceptions.from_grpc_error(exc), exc)
File "<string>", line 3, in raise_from
google.api_core.exceptions.ResourceExhausted: 429 Your project has exceeded a limit: (type="subscriptions-per-project", current=10000, maximum=10000).
-------------------- >> begin captured logging << --------------------
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
google.auth._default: DEBUG: Checking None for explicit credentials as part of auth process...
google.auth._default: DEBUG: Checking Cloud SDK credentials as part of auth process...
google.auth._default: DEBUG: Cloud SDK credentials not found on disk; not using them
google.auth._default: DEBUG: Checking for App Engine runtime as part of auth process...
google.auth._default: DEBUG: No App Engine library was found so cannot authentication via App Engine Identity Credentials.
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): metadata.google.internal:80
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
google.auth.transport.requests: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
urllib3.connectionpool: DEBUG: http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 3796.447s
FAILED (SKIP=6, errors=6)
> Task :sdks:python:test-suites:dataflow:py35:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:go:buildLinuxAmd64'.
> Build failed due to return code 1 of:
Command:
/usr/bin/go build -o ./build/bin/beamctl github.com/apache/beam/sdks/go/cmd/beamctl
Env:
GOEXE=
GOPATH=<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/go/.gogradle/project_gopath>
GOROOT=/usr/lib/go-1.12
GOOS=linux
GOARCH=amd64
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 12s
138 actionable tasks: 102 executed, 34 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/leetrdqifz7na
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PostCommit_Python35 #2817
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python35/2817/display/redirect?page=changes>
Changes:
[Boyuan Zhang] Enable dataflow streaming engine when running runner_v2 and streaming.
[Boyuan Zhang] Fix formatter.
[Boyuan Zhang] Use unbounded wrapper for Kafka Read.
[je.ik] [BEAM-10691] Use FlinkStateInternals#addWatermarkHoldUsage for timer
[noreply] [BEAM-9615] Map user types to Schema reps. (#12554)
[noreply] fixed a typo in S3TestUtils (#12582)
------------------------------------------
[...truncated 15.42 MB...]
],
"type": "JOB_TYPE_BATCH"
}
INFO:apache_beam.runners.dataflow.internal.apiclient:Create job: <Job
createTime: '2020-08-14T19:04:54.545332Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2020-08-14_12_04_52-11107539494102260292'
location: 'us-central1'
name: 'beamapp-jenkins-0814190444-364060'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2020-08-14T19:04:54.545332Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
INFO:apache_beam.runners.dataflow.internal.apiclient:Created job with id: [2020-08-14_12_04_52-11107539494102260292]
INFO:apache_beam.runners.dataflow.internal.apiclient:Submitted job: 2020-08-14_12_04_52-11107539494102260292
INFO:apache_beam.runners.dataflow.internal.apiclient:To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-14_12_04_52-11107539494102260292?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-08-14_12_04_52-11107539494102260292?project=apache-beam-testing
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_12_04_52-11107539494102260292 is in state JOB_STATE_RUNNING
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:53.006Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2020-08-14_12_04_52-11107539494102260292.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:53.006Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2020-08-14_12_04_52-11107539494102260292. The number of workers will be between 1 and 1000.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:58.141Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:58.938Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.015Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step GroupByKey: GroupByKey not followed by a combiner.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.091Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.143Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.234Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.321Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.368Z: JOB_MESSAGE_DETAILED: Fusing consumer metrics into Create/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.418Z: JOB_MESSAGE_DETAILED: Fusing consumer map_to_common_key into metrics
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.460Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Reify into map_to_common_key
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.499Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/Write into GroupByKey/Reify
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.540Z: JOB_MESSAGE_DETAILED: Fusing consumer GroupByKey/GroupByWindow into GroupByKey/Read
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.589Z: JOB_MESSAGE_DETAILED: Fusing consumer m_out into GroupByKey/GroupByWindow
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.646Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.705Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.741Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:04:59.798Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:00.045Z: JOB_MESSAGE_DEBUG: Executing wait step start13
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:00.171Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:00.237Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:00.285Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:00.414Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Create
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:00.505Z: JOB_MESSAGE_DEBUG: Value "GroupByKey/Session" materialized.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:00.625Z: JOB_MESSAGE_BASIC: Executing operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:12.207Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:12.243Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:29.966Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running stage(s).
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:32.631Z: JOB_MESSAGE_WARNING: Your project already contains 100 Dataflow-created metric descriptors and Stackdriver will not create new Dataflow custom metrics for this job. Each unique user-defined metric name (independent of the DoFn in which it is defined) produces a new metric descriptor. To delete old / unused metric descriptors see https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list and https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:33.496Z: JOB_MESSAGE_BASIC: Executing BigQuery import job "dataflow_job_1684752163942474833". You can check its status with the bq tool: "bq show -j --project_id=apache-beam-testing dataflow_job_1684752163942474833".
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:43.951Z: JOB_MESSAGE_BASIC: BigQuery import job "dataflow_job_1684752163942474833" done.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:44.902Z: JOB_MESSAGE_BASIC: Finished operation read+write/NativeWrite
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:44.983Z: JOB_MESSAGE_DEBUG: Executing success step success1
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:45.281Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:45.355Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:05:45.391Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:32.328Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:32.416Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:32.456Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:31.615Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Create/Read+Type matches/Group/pair_with_0+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:35.758Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+InspectForDetails/ParDo(_InspectFn)+ParDo(CallableWrapperDoFn)/ParDo(CallableWrapperDoFn)+Type matches/WindowInto(WindowIntoFn)+Type matches/ToVoidKey+Type matches/Group/pair_with_1+Type matches/Group/GroupByKey/Reify+Type matches/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:35.839Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:35.924Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:36.013Z: JOB_MESSAGE_BASIC: Executing operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_11_59_51-2637204800156881117 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:45.210Z: JOB_MESSAGE_BASIC: Finished operation Type matches/Group/GroupByKey/Read+Type matches/Group/GroupByKey/GroupByWindow+Type matches/Group/Map(_merge_tagged_vals_under_key)+Type matches/Unkey+Type matches/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:45.279Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:45.396Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:45.444Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:06:45.515Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Attempting to perform query SELECT fruit from `python_query_to_table_15974315806197.output_table`; to BQ
DEBUG:google.auth._default:Checking None for explicit credentials as part of auth process...
DEBUG:google.auth._default:Checking Cloud SDK credentials as part of auth process...
DEBUG:google.auth._default:Cloud SDK credentials not found on disk; not using them
DEBUG:google.auth._default:Checking for App Engine runtime as part of auth process...
DEBUG:google.auth._default:No App Engine library was found so cannot authentication via App Engine Identity Credentials.
DEBUG:google.auth.transport._http_client:Making request: GET http://169.254.169.254
DEBUG:google.auth.transport._http_client:Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
DEBUG:urllib3.util.retry:Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/default/?recursive=true
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): metadata.google.internal:80
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/default/?recursive=true HTTP/1.1" 200 144
DEBUG:google.auth.transport.requests:Making request: GET http://metadata.google.internal/computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token
DEBUG:urllib3.connectionpool:http://metadata.google.internal:80 "GET /computeMetadata/v1/instance/service-accounts/844138762903-compute@developer.gserviceaccount.com/token HTTP/1.1" 200 221
DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): bigquery.googleapis.com:443
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "POST /bigquery/v2/projects/apache-beam-testing/jobs HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/queries/f5bb390c-db43-4a32-9d4f-27de9b933d32?maxResults=0&location=US HTTP/1.1" 200 None
DEBUG:urllib3.connectionpool:https://bigquery.googleapis.com:443 "GET /bigquery/v2/projects/apache-beam-testing/datasets/_7357fab0f784d2a7327ddbe81cdd1f4ca7e429cd/tables/anon393f6c85c3af21130075829372da162b90a7b76a/data HTTP/1.1" 200 None
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Read from given query (SELECT fruit from `python_query_to_table_15974315806197.output_table`;), total rows 2
INFO:apache_beam.io.gcp.tests.bigquery_matcher:Generate checksum: 158a8ea1c254fcf40d4ed3e7c0242c3ea0a29e72
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:07:14.447Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:07:14.500Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:07:37.722Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:07:37.773Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:07:37.824Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_12_00_24-8494372210744929685 is in state JOB_STATE_DONE
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:oauth2client.transport:Refreshing due to a 401 (attempt 1/2)
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:08:44.032Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:08:50.528Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+ExternalTransform(simple)/Map(<lambda at external_it_test.py:43>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:08:50.618Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:08:50.659Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:08:50.714Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:08:59.948Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:09:00.005Z: JOB_MESSAGE_DEBUG: Executing success step success19
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:09:00.125Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:09:00.177Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:09:00.221Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:09:51.336Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:09:51.377Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:09:51.404Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_12_02_28-12613363498460267345 is in state JOB_STATE_DONE
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:10:55.791Z: JOB_MESSAGE_BASIC: Finished operation Create/Read+metrics+map_to_common_key+GroupByKey/Reify+GroupByKey/Write
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:10:55.970Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:10:56.061Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Close
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:10:56.165Z: JOB_MESSAGE_BASIC: Executing operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:05.192Z: JOB_MESSAGE_BASIC: Finished operation GroupByKey/Read+GroupByKey/GroupByWindow+m_out
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:05.344Z: JOB_MESSAGE_DEBUG: Executing success step success11
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:05.524Z: JOB_MESSAGE_DETAILED: Cleaning up.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:05.638Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:05.679Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:55.066Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:55.219Z: JOB_MESSAGE_BASIC: Worker pool stopped.
INFO:apache_beam.runners.dataflow.dataflow_runner:2020-08-14T19:11:55.275Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
INFO:apache_beam.runners.dataflow.dataflow_runner:Job 2020-08-14_12_04_52-11107539494102260292 is in state JOB_STATE_DONE
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_streaming_wordcount_debugging_it (apache_beam.examples.streaming_wordcount_debugging_it_test.StreamingWordcountDebuggingIT) ... SKIP: Skipped due to [BEAM-3377]: assert_that not working for streaming
test_datastore_wordcount_it (apache_beam.examples.cookbook.datastore_wordcount_it_test.DatastoreWordCountIT) ... ok
test_autocomplete_it (apache_beam.examples.complete.autocomplete_test.AutocompleteTest) ... ok
test_leader_board_it (apache_beam.examples.complete.game.leader_board_it_test.LeaderBoardIT) ... ok
test_game_stats_it (apache_beam.examples.complete.game.game_stats_it_test.GameStatsIT) ... ok
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_avro_it (apache_beam.examples.fastavro_it_test.FastavroIT) ... ok
test_user_score_it (apache_beam.examples.complete.game.user_score_it_test.UserScoreIT) ... ok
test_hourly_team_score_it (apache_beam.examples.complete.game.hourly_team_score_it_test.HourlyTeamScoreIT) ... ok
test_read_via_sql (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_read_via_table (apache_beam.io.gcp.experimental.spannerio_read_it_test.SpannerReadIntegrationTest) ... ok
test_bqfl_streaming (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... SKIP: TestStream is not supported on TestDataflowRunner
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_one_job_fails_all_jobs_fail (apache_beam.io.gcp.bigquery_file_loads_test.BigQueryFileLoadsIT) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadNewTypesTests) ... ok
test_iobase_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_native_source (apache_beam.io.gcp.bigquery_read_it_test.ReadTests) ... ok
test_avro_file_load (apache_beam.io.gcp.bigquery_test.BigQueryFileLoadsIntegrationTests) ... ok
test_bigquery_read_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_bigquery_read_custom_1M_python (apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT) ... ok
test_spanner_error (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_spanner_update (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_write_batches (apache_beam.io.gcp.experimental.spannerio_write_it_test.SpannerWriteIntegrationTest) ... ok
test_copy (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_batch_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_kms (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_copy_rewrite_token (apache_beam.io.gcp.gcsio_integration_test.GcsIOIntegrationTest) ... ok
test_multiple_destinations_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_value_provider_transform (apache_beam.io.gcp.bigquery_test.BigQueryStreamingInsertTransformIntegrationTests) ... ok
test_datastore_write_limit (apache_beam.io.gcp.datastore.v1new.datastore_write_it_test.DatastoreWriteIT) ... ok
test_transform_on_gcs (apache_beam.io.fileio_test.MatchIntegrationTest) ... ok
test_dicom_search_instances (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_dicom_store_instance_from_gcs (apache_beam.io.gcp.dicomio_integration_test.DICOMIoIntegrationTest) ... ok
test_file_loads (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... SKIP: https://issuetracker.google.com/issues/118375066
test_streaming_inserts (apache_beam.io.gcp.bigquery_test.PubSubBigQueryIT) ... ok
test_streaming_data_only (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_streaming_with_attributes (apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest) ... ok
test_parquetio_it (apache_beam.io.parquetio_it_test.TestParquetIT) ... ok
test_analyzing_syntax (apache_beam.ml.gcp.naturallanguageml_test_it.NaturalLanguageMlTestIT) ... ok
test_text_detection_with_language_hint (apache_beam.ml.gcp.visionml_test_it.VisionMlTestIT) ... ok
test_basic_execution (apache_beam.testing.test_stream_it_test.TestStreamIntegrationTests) ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream supports emitting to multiple PCollections. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
Tests that the TestStream can independently control output watermarks. ... SKIP: The "TestDataflowRunner", does not support the TestStream transform. Supported runners: ['DirectRunner', 'SwitchingDirectRunner']
test_big_query_write (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_new_types (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_big_query_write_schema_autodetect (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... SKIP: DataflowRunner does not support schema autodetection
test_big_query_write_without_schema (apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests) ... ok
test_label_detection_with_video_context (apache_beam.ml.gcp.videointelligenceml_test_it.VideoIntelligenceMlTestIT) ... ok
Runs streaming Dataflow job and verifies that user metrics are reported ... ok
test_big_query_legacy_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_avro (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_new_types_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_big_query_standard_sql_kms_key_native (apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT) ... ok
test_deidentification (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_inspection (apache_beam.ml.gcp.cloud_dlp_it_test.CloudDLPIT) ... ok
test_job_python_from_python_it (apache_beam.transforms.external_it_test.ExternalTransformIT) ... ok
test_metrics_fnapi_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
test_metrics_it (apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest) ... ok
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df-py35.xml
----------------------------------------------------------------------
XML: <https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 66 tests in 4140.508s
OK (SKIP=7)
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:go:buildLinuxAmd64'.
> Build failed due to return code 1 of:
Command:
/usr/bin/go build -o ./build/bin/beamctl github.com/apache/beam/sdks/go/cmd/beamctl
Env:
GOEXE=
GOPATH=<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/go/.gogradle/project_gopath>
GOROOT=/usr/lib/go-1.12
GOOS=linux
GOARCH=amd64
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python35/ws/src/sdks/python/test-suites/direct/common.gradle'> line: 48
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py35:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 11m 41s
138 actionable tasks: 104 executed, 32 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/zmgrxcrsonupk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org