You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/05/13 19:13:03 UTC
Build failed in Jenkins: beam_PostCommit_Python2 #2418
See <https://builds.apache.org/job/beam_PostCommit_Python2/2418/display/redirect?page=changes>
Changes:
[kawaigin] Use csv reader instead of split to read csv data.
------------------------------------------
[...truncated 12.71 MB...]
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py", line 744, in _execute_query
job_labels=self.bigquery_job_labels)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 249, in wrapper
raise_with_traceback(exn, exn_traceback)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 236, in wrapper
return fun(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery_tools.py", line 415, in _start_query_job
labels=job_labels or {},
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 973, in __setattr__
object.__setattr__(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 1651, in __set__
value = t(**value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 976, in __setattr__
"to message %s" % (name, type(self).__name__))
AttributeError: May not assign arbitrary value owner to message LabelsValue
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:31:30.091Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/batchworker.py", line 647, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 226, in execute
self._split_task)
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 234, in _perform_source_split_considering_api_limits
desired_bundle_size)
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 271, in _perform_source_split
for split in source.split(desired_bundle_size):
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py", line 698, in split
self.table_reference = self._execute_query(bq)
File "/usr/local/lib/python2.7/site-packages/apache_beam/options/value_provider.py", line 135, in _f
return fnc(self, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py", line 744, in _execute_query
job_labels=self.bigquery_job_labels)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 249, in wrapper
raise_with_traceback(exn, exn_traceback)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 236, in wrapper
return fun(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery_tools.py", line 415, in _start_query_job
labels=job_labels or {},
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 973, in __setattr__
object.__setattr__(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 1651, in __set__
value = t(**value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 976, in __setattr__
"to message %s" % (name, type(self).__name__))
AttributeError: May not assign arbitrary value owner to message LabelsValue
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:31:43.660Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:31:59.609Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/batchworker.py", line 647, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 226, in execute
self._split_task)
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 234, in _perform_source_split_considering_api_limits
desired_bundle_size)
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 271, in _perform_source_split
for split in source.split(desired_bundle_size):
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py", line 698, in split
self.table_reference = self._execute_query(bq)
File "/usr/local/lib/python2.7/site-packages/apache_beam/options/value_provider.py", line 135, in _f
return fnc(self, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py", line 744, in _execute_query
job_labels=self.bigquery_job_labels)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 249, in wrapper
raise_with_traceback(exn, exn_traceback)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 236, in wrapper
return fun(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery_tools.py", line 415, in _start_query_job
labels=job_labels or {},
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 973, in __setattr__
object.__setattr__(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 1651, in __set__
value = t(**value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 976, in __setattr__
"to message %s" % (name, type(self).__name__))
AttributeError: May not assign arbitrary value owner to message LabelsValue
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:26.940Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/batchworker.py", line 647, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 226, in execute
self._split_task)
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 234, in _perform_source_split_considering_api_limits
desired_bundle_size)
File "/usr/local/lib/python2.7/site-packages/dataflow_worker/executor.py", line 271, in _perform_source_split
for split in source.split(desired_bundle_size):
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py", line 698, in split
self.table_reference = self._execute_query(bq)
File "/usr/local/lib/python2.7/site-packages/apache_beam/options/value_provider.py", line 135, in _f
return fnc(self, *args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py", line 744, in _execute_query
job_labels=self.bigquery_job_labels)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 249, in wrapper
raise_with_traceback(exn, exn_traceback)
File "/usr/local/lib/python2.7/site-packages/apache_beam/utils/retry.py", line 236, in wrapper
return fun(*args, **kwargs)
File "/usr/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery_tools.py", line 415, in _start_query_job
labels=job_labels or {},
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 973, in __setattr__
object.__setattr__(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 1651, in __set__
value = t(**value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 791, in __init__
setattr(self, name, value)
File "/usr/local/lib/python2.7/site-packages/apitools/base/protorpclite/messages.py", line 976, in __setattr__
"to message %s" % (name, type(self).__name__))
AttributeError: May not assign arbitrary value owner to message LabelsValue
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:27.201Z: JOB_MESSAGE_BASIC: Finished operation read/Read+read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:27.257Z: JOB_MESSAGE_DEBUG: Executing failure step failure21
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:27.280Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S02:read/Read+read/_PassThroughThenCleanup/ParDo(PassThrough)/ParDo(PassThrough)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write failed., Internal Issue (39d0242752494afd): 63963027:24514
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:27.368Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:27.475Z: JOB_MESSAGE_DETAILED: Cleaning up.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:27.637Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:32:27.695Z: JOB_MESSAGE_BASIC: Stopping worker pool...
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:34:23.171Z: JOB_MESSAGE_DETAILED: Autoscaling: Resized worker pool from 1 to 0.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:34:23.202Z: JOB_MESSAGE_BASIC: Worker pool stopped.
apache_beam.runners.dataflow.dataflow_runner: INFO: 2020-05-13T18:34:23.243Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
apache_beam.runners.dataflow.dataflow_runner: INFO: Job 2020-05-13_11_25_36-17494548559126980755 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-postCommitIT-df.xml
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 58 tests in 3981.498s
FAILED (SKIP=7, errors=1)
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_03-12726880775793888389?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_15_00-3636237586550157474?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_23_48-16587310898488313118?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_33_03-4011421439589770031?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_42_18-7902333353469951327?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_49_44-12860062043643574562?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_57_28-12001277096359962017?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_12_05_12-5453704622869837830?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_10-1130123240120714388?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_21_22-7952288068960190033?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_29_33-15879669694484040597?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_37_28-9663988256602584465?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_45_20-7432008153465420148?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_53_16-756500190521098042?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_04-12723342796582226267?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_29_47-6238760674697352968?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_38_58-3167473620713412667?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_56_14-15126713189659938997?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_10-13631109016872789495?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_19_51-7872292617774832005?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_27_42-1887130654703860114?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_35_41-18131193908148576000?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_43_45-13879467978289341337?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_52_10-111461474311280749?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_04-6254074719981921801?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_27_03-3541797969869545793?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_35_41-6303128327851146438?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_44_07-9609347869885757810?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_51_31-2306096985362102933?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_59_19-11840333539250271117?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_05-17860298511056324566?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_15_57-4980851260701477752?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_24_42-9227039144366109492?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_32_41-6837689201689375312?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_41_39-8094634643123302744?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_49_35-13290983863164480489?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_57_12-18013229850102701817?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_05-13062460456198035053?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_16_15-3536384862329333545?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_25_36-17494548559126980755?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_34_50-8596993233311950669?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_42_46-7596086402965110376?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_51_08-413368314999347716?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_59_53-12987334211177893839?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_07_06-10442400009833631042?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_16_57-16269324763395064465?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_26_47-4270412537921802380?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_35_25-8125094544627669673?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_42_57-5375416899474361682?project=apache-beam-testing
Worker logs: https://console.cloud.google.com/dataflow/jobs/us-central1/2020-05-13_11_51_23-15120299389463275627?project=apache-beam-testing
> Task :sdks:python:test-suites:dataflow:py2:postCommitIT FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 131
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py2:postCommitPy2IT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/test-suites/direct/py2/build.gradle'> line: 50
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py2:directRunnerIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python2/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 116
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py2:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 8m 5s
123 actionable tasks: 96 executed, 25 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ijvdp4c4j7ssk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python2 #2419
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python2/2419/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org