You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/09/25 22:10:54 UTC
Build failed in Jenkins: beam_PostCommit_Python_Verify #6085
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6085/display/redirect?page=changes>
Changes:
[qinyeli] Interactive Beam -- read_cache_ids and write_cache_ids
[qinyeli] Interactive Beam -- renaming variables and functions
[qinyeli] Interactive Beam -- fixing PTransform # display issue
[ehudm] GCSIO: Allow empty object prefix in list_prefix().
[migryz] Add metrics dashboard deployment script and logic
[migryz] Fix rat issues
------------------------------------------
[...truncated 1.12 MB...]
test_proto_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_singleton_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_timestamp_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_tuple_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_tuple_sequence_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_utf8_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_varint_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_windowed_value_coder (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_windowedvalue_coder_paneinfo (apache_beam.coders.slow_coders_test.transplant_class.<locals>.C) ... ok
test_using_slow_impl (apache_beam.coders.slow_coders_test.SlowCoders) ... ok
test_standard_coders (apache_beam.coders.standard_coders_test.StandardCodersTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/coders/standard_coders_test.py>:50: ResourceWarning: unclosed file <_io.TextIOWrapper name='<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/coders/../testing/data/standard_coders.yaml'> mode='r' encoding='UTF-8'>
for ix, spec in enumerate(yaml.load_all(open(test_yaml))):
ok
test_byte_counting (apache_beam.coders.stream_test.StreamTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/coders/stream_test.py>:131: DeprecationWarning: Please use assertEqual instead.
self.assertEquals(0, bc_s.get_count())
ok
test_large_var_int64 (apache_beam.coders.stream_test.StreamTest) ... ok
test_medium_var_int64 (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_all (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_write (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_write_bigendian_int32 (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_write_bigendian_int64 (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_write_bigendian_uint64 (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_write_byte (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_write_double (apache_beam.coders.stream_test.StreamTest) ... ok
test_read_write_large (apache_beam.coders.stream_test.StreamTest) ... ok
test_small_var_int64 (apache_beam.coders.stream_test.StreamTest) ... ok
test_dataflow_job_file (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_display_data (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_experiments (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_extra_package (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_from_dictionary (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_get_all_options (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... /usr/lib/python3.5/unittest/case.py:1116: DeprecationWarning: assertDictContainsSubset is deprecated
DeprecationWarning)
ok
test_option_with_space (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_override_options (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_redefine_options (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_template_location (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_value_provider_options (apache_beam.options.pipeline_options_test.PipelineOptionsTest) ... ok
test_dataflow_job_file_and_template_location_mutually_exclusive (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_gcs_path (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_is_service_runner (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_job_name (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_local_runner (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_missing_required_options (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_num_workers (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_project (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_test_matcher (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_validate_dataflow_job_file (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_validate_template_location (apache_beam.options.pipeline_options_validator_test.SetupTest) ... ok
test_choices (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_experiments_options_setup (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_experiments_setup (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_runtime_value_provider_keyword_argument (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_runtime_value_provider_positional_argument (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_set_runtime_option (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_static_value_provider_choices (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_static_value_provider_keyword_argument (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_static_value_provider_positional_argument (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_static_value_provider_type_cast (apache_beam.options.value_provider_test.ValueProviderTests) ... ok
test_coders_microbenchmark (apache_beam.tools.microbenchmarks_test.MicrobenchmarksTest) ... ok
test_deprecated_with_since_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_with_since_current_message (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_without_since_should_fail (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_with_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_with_current_message (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
Tests that the filter 'once' is sufficient to print once per ... ok
test_equal_objects (apache_beam.utils.counters_test.CounterNameTest) ... ok
test_hash_two_objects (apache_beam.utils.counters_test.CounterNameTest) ... ok
test_name_string_representation (apache_beam.utils.counters_test.CounterNameTest) ... ok
test_method_forwarding_not_windows (apache_beam.utils.processes_test.Exec) ... ok
test_method_forwarding_windows (apache_beam.utils.processes_test.Exec) ... ok
test_call_two_objects (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_single_failure (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_two_failures (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_log_calls_for_permanent_failure (apache_beam.utils.retry_test.RetryTest) ... ok
test_log_calls_for_transient_failure (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_default_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_decorator (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_initial_delay (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_http_error_that_should_be_retried (apache_beam.utils.retry_test.RetryTest) ... SKIP: google-apitools is not installed
test_with_http_error_that_should_not_be_retried (apache_beam.utils.retry_test.RetryTest) ... SKIP: google-apitools is not installed
test_with_no_retry_decorator (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_real_clock (apache_beam.utils.retry_test.RetryTest) ... ok
test_arithmetic (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_of (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_precision (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_sort_order (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_str (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_arithmetic (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_from_rfc3339 (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_from_rfc3339_failure (apache_beam.utils.timestamp_test.TimestampTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/utils/timestamp_test.py>:69: DeprecationWarning: Please use assertRaisesRegex instead.
with self.assertRaisesRegexp(ValueError, 'parse'):
ok
test_from_utc_datetime (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_of (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_precision (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_sort_order (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_str (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_utc_timestamp (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_equality (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_hash (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_pickle (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_timestamps (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_with_value (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_false_from (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_false_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_float_from (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_float_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_int_from (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_int_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_large_integer (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_long_value (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_none_from (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_none_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_runtime_value_provider_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_static_value_provider_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_string_from (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_string_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_too_long_value (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_true_from (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_true_to (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_with_type (apache_beam.internal.gcp.json_value_test.JsonValueTest) ... SKIP: GCP dependencies are not installed
test_basics (apache_beam.internal.pickler_test.PicklerTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/internal/pickler_test.py>:32: DeprecationWarning: Please use assertEqual instead.
self.assertEquals([1, 'a', (u'z',)], loads(dumps([1, 'a', (u'z',)])))
ok
Tests that a class object is pickled correctly. ... ok
Tests that a nested class object is pickled correctly. ... ok
test_generators (apache_beam.internal.pickler_test.PicklerTest) ... ok
Tests that the closure of a function is preserved. ... ok
Tests that the globals of a function are preserved. ... ok
test_lambda_with_main_globals (apache_beam.internal.pickler_test.PicklerTest) ... ok
Tests that a nested class object is pickled correctly. ... ok
Tests that a class instance is pickled correctly. ... ok
test_recursive_class (apache_beam.internal.pickler_test.PicklerTest) ... ok
test_insert_values_in_args (apache_beam.internal.util_test.UtilTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/internal/util_test.py>:49: DeprecationWarning: Please use assertEqual instead.
self.assertEquals([1, 'a'], args)
ok
test_insert_values_in_args_nothing_to_insert (apache_beam.internal.util_test.UtilTest) ... ok
test_remove_objects_from_args (apache_beam.internal.util_test.UtilTest) ... ok
test_remove_objects_from_args_nothing_to_remove (apache_beam.internal.util_test.UtilTest) ... ok
test_basic_path (apache_beam.metrics.cells_test.TestCellCommitState) ... ok
test_basic_operations (apache_beam.metrics.cells_test.TestCounterCell) ... ok
test_parallel_access (apache_beam.metrics.cells_test.TestCounterCell) ... ok
test_basic_operations (apache_beam.metrics.cells_test.TestDistributionCell) ... ok
test_integer_only (apache_beam.metrics.cells_test.TestDistributionCell) ... ok
test_parallel_access (apache_beam.metrics.cells_test.TestDistributionCell) ... ok
test_basic_operations (apache_beam.metrics.cells_test.TestGaugeCell) ... ok
test_combine_appropriately (apache_beam.metrics.cells_test.TestGaugeCell) ... ok
test_integer_only (apache_beam.metrics.cells_test.TestGaugeCell) ... ok
test_add_to_counter (apache_beam.metrics.execution_test.TestMetricsContainer) ... ok
test_create_new_counter (apache_beam.metrics.execution_test.TestMetricsContainer) ... ok
test_get_cumulative_or_updates (apache_beam.metrics.execution_test.TestMetricsContainer) ... ok
test_metric_filter_name_matching (apache_beam.metrics.metric_test.MetricResultsTest) ... ok
test_metric_filter_namespace_matching (apache_beam.metrics.metric_test.MetricResultsTest) ... ok
test_metric_filter_step_matching (apache_beam.metrics.metric_test.MetricResultsTest) ... ok
test_counter_empty_name (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_counter_empty_namespace (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_create_counter_distribution (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_distribution_empty_name (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_distribution_empty_namespace (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_get_namespace_class (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_get_namespace_error (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_get_namespace_string (apache_beam.metrics.metric_test.MetricsTest) ... ok
test_basic_metric_name (apache_beam.metrics.metric_test.NameTest) ... ok
test_no_partial_writeouts (apache_beam.pipeline_test.DirectRunnerRetryTests) ... ok
test_retry_fork_graph (apache_beam.pipeline_test.DirectRunnerRetryTests) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/typehints/decorators.py>:123: DeprecationWarning: inspect.getargspec() is deprecated, use inspect.signature() instead
return _original_getargspec(func)
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/direct/direct_runner.py>:360: DeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
pipeline.replace_all(_get_transform_overrides(pipeline.options))
ok
test_element (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_no_tag (apache_beam.pipeline_test.DoFnTest) ... SKIP: This test still needs to be fixed on Python 3
test_side_input_tagged (apache_beam.pipeline_test.DoFnTest) ... SKIP: This test still needs to be fixed on Python 3
test_timestamp_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_timestamp_param_map (apache_beam.pipeline_test.DoFnTest) ... ok
test_window_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_attribute_setting (apache_beam.pipeline_test.PipelineOptionsTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline_test.py>:501: DeprecationWarning: Please use assertEqual instead.
self.assertEquals(10, options.slices)
ok
test_defaults (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_dir (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_flag_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_keyword_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_view_as (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_aggregator_empty_input (apache_beam.pipeline_test.PipelineTest) ... ok
test_apply_custom_transform (apache_beam.pipeline_test.PipelineTest) ... ok
test_create (apache_beam.pipeline_test.PipelineTest) ... ok
test_create_singleton_pcollection (apache_beam.pipeline_test.PipelineTest) ... ok
test_fake_read (apache_beam.pipeline_test.PipelineTest) ... ok
test_flatmap_builtin (apache_beam.pipeline_test.PipelineTest) ... ok
test_memory_usage (apache_beam.pipeline_test.PipelineTest) ... ok
test_metrics_in_fake_source (apache_beam.pipeline_test.PipelineTest) ... ok
test_pipeline_as_context (apache_beam.pipeline_test.PipelineTest) ... ok
test_ptransform_override_type_hints (apache_beam.pipeline_test.PipelineTest) ... ok
test_ptransform_overrides (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_cloned_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... ok
test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... ok
test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok
test_parent_pointer (apache_beam.pipeline_test.RunnerApiTest) ... ok
test_assingleton_multi_element (apache_beam.pvalue_test.PValueTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pvalue_test.py>:40: DeprecationWarning: Please use assertRaisesRegex instead.
'PCollection of size 2 with more than one element accessed as a '
ok
test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok
test_passed_tuple_as_tag (apache_beam.pvalue_test.TaggedValueTest) ... ok
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 233 tests in 11.725s
OK (SKIP=22)
py3 runtests: commands[4] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
py3: commands succeeded
congratulations :)
:beam-sdks-python:testPython3 (Thread[Task worker for ':',5,main]) completed. Took 29.487 secs.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 102
* What went wrong:
Execution failed for task ':beam-sdks-python:lintPy27_3'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 53s
13 actionable tasks: 13 executed
Publishing build scan...
https://gradle.com/s/joovcayg6ax2c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Jenkins build is back to normal : beam_PostCommit_Python_Verify
#6088
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6088/display/redirect?page=changes>
Build failed in Jenkins: beam_PostCommit_Python_Verify #6087
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6087/display/redirect>
------------------------------------------
[...truncated 1.28 MB...]
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1068, in <lambda>
wrapper = lambda x: [fn(x)]
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/portability/portable_runner_test.py",> line 182, in raise_error
raise RuntimeError('x')
RuntimeError: x
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 131, in _execute
response = task()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 166, in <lambda>
self._execute(lambda: worker.do_instruction(work), work)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 212, in do_instruction
request.instruction_id)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 234, in process_bundle
processor.process_bundle(instruction_id)
File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
self.gen.throw(type, value, traceback)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 349, in process_instruction_id
yield
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 234, in process_bundle
processor.process_bundle(instruction_id)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 387, in process_bundle
input_op.process_encoded(data.data)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 123, in process_encoded
self.output(decoded_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 167, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 268, in process
self.output(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 167, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 414, in process
self.dofn_receiver.receive(o)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 673, in receive
self.process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 679, in process
self._reraise_augmented(exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 787, in process_outputs
self.main_receivers.receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 414, in process
self.dofn_receiver.receive(o)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 673, in receive
self.process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 679, in process
self._reraise_augmented(exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 787, in process_outputs
self.main_receivers.receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 414, in process
self.dofn_receiver.receive(o)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 673, in receive
self.process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 679, in process
self._reraise_augmented(exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 717, in _reraise_augmented
raise_with_traceback(new_exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3/lib/python3.5/site-packages/future/utils/__init__.py",> line 419, in raise_with_traceback
raise exc.with_traceback(traceback)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1068, in <lambda>
wrapper = lambda x: [fn(x)]
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/portability/portable_runner_test.py",> line 182, in raise_error
raise RuntimeError('x')
RuntimeError: x [while running 'StageC']
ok
test_error_traceback_includes_user_code (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: TODO
test_flatten (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_flattened_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_gbk_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_group_by_key (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_large_elements (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: Metrics not supported.
test_multimap_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_no_subtransform_composite (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: Metrics are not supported.
test_pardo_side_and_main_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_pardo_side_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo_state_only (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: User state not supported.
test_pardo_unfusable_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_pardo_windowed_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_progress_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: Progress metrics not supported.
test_read (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_windowing (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_assert_that (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_combine_per_key (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_create (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_error_message_includes_stage (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_error_traceback_includes_user_code (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_flatten (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_flattened_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_gbk_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_group_by_key (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_large_elements (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_multimap_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_no_subtransform_composite (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_side_and_main_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_side_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_state_only (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_unfusable_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_windowed_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_progress_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_read (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_windowing (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_stage_multiple_files (apache_beam.runners.portability.portable_stager_test.PortableStagerTest) ... ok
test_stage_single_file (apache_beam.runners.portability.portable_stager_test.PortableStagerTest) ... ok
test_default_resources (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_no_main_session (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_no_staging_location (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_requirements_file_not_present (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_default (apache_beam.runners.portability.stager_test.StagerTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/portability/stager.py>:487: DeprecationWarning: The 'warn' function is deprecated, use 'warning' instead
'of the SDK: %s', repr(e))
ok
test_sdk_location_default_with_wheels (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_http (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_directory (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_directory_not_present (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_source_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_wheel_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_remote_source_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_remote_wheel_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_setup_file_not_named_setup_dot_py (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_setup_file_not_present (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_extra_packages (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_extra_packages_invalid_file_name (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_extra_packages_missing_files (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_main_session (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_requirements_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_requirements_file_and_cache (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_setup_file (apache_beam.runners.portability.stager_test.StagerTest) ... SKIP: This test still needs to be fixed on Python 3
test_in_memory_data_channel (apache_beam.runners.worker.data_plane_test.DataChannelTest) ... ok
test_basic_record (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_exception_record (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_nested_with_per_thread_info (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_record_with_arbitrary_messages (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_record_with_format_character (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_record_with_per_thread_info (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_per_thread_attribute (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok
test_set_when_already_defined (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok
test_set_when_undefined (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok
test_should_sample (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... SKIP: This test still needs to be fixed on Python 3
test_update_int (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_multiple (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_new_object (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_old_object (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_str (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_basic_counters (apache_beam.runners.worker.opcounters_test.TransformIoCounterTest) ... ok
test_parse_pipeine_options (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok
test_status_server (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main_test.py>:52: DeprecationWarning: Please use assertRegex instead.
self.assertRegexpMatches(threaddump, '.*wrapped_method_for_test.*')
ok
test_work_count_custom_value (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main_test.py>:128: DeprecationWarning: Please use assertEqual instead.
expected)
ok
test_work_count_default_value (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok
test_work_count_wrong_format (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok
test_fn_registration (apache_beam.runners.worker.sdk_worker_test.SdkWorkerTest) ... ok
test_emulated_iterable (apache_beam.runners.worker.sideinputs_test.EmulatedCollectionsTest) ... ok
test_large_iterable_values (apache_beam.runners.worker.sideinputs_test.EmulatedCollectionsTest) ... ok
test_bytes_read_are_reported (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_multiple_sources_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_multiple_sources_single_reader_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_single_source_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_source_iterator_fn_exception (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_source_iterator_single_source_exception (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_basic_sampler (apache_beam.runners.worker.statesampler_test.StateSamplerTest) ... ok
test_sampler_transition_overhead (apache_beam.runners.worker.statesampler_test.StateSamplerTest) ... ok
test_failure_when_worker_id_exists (apache_beam.runners.worker.worker_id_interceptor_test.WorkerIdInterceptorTest) ... ok
test_worker_id_insertion (apache_beam.runners.worker.worker_id_interceptor_test.WorkerIdInterceptorTest) ... ok
test_dofn_validate_finish_bundle_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok
test_dofn_validate_process_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok
test_dofn_validate_start_bundle_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok
test_deduplication (apache_beam.runners.pipeline_context_test.PipelineContextTest) ... ok
test_serialization (apache_beam.runners.pipeline_context_test.PipelineContextTest) ... ok
test_create_runner (apache_beam.runners.runner_test.RunnerTest) ... ok
test_create_runner_shorthand (apache_beam.runners.runner_test.RunnerTest) ... ok
test_direct_runner_metrics (apache_beam.runners.runner_test.RunnerTest) ... ok
test_run_api (apache_beam.runners.runner_test.RunnerTest) ... ok
test_run_api_with_callable (apache_beam.runners.runner_test.RunnerTest) ... ok
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 537 tests in 75.819s
OK (SKIP=140)
py3 runtests: commands[4] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
py3: commands succeeded
congratulations :)
:beam-sdks-python:testPython3 (Thread[Task worker for ':',5,main]) completed. Took 1 mins 34.444 secs.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 102
* What went wrong:
Execution failed for task ':beam-sdks-python:lintPy27_3'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 6m 2s
13 actionable tasks: 13 executed
Publishing build scan...
https://gradle.com/s/l2gaqioaynurm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Build failed in Jenkins: beam_PostCommit_Python_Verify #6086
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/6086/display/redirect?page=changes>
Changes:
[aaltay] [BEAM-5319] Partially port runners (#6451)
------------------------------------------
[...truncated 1.28 MB...]
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1068, in <lambda>
wrapper = lambda x: [fn(x)]
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/portability/portable_runner_test.py",> line 182, in raise_error
raise RuntimeError('x')
RuntimeError: x
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 131, in _execute
response = task()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 166, in <lambda>
self._execute(lambda: worker.do_instruction(work), work)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 212, in do_instruction
request.instruction_id)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 234, in process_bundle
processor.process_bundle(instruction_id)
File "/usr/lib/python3.5/contextlib.py", line 77, in __exit__
self.gen.throw(type, value, traceback)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 349, in process_instruction_id
yield
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py",> line 234, in process_bundle
processor.process_bundle(instruction_id)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 387, in process_bundle
input_op.process_encoded(data.data)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py",> line 123, in process_encoded
self.output(decoded_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 167, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 268, in process
self.output(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 167, in output
cython.cast(Receiver, self.receivers[output_index]).receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 414, in process
self.dofn_receiver.receive(o)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 673, in receive
self.process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 679, in process
self._reraise_augmented(exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 787, in process_outputs
self.main_receivers.receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 414, in process
self.dofn_receiver.receive(o)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 673, in receive
self.process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 679, in process
self._reraise_augmented(exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 787, in process_outputs
self.main_receivers.receive(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 87, in receive
cython.cast(Operation, consumer).process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/operations.py",> line 414, in process
self.dofn_receiver.receive(o)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 673, in receive
self.process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 679, in process
self._reraise_augmented(exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 717, in _reraise_augmented
raise_with_traceback(new_exn)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3/lib/python3.5/site-packages/future/utils/__init__.py",> line 419, in raise_with_traceback
raise exc.with_traceback(traceback)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 677, in process
self.do_fn_invoker.invoke_process(windowed_value)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/common.py",> line 414, in invoke_process
windowed_value, self.process_method(windowed_value.value))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/core.py",> line 1068, in <lambda>
wrapper = lambda x: [fn(x)]
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/portability/portable_runner_test.py",> line 182, in raise_error
raise RuntimeError('x')
RuntimeError: x [while running 'StageC']
ok
test_error_traceback_includes_user_code (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: TODO
test_flatten (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_flattened_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_gbk_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_group_by_key (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_large_elements (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: Metrics not supported.
test_multimap_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_no_subtransform_composite (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: Metrics are not supported.
test_pardo_side_and_main_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_pardo_side_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_pardo_state_only (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: User state not supported.
test_pardo_unfusable_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_pardo_windowed_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: This test still needs to be fixed on Python 3
test_progress_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... SKIP: Progress metrics not supported.
test_read (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_windowing (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithGrpc) ... ok
test_assert_that (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_combine_per_key (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_create (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_error_message_includes_stage (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_error_traceback_includes_user_code (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_flatten (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_flattened_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_gbk_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_group_by_key (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_large_elements (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_multimap_side_input (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_no_subtransform_composite (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_side_and_main_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_side_outputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_state_only (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_unfusable_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_pardo_windowed_side_inputs (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_progress_metrics (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_read (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_windowing (apache_beam.runners.portability.portable_runner_test.PortableRunnerTestWithSubprocesses) ... SKIP: BEAM-3040
test_stage_multiple_files (apache_beam.runners.portability.portable_stager_test.PortableStagerTest) ... ok
test_stage_single_file (apache_beam.runners.portability.portable_stager_test.PortableStagerTest) ... ok
test_default_resources (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_no_main_session (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_no_staging_location (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_requirements_file_not_present (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_default (apache_beam.runners.portability.stager_test.StagerTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/portability/stager.py>:487: DeprecationWarning: The 'warn' function is deprecated, use 'warning' instead
'of the SDK: %s', repr(e))
ok
test_sdk_location_default_with_wheels (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_http (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_directory (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_directory_not_present (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_source_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_local_wheel_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_remote_source_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_sdk_location_remote_wheel_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_setup_file_not_named_setup_dot_py (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_setup_file_not_present (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_extra_packages (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_extra_packages_invalid_file_name (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_extra_packages_missing_files (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_main_session (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_requirements_file (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_requirements_file_and_cache (apache_beam.runners.portability.stager_test.StagerTest) ... ok
test_with_setup_file (apache_beam.runners.portability.stager_test.StagerTest) ... SKIP: This test still needs to be fixed on Python 3
test_in_memory_data_channel (apache_beam.runners.worker.data_plane_test.DataChannelTest) ... ok
test_basic_record (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_exception_record (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_nested_with_per_thread_info (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_record_with_arbitrary_messages (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_record_with_format_character (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_record_with_per_thread_info (apache_beam.runners.worker.logger_test.JsonLogFormatterTest) ... ok
test_per_thread_attribute (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok
test_set_when_already_defined (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok
test_set_when_undefined (apache_beam.runners.worker.logger_test.PerThreadLoggingContextTest) ... ok
test_should_sample (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... SKIP: This test still needs to be fixed on Python 3
test_update_int (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_multiple (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_new_object (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_old_object (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_update_str (apache_beam.runners.worker.opcounters_test.OperationCountersTest) ... ok
test_basic_counters (apache_beam.runners.worker.opcounters_test.TransformIoCounterTest) ... ok
test_parse_pipeine_options (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok
test_status_server (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main_test.py>:52: DeprecationWarning: Please use assertRegex instead.
self.assertRegexpMatches(threaddump, '.*wrapped_method_for_test.*')
ok
test_work_count_custom_value (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker_main_test.py>:128: DeprecationWarning: Please use assertEqual instead.
expected)
ok
test_work_count_default_value (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok
test_work_count_wrong_format (apache_beam.runners.worker.sdk_worker_main_test.SdkWorkerMainTest) ... ok
test_fn_registration (apache_beam.runners.worker.sdk_worker_test.SdkWorkerTest) ... ok
test_emulated_iterable (apache_beam.runners.worker.sideinputs_test.EmulatedCollectionsTest) ... ok
test_large_iterable_values (apache_beam.runners.worker.sideinputs_test.EmulatedCollectionsTest) ... ok
test_bytes_read_are_reported (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_multiple_sources_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_multiple_sources_single_reader_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_single_source_iterator_fn (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_source_iterator_fn_exception (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_source_iterator_single_source_exception (apache_beam.runners.worker.sideinputs_test.PrefetchingSourceIteratorTest) ... ok
test_basic_sampler (apache_beam.runners.worker.statesampler_test.StateSamplerTest) ... ok
test_sampler_transition_overhead (apache_beam.runners.worker.statesampler_test.StateSamplerTest) ... ok
test_failure_when_worker_id_exists (apache_beam.runners.worker.worker_id_interceptor_test.WorkerIdInterceptorTest) ... ok
test_worker_id_insertion (apache_beam.runners.worker.worker_id_interceptor_test.WorkerIdInterceptorTest) ... ok
test_dofn_validate_finish_bundle_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok
test_dofn_validate_process_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok
test_dofn_validate_start_bundle_error (apache_beam.runners.common_test.DoFnSignatureTest) ... ok
test_deduplication (apache_beam.runners.pipeline_context_test.PipelineContextTest) ... ok
test_serialization (apache_beam.runners.pipeline_context_test.PipelineContextTest) ... ok
test_create_runner (apache_beam.runners.runner_test.RunnerTest) ... ok
test_create_runner_shorthand (apache_beam.runners.runner_test.RunnerTest) ... ok
test_direct_runner_metrics (apache_beam.runners.runner_test.RunnerTest) ... ok
test_run_api (apache_beam.runners.runner_test.RunnerTest) ... ok
test_run_api_with_callable (apache_beam.runners.runner_test.RunnerTest) ... ok
----------------------------------------------------------------------
XML: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 537 tests in 72.921s
OK (SKIP=140)
py3 runtests: commands[4] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
py3: commands succeeded
congratulations :)
:beam-sdks-python:testPython3 (Thread[Task worker for ':',5,main]) completed. Took 1 mins 31.18 secs.
FAILURE: Build failed with an exception.
* Where:
Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/build.gradle'> line: 102
* What went wrong:
Execution failed for task ':beam-sdks-python:lintPy27_3'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 5m 1s
13 actionable tasks: 13 executed
Publishing build scan...
https://gradle.com/s/uq7f3i3xvym5a
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure