You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/03/21 15:35:52 UTC
Build failed in Jenkins: beam_PostCommit_Python_Verify #4474
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4474/display/redirect>
------------------------------------------
[...truncated 1.12 MB...]
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2018-03-21T15:27:59.224524Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-03-21_08_27_57-9262512833116587506'
location: u'us-central1'
name: u'beamapp-jenkins-0321152756-466913'
projectId: u'apache-beam-testing'
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-21_08_27_57-9262512833116587506]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_08_27_57-9262512833116587506?project=apache-beam-testing
root: INFO: Job 2018-03-21_08_27_57-9262512833116587506 is in state JOB_STATE_PENDING
root: INFO: 2018-03-21T15:27:57.941Z: JOB_MESSAGE_WARNING: Job 2018-03-21_08_27_57-9262512833116587506 might autoscale up to 250 workers.
root: INFO: 2018-03-21T15:27:57.971Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-21_08_27_57-9262512833116587506. The number of workers will be between 1 and 250.
root: INFO: 2018-03-21T15:27:58.003Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-21_08_27_57-9262512833116587506.
root: INFO: 2018-03-21T15:28:00.899Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-21T15:28:01.065Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-21T15:28:01.343Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-21T15:28:01.367Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-21T15:28:01.389Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-21T15:28:01.411Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-21T15:28:01.435Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-21T15:28:01.468Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-21T15:28:01.496Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-21T15:28:01.518Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T15:28:01.541Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T15:28:01.558Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T15:28:01.574Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T15:28:01.598Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-21T15:28:01.621Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-21T15:28:01.641Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-21T15:28:01.660Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-21T15:28:01.672Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-21T15:28:01.685Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-21T15:28:01.704Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-21T15:28:01.726Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-21T15:28:01.738Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-21T15:28:01.763Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-21T15:28:01.774Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-21T15:28:01.795Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-21T15:28:01.817Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-21T15:28:01.834Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-21T15:28:01.857Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T15:28:01.869Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T15:28:01.906Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T15:28:01.946Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T15:28:01.970Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T15:28:01.989Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T15:28:02.010Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-21T15:28:02.030Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T15:28:02.058Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T15:28:02.082Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-21T15:28:02.102Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-21T15:28:02.122Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-21T15:28:02.143Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-21T15:28:02.253Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-21T15:28:02.297Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-21T15:28:02.320Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-21T15:28:02.332Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-21T15:28:02.342Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T15:28:02.356Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-21_08_27_57-9262512833116587506 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-21T15:28:11.963Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T15:28:12.128Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-21T15:28:12.149Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-21T15:28:12.196Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-21T15:28:17.286Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-21T15:28:29.503Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T15:28:29.523Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-21T15:28:41.729Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-21T15:28:45.360Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T15:32:48.319Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-21T15:32:48.339Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T15:32:48.352Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T15:32:48.374Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T15:32:48.394Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T15:32:48.417Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T15:32:48.438Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T15:32:48.471Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T15:32:48.530Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T15:32:48.552Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T15:32:58.112Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-21T15:32:58.150Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-21T15:33:01.528Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T15:33:04.915Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T15:33:08.299Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T15:33:11.683Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T15:33:11.727Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-21T15:33:11.761Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032115275-03210827-4ee9-harness-2xvq,
beamapp-jenkins-032115275-03210827-4ee9-harness-2xvq,
beamapp-jenkins-032115275-03210827-4ee9-harness-2xvq,
beamapp-jenkins-032115275-03210827-4ee9-harness-2xvq
root: INFO: 2018-03-21T15:33:11.880Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-21T15:33:11.921Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-21T15:33:11.955Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-21T15:35:10.804Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T15:35:11.150Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-21_08_27_57-9262512833116587506 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 473.671s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_08_27_57-13973811041455737982?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_08_27_56-17308336187412854497?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_08_27_57-9262512833116587506?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Jenkins build is back to normal : beam_PostCommit_Python_Verify
#4551
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4551/display/redirect>
Build failed in Jenkins: beam_PostCommit_Python_Verify #4550
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4550/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-3249] Allow for re-use of dependencies within other projects by
[boyuanz] Add distribution_counter_microbenchmark to apache_beam.tools.utils
------------------------------------------
[...truncated 1016.42 KB...]
copying apache_beam/runners/portability/universal_local_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/data/standard_coders.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/tools/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
Writing apache-beam-2.5.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.5.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run integration tests on the Google Cloud Dataflow service
# and validate that jobs finish successfully.
echo ">>> RUNNING TEST DATAFLOW RUNNER it tests"
>>> RUNNING TEST DATAFLOW RUNNER it tests
python setup.py nosetests \
--attr IT \
--nocapture \
--processes=4 \
--process-timeout=900 \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--staging_location=$GCS_LOCATION/staging-it \
--temp_location=$GCS_LOCATION/temp-it \
--output=$GCS_LOCATION/py-it-cloud/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--sleep_secs=20"
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/setuptools/dist.py>:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
running nosetests
running egg_info
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:743: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
transform_node.inputs[0].pipeline.options.view_as(StandardOptions))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_20_27_53-6004781185215055164?project=apache-beam-testing.
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ERROR
======================================================================
ERROR: test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 812, in run
test(orig)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 45, in __call__
return self.run(*arg, **kwarg)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 133, in run
self.runTest(result)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 151, in runTest
test(result)
File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__
return self.run(*args, **kwds)
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py",> line 113, in test_streaming_wordcount_it
self.test_pipeline.get_full_options_as_args(**extra_opts))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount.py",> line 92, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline.py",> line 402, in run
return self.runner.run_pipeline(self)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 58, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/assert_that.py",> line 43, in assert_that
_assert_match(actual=arg1, matcher=arg2, reason=arg3)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/assert_that.py",> line 55, in _assert_match
matcher.describe_mismatch(actual, description)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/core/allof.py",> line 25, in describe_mismatch
self.matches(item, mismatch_description)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/core/allof.py",> line 16, in matches
if not matcher.matches(item):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/base_matcher.py",> line 28, in matches
match_result = self._matches(item)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py",> line 81, in _matches
self.timeout)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py",> line 90, in _wait_for_messages
pulled = subscription.pull(max_messages=MAX_MESSAGES_IN_ONE_PULL)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/pubsub/subscription.py",> line 367, in pull
self.full_name, return_immediately, max_messages)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/pubsub/_gax.py",> line 440, in subscription_pull
return_immediately=return_immediately)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/gapic/pubsub/v1/subscriber_client.py",> line 706, in pull
return self._pull(request, options)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 452, in inner
return api_caller(api_call, this_settings, request)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 438, in base_caller
return api_call(*args)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 376, in inner
return a_func(*args, **kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/retry.py",> line 121, in inner
return to_call(*args)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/retry.py",> line 68, in inner
return a_func(*updated_args, **kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/grpc/_channel.py",> line 486, in __call__
credentials)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/grpc/_channel.py",> line 480, in _blocking
_handle_event(completion_queue.poll(), state,
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 276, in signalhandler
raise TimedOutException()
TimedOutException: 'test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT)'
----------------------------------------------------------------------
Ran 4 tests in 901.754s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_20_27_40-2053081329910483990?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_20_27_41-17869299411526392348?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_20_27_41-6788343534643819835?project=apache-beam-testing.
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4549
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4549/display/redirect>
------------------------------------------
[...truncated 1016.15 KB...]
copying apache_beam/runners/job/utils.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/data/standard_coders.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/tools/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
Writing apache-beam-2.5.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.5.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run integration tests on the Google Cloud Dataflow service
# and validate that jobs finish successfully.
echo ">>> RUNNING TEST DATAFLOW RUNNER it tests"
>>> RUNNING TEST DATAFLOW RUNNER it tests
python setup.py nosetests \
--attr IT \
--nocapture \
--processes=4 \
--process-timeout=900 \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--staging_location=$GCS_LOCATION/staging-it \
--temp_location=$GCS_LOCATION/temp-it \
--output=$GCS_LOCATION/py-it-cloud/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--sleep_secs=20"
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/setuptools/dist.py>:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
running nosetests
running egg_info
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:743: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
transform_node.inputs[0].pipeline.options.view_as(StandardOptions))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_44_02-9341975140510436042?project=apache-beam-testing.
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ERROR
======================================================================
ERROR: test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 812, in run
test(orig)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 45, in __call__
return self.run(*arg, **kwarg)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 133, in run
self.runTest(result)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 151, in runTest
test(result)
File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__
return self.run(*args, **kwds)
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py",> line 113, in test_streaming_wordcount_it
self.test_pipeline.get_full_options_as_args(**extra_opts))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount.py",> line 92, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline.py",> line 402, in run
return self.runner.run_pipeline(self)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 58, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/assert_that.py",> line 43, in assert_that
_assert_match(actual=arg1, matcher=arg2, reason=arg3)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/assert_that.py",> line 55, in _assert_match
matcher.describe_mismatch(actual, description)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/core/allof.py",> line 25, in describe_mismatch
self.matches(item, mismatch_description)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/core/allof.py",> line 16, in matches
if not matcher.matches(item):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/base_matcher.py",> line 28, in matches
match_result = self._matches(item)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py",> line 81, in _matches
self.timeout)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py",> line 90, in _wait_for_messages
pulled = subscription.pull(max_messages=MAX_MESSAGES_IN_ONE_PULL)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/pubsub/subscription.py",> line 367, in pull
self.full_name, return_immediately, max_messages)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/pubsub/_gax.py",> line 440, in subscription_pull
return_immediately=return_immediately)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/gapic/pubsub/v1/subscriber_client.py",> line 706, in pull
return self._pull(request, options)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 452, in inner
return api_caller(api_call, this_settings, request)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 438, in base_caller
return api_call(*args)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 376, in inner
return a_func(*args, **kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/retry.py",> line 135, in inner
time.sleep(to_sleep / _MILLIS_PER_SECOND)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 276, in signalhandler
raise TimedOutException()
TimedOutException: 'test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT)'
----------------------------------------------------------------------
Ran 4 tests in 901.325s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_43_52-13527892008758511651?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_43_52-8546107972197467192?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_43_52-16966293485223729253?project=apache-beam-testing.
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4548
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4548/display/redirect>
------------------------------------------
[...truncated 1.08 MB...]
copying apache_beam/runners/job/utils.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/data/standard_coders.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/tools/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
Writing apache-beam-2.5.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.5.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run integration tests on the Google Cloud Dataflow service
# and validate that jobs finish successfully.
echo ">>> RUNNING TEST DATAFLOW RUNNER it tests"
>>> RUNNING TEST DATAFLOW RUNNER it tests
python setup.py nosetests \
--attr IT \
--nocapture \
--processes=4 \
--process-timeout=900 \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--staging_location=$GCS_LOCATION/staging-it \
--temp_location=$GCS_LOCATION/temp-it \
--output=$GCS_LOCATION/py-it-cloud/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--sleep_secs=20"
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/setuptools/dist.py>:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
running nosetests
running egg_info
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:743: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
transform_node.inputs[0].pipeline.options.view_as(StandardOptions))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py>:49: DeprecationWarning: options is deprecated since First stable release.. References to <pipeline>.options will not be supported
print('Found: %s.' % self.build_console_url(pipeline.options))
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_00_45-9316448145584535552?project=apache-beam-testing.
test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT) ... ERROR
======================================================================
ERROR: test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 812, in run
test(orig)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 45, in __call__
return self.run(*arg, **kwarg)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 133, in run
self.runTest(result)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/case.py",> line 151, in runTest
test(result)
File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__
return self.run(*args, **kwds)
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py",> line 113, in test_streaming_wordcount_it
self.test_pipeline.get_full_options_as_args(**extra_opts))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount.py",> line 92, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline.py",> line 402, in run
return self.runner.run_pipeline(self)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 58, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/assert_that.py",> line 43, in assert_that
_assert_match(actual=arg1, matcher=arg2, reason=arg3)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/assert_that.py",> line 55, in _assert_match
matcher.describe_mismatch(actual, description)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/core/allof.py",> line 25, in describe_mismatch
self.matches(item, mismatch_description)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/core/allof.py",> line 16, in matches
if not matcher.matches(item):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/hamcrest/core/base_matcher.py",> line 28, in matches
match_result = self._matches(item)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py",> line 81, in _matches
self.timeout)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/pubsub_matcher.py",> line 90, in _wait_for_messages
pulled = subscription.pull(max_messages=MAX_MESSAGES_IN_ONE_PULL)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/pubsub/subscription.py",> line 367, in pull
self.full_name, return_immediately, max_messages)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/pubsub/_gax.py",> line 440, in subscription_pull
return_immediately=return_immediately)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/cloud/gapic/pubsub/v1/subscriber_client.py",> line 706, in pull
return self._pull(request, options)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 452, in inner
return api_caller(api_call, this_settings, request)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 438, in base_caller
return api_call(*args)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/api_callable.py",> line 376, in inner
return a_func(*args, **kwargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/google/gax/retry.py",> line 135, in inner
time.sleep(to_sleep / _MILLIS_PER_SECOND)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py",> line 276, in signalhandler
raise TimedOutException()
TimedOutException: 'test_streaming_wordcount_it (apache_beam.examples.streaming_wordcount_it_test.StreamingWordCountIT)'
----------------------------------------------------------------------
Ran 4 tests in 901.314s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_00_34-7360918190272255732?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_00_35-6634183406654185572?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-30_19_00_35-6447135140435672752?project=apache-beam-testing.
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4547
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4547/display/redirect>
------------------------------------------
[...truncated 291.27 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-31 00:29:49.657561
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-31 00:29:50.209306
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-31 00:29:50.352455
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-31 00:29:50.366336
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-31 00:29:50.381745
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-31 00:29:50.467310
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-31 00:29:50.735394
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-31 00:29:50.764264
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-31 00:29:50.879186
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-31 00:29:50.918781
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
345.95user 6.71system 2:11.22elapsed 268%CPU (0avgtext+0avgdata 248684maxresident)k
0inputs+168outputs (0major+636924minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1012932711'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
30.23user 0.29system 0:10.27elapsed 297%CPU (0avgtext+0avgdata 66252maxresident)k
0inputs+0outputs (0major+88223minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4546
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4546/display/redirect>
------------------------------------------
[...truncated 291.07 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 23:26:10.697928
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 23:26:12.877420
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 23:26:13.254729
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 23:26:13.281832
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 23:26:13.311403
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 23:26:13.637509
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 23:26:14.516240
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 23:26:14.605611
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 23:26:15.090165
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 23:26:15.223065
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
358.26user 11.80system 3:50.66elapsed 160%CPU (0avgtext+0avgdata 240604maxresident)k
8inputs+168outputs (0major+639761minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='332607943'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
37.87user 0.89system 0:32.95elapsed 117%CPU (0avgtext+0avgdata 66088maxresident)k
0inputs+0outputs (0major+87846minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4545
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4545/display/redirect>
------------------------------------------
[...truncated 984.20 KB...]
test_compatibility (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_getitem_param_must_be_tuple (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_getitem_param_must_have_length_2 (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_key_type_must_be_valid_composite_param (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_match_type_variables (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_invalid_key_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_invalid_value_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_valid_composite_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_valid_simple_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_checks_not_dict (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_value_type_must_be_valid_composite_param (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_compatibility (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_generator_argument_hint_invalid_yield_type (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_generator_return_hint_invalid_yield_type (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_compatibility (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_tuple_compatibility (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_must_be_iterable (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_invalid_composite_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_invalid_simple_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_valid_composite_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_valid_simple_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_enforce_kv_type_constraint (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_getitem_param_must_be_tuple (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_getitem_param_must_have_length_2 (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_getitem_proxy_to_tuple (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_enforce_list_type_constraint_invalid_composite_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_enforce_list_type_constraint_invalid_simple_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_enforce_list_type_constraint_valid_composite_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_enforce_list_type_constraint_valid_simple_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_list_constraint_compatibility (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_list_repr (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_getitem_proxy_to_union (apache_beam.typehints.typehints_test.OptionalHintTestCase) ... ok
test_getitem_sequence_not_allowed (apache_beam.typehints.typehints_test.OptionalHintTestCase) ... ok
test_any_return_type_hint (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_must_be_primitive_type_or_type_constraint (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_must_be_single_return_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_no_kwargs_accepted (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_type_check_composite_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_type_check_simple_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_type_check_violation (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_compatibility (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_invalid_elem_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_must_be_set (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_valid_elem_composite_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_valid_elem_simple_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_any_argument_type_hint (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_basic_type_assertion (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_composite_type_assertion (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_invalid_only_positional_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_must_be_primitive_type_or_constraint (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_valid_mix_positional_and_keyword_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_valid_only_positional_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_valid_simple_type_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_functions_as_regular_generator (apache_beam.typehints.typehints_test.TestGeneratorWrapper) ... ok
test_compatibility (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_compatibility_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_getitem_invalid_ellipsis_type_param (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_getitem_params_must_be_type_or_constraint (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_raw_tuple (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_composite_type (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_composite_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_simple_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_simple_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_must_be_tuple (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_must_have_same_arity (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_composite_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_composite_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_simple_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_simple_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_getitem_duplicates_ignored (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_getitem_must_be_valid_type_param (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_getitem_must_be_valid_type_param_cant_be_object_instance (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_getitem_nested_unions_flattened (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_nested_compatibility (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_compatibility (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_enforcement_composite_type_in_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_enforcement_not_part_of_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_enforcement_part_of_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_repr (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_deprecated_with_since_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_with_since_current_message (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_without_since_should_fail (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_with_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_with_current_message (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_frequency (apache_beam.utils.annotations_test.AnnotationTests)
Tests that the filter 'once' is sufficient to print once per ... ok
test_equal_objects (apache_beam.utils.counters_test.CounterNameTest) ... ok
test_hash_two_objects (apache_beam.utils.counters_test.CounterNameTest) ... ok
test_method_forwarding_not_windows (apache_beam.utils.processes_test.Exec) ... ok
test_method_forwarding_windows (apache_beam.utils.processes_test.Exec) ... ok
test_call_two_objects (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_single_failure (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_two_failures (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_log_calls_for_permanent_failure (apache_beam.utils.retry_test.RetryTest) ... ok
test_log_calls_for_transient_failure (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_default_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_decorator (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_initial_delay (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_http_error_that_should_be_retried (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_http_error_that_should_not_be_retried (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_no_retry_decorator (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_real_clock (apache_beam.utils.retry_test.RetryTest) ... ok
test_arithmetic (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_of (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_precision (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_sort_order (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_str (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_arithmetic (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_from_rfc3339 (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_from_rfc3339_failure (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_from_utc_datetime (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_of (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_precision (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_sort_order (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_str (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_utc_timestamp (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_equality (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_hash (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_pickle (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_timestamps (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_with_value (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_no_partial_writeouts (apache_beam.pipeline_test.DirectRunnerRetryTests) ... ok
test_retry_fork_graph (apache_beam.pipeline_test.DirectRunnerRetryTests) ... ok
test_element (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_no_tag (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_tagged (apache_beam.pipeline_test.DoFnTest) ... ok
test_timestamp_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_timestamp_param_map (apache_beam.pipeline_test.DoFnTest) ... ok
test_window_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_attribute_setting (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_defaults (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_dir (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_flag_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_keyword_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_view_as (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_aggregator_empty_input (apache_beam.pipeline_test.PipelineTest) ... ok
test_apply_custom_transform (apache_beam.pipeline_test.PipelineTest) ... ok
test_create (apache_beam.pipeline_test.PipelineTest) ... ok
test_create_singleton_pcollection (apache_beam.pipeline_test.PipelineTest) ... ok
test_fake_read (apache_beam.pipeline_test.PipelineTest) ... ok
test_flatmap_builtin (apache_beam.pipeline_test.PipelineTest) ... ok
test_memory_usage (apache_beam.pipeline_test.PipelineTest) ... ok
test_metrics_in_fake_source (apache_beam.pipeline_test.PipelineTest) ... ok
test_pipeline_as_context (apache_beam.pipeline_test.PipelineTest) ... ok
test_ptransform_override_type_hints (apache_beam.pipeline_test.PipelineTest) ... ok
test_ptransform_overrides (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_cloned_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... ok
test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... ok
test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok
test_parent_pointer (apache_beam.pipeline_test.RunnerApiTest) ... ok
test_pickling (apache_beam.pipeline_test.RunnerApiTest) ... ok
test_simple (apache_beam.pipeline_test.RunnerApiTest)
Tests serializing, deserializing, and running a simple pipeline. ... ok
test_assingleton_multi_element (apache_beam.pvalue_test.PValueTest) ... ok
test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok
test_file_checksum_matchcer_invalid_sleep_time (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_read_failed (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_service_error (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_sleep_before_verify (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_success (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_pipeline_state_matcher_fails (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher fails when using default expected state ... ok
test_pipeline_state_matcher_given_state (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when matches given state ... ok
test_pipeline_state_matcher_success (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when using default expected state ... ok
test_append_extra_options (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_append_verifier_in_extra_opt (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_create_test_pipeline_options (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_empty_option_args_parsing (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_get_option (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_option_args_parsing (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_skip_IT (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... SKIP: IT is skipped because --test-pipeline-options is not specified
test_basic_execution (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_basic_execution_sideinputs (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_basic_execution_sideinputs_batch (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_basic_test_stream (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_gbk_execution_after_processing_trigger_fired (apache_beam.testing.test_stream_test.TestStreamTest)
Advance TestClock to (X + delta) and see the pipeline does finish. ... ok
test_gbk_execution_after_watermark_trigger (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_gbk_execution_no_triggers (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_test_stream_errors (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_cleanup_subscriptions (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_cleanup_topics (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_delete_files_fails_with_invalid_arg (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_delete_files_fails_with_io_error (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_delete_files_succeeds (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_temp_dir_removes_files (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_temp_file_field_correct (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_subscriptions_created_fails (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_subscriptions_created_succeeds (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_topics_created_fails (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_topics_created_succeeds (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_assert_that_fails (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_fails_on_empty_expected (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_fails_on_empty_input (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_passes (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_passes_empty_equal_to (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_passes_empty_is_empty (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_assert_fail_unmatched_timestamp (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_assert_fail_unmatched_value (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_assert_fail_unmatched_window (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_passes (apache_beam.testing.util_test.UtilTest) ... ok
----------------------------------------------------------------------
Ran 1551 tests in 536.395s
OK (skipped=44)
___________________________________ summary ____________________________________
cover: commands succeeded
docs: commands succeeded
ERROR: lint_py2: commands failed
lint_py3: commands succeeded
py27: commands succeeded
py27cython: commands succeeded
py27gcp: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4544
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4544/display/redirect?page=changes>
Changes:
[wcn] Fix golint issues
[robertwb] Optimize reshuffle.
[robertwb] Add PipelineRunner.run_async for non-blocking execution.
------------------------------------------
[...truncated 291.17 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 20:50:18.030522
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 20:50:19.053095
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 20:50:19.316035
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 20:50:19.344472
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 20:50:19.376030
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 20:50:19.553258
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 20:50:20.065747
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 20:50:20.121111
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 20:50:20.342453
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 20:50:20.414042
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
356.72user 7.62system 2:08.06elapsed 284%CPU (0avgtext+0avgdata 246532maxresident)k
32inputs+168outputs (0major+648220minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1538324538'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.79user 0.24system 0:09.90elapsed 303%CPU (0avgtext+0avgdata 66132maxresident)k
0inputs+0outputs (0major+88579minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4543
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4543/display/redirect>
------------------------------------------
[...truncated 291.66 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 20:10:47.203184
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 20:10:47.750753
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 20:10:47.896686
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 20:10:47.911453
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 20:10:47.930540
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 20:10:48.021240
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 20:10:48.319363
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 20:10:48.351366
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 20:10:48.487426
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 20:10:48.533206
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
355.84user 6.93system 2:07.50elapsed 284%CPU (0avgtext+0avgdata 246044maxresident)k
2920inputs+168outputs (0major+652639minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3673781195'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
35.56user 0.26system 0:13.07elapsed 273%CPU (0avgtext+0avgdata 66260maxresident)k
200inputs+0outputs (0major+89084minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4542
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4542/display/redirect>
------------------------------------------
[...truncated 321.12 KB...]
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 18:43:26.387188
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 18:43:26.535481
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 18:43:26.552227
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 18:43:26.569098
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 18:43:26.657528
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 18:43:26.932264
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 18:43:26.961988
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 18:43:27.079310
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 18:43:27.117904
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
344.36user 6.85system 1:51.61elapsed 314%CPU (0avgtext+0avgdata 261684maxresident)k
48inputs+168outputs (0major+651752minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py27-lint finish: runtests after 111.92 seconds
py3-lint start: getenv <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
setting PATH=<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox$> /usr/bin/python -m virtualenv --python /usr/bin/python py3-lint ><https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/log/py3-lint-0.log>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
setting PATH=<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python$> <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin/pip> install pycodestyle==2.3.1 pylint==1.7.2 future==0.16.0 isort==4.2.15 flake8==3.5.0 ><https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/log/py3-lint-1.log>
py3-lint finish: getenv after 5.55 seconds
py3-lint start: installpkg <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
setting PATH=<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python$> <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin/pip> install <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip> ><https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/log/py3-lint-2.log>
py3-lint finish: installpkg after 12.96 seconds
py3-lint start: envreport
setting PATH=<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python$> <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin/pip> freeze ><https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/log/py3-lint-3.log>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint finish: envreport after 0.51 seconds
py3-lint start: runtests
py3-lint runtests: PYTHONHASHSEED='601194479'
py3-lint runtests: commands[0] | python --version
setting PATH=<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python$> <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin/python> --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
setting PATH=<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python$> <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin/pip> --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
setting PATH=<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python$> /usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
36.10user 0.35system 0:13.54elapsed 269%CPU (0avgtext+0avgdata 66132maxresident)k
0inputs+0outputs (0major+88812minor)pagefaults 0swaps
py3-lint finish: runtests after 13.85 seconds
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4541
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4541/display/redirect?page=changes>
Changes:
[XuMingmin] [BEAM-591] Support custom timestamps & CreateTime support (#4935)
------------------------------------------
[...truncated 291.15 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 18:04:02.353860
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 18:04:03.439745
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 18:04:03.721009
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 18:04:03.747269
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 18:04:03.777179
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 18:04:03.947560
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 18:04:04.482339
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 18:04:04.539205
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 18:04:04.765161
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 18:04:04.831268
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
358.58user 7.22system 2:12.74elapsed 275%CPU (0avgtext+0avgdata 261096maxresident)k
1056inputs+168outputs (1major+640653minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2327255111'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
38.17user 0.39system 0:22.49elapsed 171%CPU (0avgtext+0avgdata 66232maxresident)k
8inputs+0outputs (0major+88372minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4540
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4540/display/redirect?page=changes>
Changes:
[tgroh] Reintroduce MetricName#name[space]
------------------------------------------
[...truncated 291.14 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 17:11:05.319706
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 17:11:05.878493
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 17:11:06.029433
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 17:11:06.044637
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 17:11:06.063024
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 17:11:06.155024
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 17:11:06.440482
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 17:11:06.470993
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 17:11:06.593281
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 17:11:06.632681
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
347.18user 7.41system 1:41.72elapsed 348%CPU (0avgtext+0avgdata 246628maxresident)k
0inputs+168outputs (0major+652036minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='85257674'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
30.61user 0.29system 0:10.69elapsed 288%CPU (0avgtext+0avgdata 66244maxresident)k
0inputs+0outputs (0major+88461minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4539
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4539/display/redirect>
------------------------------------------
[...truncated 291.74 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 16:41:14.632868
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 16:41:15.550691
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 16:41:15.773957
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 16:41:15.802215
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 16:41:15.832677
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 16:41:16.006088
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 16:41:16.612547
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 16:41:16.735093
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 16:41:17.042811
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 16:41:17.117034
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
374.03user 7.33system 2:58.93elapsed 213%CPU (0avgtext+0avgdata 260240maxresident)k
0inputs+168outputs (0major+658420minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='4271808472'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
38.34user 0.32system 0:21.24elapsed 182%CPU (0avgtext+0avgdata 66208maxresident)k
0inputs+0outputs (0major+88722minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4538
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4538/display/redirect>
------------------------------------------
[...truncated 291.10 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 15:11:17.170971
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 15:11:17.732634
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 15:11:17.882672
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 15:11:17.898483
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 15:11:17.917817
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 15:11:18.025478
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 15:11:18.330736
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 15:11:18.361342
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 15:11:18.486238
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 15:11:18.525168
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
351.85user 8.54system 1:44.80elapsed 343%CPU (0avgtext+0avgdata 252040maxresident)k
0inputs+168outputs (0major+652020minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='46615879'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.45user 0.30system 0:09.78elapsed 293%CPU (0avgtext+0avgdata 66464maxresident)k
0inputs+0outputs (0major+88350minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4537
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4537/display/redirect>
------------------------------------------
[...truncated 291.11 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 09:43:42.902130
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 09:43:43.575680
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 09:43:43.756622
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 09:43:43.776157
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 09:43:43.797258
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 09:43:43.909021
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 09:43:44.243322
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 09:43:44.274523
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 09:43:44.399698
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 09:43:44.439560
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
343.45user 9.42system 1:41.60elapsed 347%CPU (0avgtext+0avgdata 257648maxresident)k
2616inputs+168outputs (0major+655137minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1842172683'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.63user 0.26system 0:10.54elapsed 283%CPU (0avgtext+0avgdata 65132maxresident)k
8inputs+0outputs (0major+90633minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4536
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4536/display/redirect>
------------------------------------------
[...truncated 291.11 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 03:20:47.608517
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 03:20:48.157118
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 03:20:48.307296
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 03:20:48.322701
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 03:20:48.338581
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 03:20:48.426230
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 03:20:48.698064
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 03:20:48.728723
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 03:20:48.848374
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 03:20:48.886697
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
343.89user 7.60system 1:39.78elapsed 352%CPU (0avgtext+0avgdata 254672maxresident)k
0inputs+168outputs (0major+646013minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2024082232'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.57user 0.30system 0:10.00elapsed 298%CPU (0avgtext+0avgdata 66392maxresident)k
0inputs+0outputs (0major+88935minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4535
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4535/display/redirect>
------------------------------------------
[...truncated 291.73 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 03:10:54.575040
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 03:10:55.182525
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 03:10:55.333805
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 03:10:55.350012
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 03:10:55.367426
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 03:10:55.465639
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 03:10:55.759254
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 03:10:55.791896
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 03:10:55.913582
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 03:10:55.955656
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
348.43user 9.36system 1:42.65elapsed 348%CPU (0avgtext+0avgdata 249848maxresident)k
80inputs+168outputs (0major+645752minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='348519100'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.41user 0.21system 0:10.01elapsed 295%CPU (0avgtext+0avgdata 66236maxresident)k
8inputs+0outputs (0major+88441minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4534
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4534/display/redirect?page=changes>
Changes:
[github] Fix linter error in typehints.
------------------------------------------
[...truncated 291.12 KB...]
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-30 01:02:18.564394
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-30 01:02:19.112097
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-30 01:02:19.255549
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-30 01:02:19.269918
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-30 01:02:19.285763
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-30 01:02:19.374244
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-30 01:02:19.645325
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-30 01:02:19.674693
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-30 01:02:19.791402
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-30 01:02:19.831367
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
357.66user 7.02system 2:08.57elapsed 283%CPU (0avgtext+0avgdata 250392maxresident)k
0inputs+168outputs (0major+655009minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1458941295'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
38.26user 0.34system 0:21.30elapsed 181%CPU (0avgtext+0avgdata 66284maxresident)k
0inputs+0outputs (0major+88610minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4533
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4533/display/redirect?page=changes>
Changes:
[altay] Update streaming wordcount example and allign with the batch example.
------------------------------------------
[...truncated 260.74 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
41.47user 2.28system 0:18.71elapsed 233%CPU (0avgtext+0avgdata 153704maxresident)k
0inputs+40848outputs (0major+498984minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='9398634'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='9398634'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='9398634'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='9398634'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, -0.00)
Command exited with non-zero status 16
306.00user 9.50system 1:30.84elapsed 347%CPU (0avgtext+0avgdata 241484maxresident)k
0inputs+168outputs (0major+535337minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='9398634'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.95user 0.26system 0:10.08elapsed 299%CPU (0avgtext+0avgdata 66464maxresident)k
0inputs+0outputs (0major+88758minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4532
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4532/display/redirect>
------------------------------------------
[...truncated 260.86 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
42.27user 2.16system 0:18.48elapsed 240%CPU (0avgtext+0avgdata 152756maxresident)k
304inputs+40848outputs (2major+493343minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='3460092797'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='3460092797'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='3460092797'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='3460092797'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
300.10user 8.53system 1:22.15elapsed 375%CPU (0avgtext+0avgdata 246100maxresident)k
2568inputs+168outputs (0major+540309minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3460092797'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.28user 0.24system 0:10.13elapsed 271%CPU (0avgtext+0avgdata 68176maxresident)k
56inputs+0outputs (0major+89037minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4531
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4531/display/redirect?page=changes>
Changes:
[wcn] Remove include directives for proto well-known-types.
------------------------------------------
[...truncated 260.88 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
41.72user 2.33system 0:18.58elapsed 237%CPU (0avgtext+0avgdata 152640maxresident)k
312inputs+40912outputs (2major+496720minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='1902418334'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='1902418334'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='1902418334'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='1902418334'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
298.09user 6.60system 1:20.82elapsed 376%CPU (0avgtext+0avgdata 251896maxresident)k
2576inputs+168outputs (0major+547321minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1902418334'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.16user 0.20system 0:10.85elapsed 261%CPU (0avgtext+0avgdata 68248maxresident)k
56inputs+0outputs (0major+88990minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4530
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4530/display/redirect>
------------------------------------------
[...truncated 260.87 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
42.04user 2.10system 0:18.75elapsed 235%CPU (0avgtext+0avgdata 153792maxresident)k
0inputs+40832outputs (0major+492134minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='1613378511'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='1613378511'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='1613378511'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='1613378511'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
301.20user 8.23system 1:25.03elapsed 363%CPU (0avgtext+0avgdata 243824maxresident)k
0inputs+168outputs (0major+551108minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1613378511'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.12user 0.25system 0:10.79elapsed 272%CPU (0avgtext+0avgdata 68456maxresident)k
0inputs+0outputs (0major+88881minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4529
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4529/display/redirect>
------------------------------------------
[...truncated 260.87 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
44.11user 2.21system 0:19.05elapsed 243%CPU (0avgtext+0avgdata 151960maxresident)k
360inputs+40856outputs (2major+487183minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='3949638591'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='3949638591'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='3949638591'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='3949638591'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
296.28user 8.16system 1:20.38elapsed 378%CPU (0avgtext+0avgdata 243932maxresident)k
2568inputs+168outputs (0major+541485minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3949638591'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.62user 0.22system 0:10.91elapsed 264%CPU (0avgtext+0avgdata 68324maxresident)k
56inputs+0outputs (0major+88889minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4528
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4528/display/redirect>
------------------------------------------
[...truncated 260.87 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
41.79user 2.33system 0:18.93elapsed 233%CPU (0avgtext+0avgdata 150656maxresident)k
192inputs+40856outputs (0major+489335minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='2501701503'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='2501701503'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='2501701503'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='2501701503'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
304.46user 8.46system 1:27.76elapsed 356%CPU (0avgtext+0avgdata 250192maxresident)k
0inputs+168outputs (0major+544393minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2501701503'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
26.98user 0.23system 0:10.71elapsed 254%CPU (0avgtext+0avgdata 68248maxresident)k
0inputs+0outputs (0major+88900minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4527
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4527/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-3326] Address additional comments from PR/4963.
[lcwik] [BEAM-3104] Set up state interfaces, wire into SDK harness client.
------------------------------------------
[...truncated 260.92 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
41.70user 2.22system 0:18.81elapsed 233%CPU (0avgtext+0avgdata 153500maxresident)k
976inputs+40888outputs (2major+497150minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='56224873'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='56224873'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='56224873'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='56224873'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
294.78user 6.76system 1:19.53elapsed 379%CPU (0avgtext+0avgdata 246636maxresident)k
2704inputs+168outputs (1major+544322minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='56224873'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.89user 0.22system 0:11.22elapsed 250%CPU (0avgtext+0avgdata 68372maxresident)k
56inputs+0outputs (0major+88975minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4526
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4526/display/redirect>
------------------------------------------
[...truncated 260.89 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
50.44user 2.17system 0:24.52elapsed 214%CPU (0avgtext+0avgdata 153268maxresident)k
568inputs+40808outputs (3major+506259minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='2480455699'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='2480455699'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='2480455699'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='2480455699'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, -0.00)
Command exited with non-zero status 16
309.72user 7.20system 1:37.40elapsed 325%CPU (0avgtext+0avgdata 243356maxresident)k
2272inputs+168outputs (0major+544768minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2480455699'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
39.34user 0.36system 0:26.03elapsed 152%CPU (0avgtext+0avgdata 68332maxresident)k
56inputs+0outputs (0major+89405minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4525
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4525/display/redirect?page=changes>
Changes:
[mairbek] [BEAM-3932] Adds handling of array null values to MutationSizeEstimator
[aromanenko.dev] [BEAM-3819] Add withRequestRecordsLimit() option to KinesisIO
[altay] [BEAM-3738] Add more flake8 tests to run_pylint.sh
------------------------------------------
[...truncated 260.97 KB...]
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
41.78user 2.52system 0:18.62elapsed 237%CPU (0avgtext+0avgdata 151420maxresident)k
48inputs+40888outputs (2major+505861minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='240766130'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='240766130'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='240766130'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='240766130'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, -0.00)
Command exited with non-zero status 16
302.65user 6.82system 1:23.58elapsed 370%CPU (0avgtext+0avgdata 247672maxresident)k
328inputs+168outputs (0major+550211minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='240766130'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.93user 0.23system 0:10.27elapsed 283%CPU (0avgtext+0avgdata 68256maxresident)k
0inputs+0outputs (0major+89488minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4524
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4524/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-3326] Abstract away closing the inbound receiver, waiting for the
------------------------------------------
[...truncated 260.85 KB...]
Creating file target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst.
Creating file target/docs/source/apache_beam.io.gcp.gcsio.rst.
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
40.74user 2.61system 0:18.53elapsed 233%CPU (0avgtext+0avgdata 152084maxresident)k
328inputs+40816outputs (3major+499271minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='1580158648'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='1580158648'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='1580158648'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='1580158648'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
298.89user 6.13system 1:19.51elapsed 383%CPU (0avgtext+0avgdata 276460maxresident)k
1256inputs+168outputs (0major+550479minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1580158648'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
26.79user 0.20system 0:10.33elapsed 261%CPU (0avgtext+0avgdata 68248maxresident)k
56inputs+0outputs (0major+89167minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4523
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4523/display/redirect>
------------------------------------------
[...truncated 260.73 KB...]
Creating file target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst.
Creating file target/docs/source/apache_beam.io.gcp.gcsio.rst.
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
40.02user 2.45system 0:18.36elapsed 231%CPU (0avgtext+0avgdata 153132maxresident)k
296inputs+40832outputs (1major+499857minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='1965470360'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='1965470360'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='1965470360'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='1965470360'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
299.26user 7.12system 1:21.06elapsed 377%CPU (0avgtext+0avgdata 253688maxresident)k
2152inputs+168outputs (0major+566450minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1965470360'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.58user 0.20system 0:10.93elapsed 263%CPU (0avgtext+0avgdata 68124maxresident)k
64inputs+0outputs (0major+89396minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4522
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4522/display/redirect?page=changes>
Changes:
[herohde] Migrate container instructions and builds to Gradle
[herohde] CR: added comments to container helper function
[herohde] CR: make containerImageName take named parameters
------------------------------------------
[...truncated 260.77 KB...]
Creating file target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst.
Creating file target/docs/source/apache_beam.io.gcp.gcsio.rst.
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
54.15user 3.36system 0:53.75elapsed 107%CPU (0avgtext+0avgdata 150244maxresident)k
616inputs+40856outputs (1major+503634minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='844402220'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='844402220'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='844402220'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='844402220'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Command exited with non-zero status 16
310.36user 9.38system 2:53.06elapsed 184%CPU (0avgtext+0avgdata 261472maxresident)k
2608inputs+168outputs (1major+556320minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='844402220'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
38.08user 1.10system 0:36.51elapsed 107%CPU (0avgtext+0avgdata 63788maxresident)k
56inputs+0outputs (0major+90638minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4521
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4521/display/redirect?page=changes>
Changes:
[rober] Go SDK usercounters
[ccy] Revert #4781 which broke Python postsubmits
------------------------------------------
[...truncated 260.77 KB...]
Creating file target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst.
Creating file target/docs/source/apache_beam.io.gcp.gcsio.rst.
Creating file target/docs/source/apache_beam.io.gcp.pubsub.rst.
Creating file target/docs/source/apache_beam.io.gcp.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.adaptive_throttler.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.datastoreio.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.fake_datastore.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.helper.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.query_splitter.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.util.rst.
Creating file target/docs/source/apache_beam.io.gcp.datastore.v1.rst.
Creating file target/docs/source/apache_beam.metrics.cells.rst.
Creating file target/docs/source/apache_beam.metrics.metric.rst.
Creating file target/docs/source/apache_beam.metrics.metricbase.rst.
Creating file target/docs/source/apache_beam.metrics.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options.rst.
Creating file target/docs/source/apache_beam.options.pipeline_options_validator.rst.
Creating file target/docs/source/apache_beam.options.value_provider.rst.
Creating file target/docs/source/apache_beam.options.rst.
Creating file target/docs/source/apache_beam.portability.common_urns.rst.
Creating file target/docs/source/apache_beam.portability.python_urns.rst.
Creating file target/docs/source/apache_beam.portability.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_artifact_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_fn_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_job_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_provision_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.beam_runner_api_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.endpoints_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.standard_window_fns_pb2_grpc.rst.
Creating file target/docs/source/apache_beam.portability.api.rst.
Creating file target/docs/source/apache_beam.runners.pipeline_context.rst.
Creating file target/docs/source/apache_beam.runners.runner.rst.
Creating file target/docs/source/apache_beam.runners.sdf_common.rst.
Creating file target/docs/source/apache_beam.runners.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_metrics.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.ptransform_overrides.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.test_dataflow_runner.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.iobase.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.streaming_create.rst.
Creating file target/docs/source/apache_beam.runners.dataflow.native_io.rst.
Creating file target/docs/source/apache_beam.runners.direct.bundle_factory.rst.
Creating file target/docs/source/apache_beam.runners.direct.clock.rst.
Creating file target/docs/source/apache_beam.runners.direct.consumer_tracking_pipeline_visitor.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_metrics.rst.
Creating file target/docs/source/apache_beam.runners.direct.direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.evaluation_context.rst.
Creating file target/docs/source/apache_beam.runners.direct.executor.rst.
Creating file target/docs/source/apache_beam.runners.direct.helper_transforms.rst.
Creating file target/docs/source/apache_beam.runners.direct.sdf_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.direct.transform_evaluator.rst.
Creating file target/docs/source/apache_beam.runners.direct.util.rst.
Creating file target/docs/source/apache_beam.runners.direct.watermark_manager.rst.
Creating file target/docs/source/apache_beam.runners.direct.rst.
Creating file target/docs/source/apache_beam.runners.experimental.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.python_rpc_direct_runner.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.server.rst.
Creating file target/docs/source/apache_beam.runners.experimental.python_rpc_direct.rst.
Creating file target/docs/source/apache_beam.runners.job.manager.rst.
Creating file target/docs/source/apache_beam.runners.job.utils.rst.
Creating file target/docs/source/apache_beam.runners.job.rst.
Creating file target/docs/source/apache_beam.testing.pipeline_verifiers.rst.
Creating file target/docs/source/apache_beam.testing.test_pipeline.rst.
Creating file target/docs/source/apache_beam.testing.test_stream.rst.
Creating file target/docs/source/apache_beam.testing.test_utils.rst.
Creating file target/docs/source/apache_beam.testing.util.rst.
Creating file target/docs/source/apache_beam.testing.rst.
Creating file target/docs/source/apache_beam.tools.rst.
Creating file target/docs/source/apache_beam.transforms.combiners.rst.
Creating file target/docs/source/apache_beam.transforms.core.rst.
Creating file target/docs/source/apache_beam.transforms.display.rst.
Creating file target/docs/source/apache_beam.transforms.ptransform.rst.
Creating file target/docs/source/apache_beam.transforms.sideinputs.rst.
Creating file target/docs/source/apache_beam.transforms.timeutil.rst.
Creating file target/docs/source/apache_beam.transforms.trigger.rst.
Creating file target/docs/source/apache_beam.transforms.util.rst.
Creating file target/docs/source/apache_beam.transforms.window.rst.
Creating file target/docs/source/apache_beam.transforms.rst.
Creating file target/docs/source/apache_beam.typehints.decorators.rst.
Creating file target/docs/source/apache_beam.typehints.native_type_compatibility.rst.
Creating file target/docs/source/apache_beam.typehints.opcodes.rst.
Creating file target/docs/source/apache_beam.typehints.trivial_inference.rst.
Creating file target/docs/source/apache_beam.typehints.typecheck.rst.
Creating file target/docs/source/apache_beam.typehints.typehints.rst.
Creating file target/docs/source/apache_beam.typehints.rst.
Creating file target/docs/source/apache_beam.utils.annotations.rst.
Creating file target/docs/source/apache_beam.utils.plugin.rst.
Creating file target/docs/source/apache_beam.utils.processes.rst.
Creating file target/docs/source/apache_beam.utils.profiler.rst.
Creating file target/docs/source/apache_beam.utils.proto_utils.rst.
Creating file target/docs/source/apache_beam.utils.retry.rst.
Creating file target/docs/source/apache_beam.utils.timestamp.rst.
Creating file target/docs/source/apache_beam.utils.urns.rst.
Creating file target/docs/source/apache_beam.utils.rst.
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/util/requests.py>:64: UserWarning: Some links may return broken results due to being unable to check the Server Name Indication (SNI) in the returned SSL cert against the hostname in the url requested. Recommended to install "requests[security]" as a dependency or upgrade to a python version with SNI support (Python 3 and Python 2.7.9+).
'Some links may return broken results due to being unable to '
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsfilesystem.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsfilesystem'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsfilesystem.py",> line 27, in <module>
from apache_beam.io.gcp import gcsio
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.io.gcp.gcsio.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.io.gcp.gcsio'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py",> line 59, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution environment (could not import storage API client).
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.pipeline_verifiers.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.pipeline_verifiers'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py",> line 28, in <module>
from hamcrest.core.base_matcher import BaseMatcher
ImportError: No module named hamcrest.core.base_matcher
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/docs/source/apache_beam.testing.test_pipeline.rst>:4: WARNING: autodoc: failed to import module u'apache_beam.testing.test_pipeline'; the following exception was raised:
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/docs/local/lib/python2.7/site-packages/sphinx/ext/autodoc.py",> line 658, in import_object
__import__(self.modname)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
Command exited with non-zero status 1
42.03user 2.53system 0:18.64elapsed 239%CPU (0avgtext+0avgdata 153392maxresident)k
944inputs+40848outputs (2major+508356minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/generate_pydoc.sh'>
py27 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27>
py27 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27 runtests: PYTHONHASHSEED='3322486575'
py27 runtests: commands[0] | python --version
Python 2.7.6
py27 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages> (python 2.7)
py27 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-cython2 create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2>
py27-cython2 installdeps: cython==0.26.1
py27-cython2 inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-cython2 installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,Cython==0.26.1,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-cython2 runtests: PYTHONHASHSEED='3322486575'
py27-cython2 runtests: commands[0] | python --version
Python 2.7.6
py27-cython2 runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages> (python 2.7)
py27-cython2 runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-cython2 runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-cython2/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-gcp create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp>
py27-gcp inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-gcp installed: apache-beam==2.5.0.dev0,avro==1.8.2,certifi==2018.1.18,chardet==3.0.4,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,funcsigs==1.0.2,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,six==1.11.0,typing==3.6.4,urllib3==1.22
py27-gcp runtests: PYTHONHASHSEED='3322486575'
py27-gcp runtests: commands[0] | python --version
Python 2.7.6
py27-gcp runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages> (python 2.7)
py27-gcp runtests: commands[2] | <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_tox_cleanup.sh>
py27-gcp runtests: commands[3] | python apache_beam/examples/complete/autocomplete_test.py
Traceback (most recent call last):
File "apache_beam/examples/complete/autocomplete_test.py", line 24, in <module>
from apache_beam.testing.test_pipeline import TestPipeline
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/local/lib/python2.7/site-packages/apache_beam/testing/test_pipeline.py",> line 23, in <module>
from nose.plugins.skip import SkipTest
ImportError: No module named nose.plugins.skip
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-gcp/bin/python> apache_beam/examples/complete/autocomplete_test.py'
py27-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint>
py27-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py27-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py27-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py27-lint runtests: PYTHONHASHSEED='3322486575'
py27-lint runtests: commands[0] | python --version
Python 2.7.6
py27-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27-lint/local/lib/python2.7/site-packages> (python 2.7)
py27-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh>
Skipping lint for generated files: bigquery_v2_client.py, bigquery_v2_messages.py, dataflow_v1b3_client.py, dataflow_v1b3_messages.py, storage_v1_client.py, storage_v1_messages.py, proto2_coder_test_messages_pb2.py, beam_artifact_api_pb2_grpc.py, beam_artifact_api_pb2.py, beam_fn_api_pb2_grpc.py, beam_fn_api_pb2.py, beam_job_api_pb2_grpc.py, beam_job_api_pb2.py, beam_provision_api_pb2_grpc.py, beam_provision_api_pb2.py, beam_runner_api_pb2_grpc.py, beam_runner_api_pb2.py, endpoints_pb2_grpc.py, endpoints_pb2.py, standard_window_fns_pb2_grpc.py, standard_window_fns_pb2.py
Running pylint for module apache_beam:
************* Module apache_beam.typehints.typehints
C:1101, 0: Trailing newlines (trailing-newlines)
--------------------------------------------------------------------
Your code has been rated at 10.00/10 (previous run: 10.00/10, -0.00)
Command exited with non-zero status 16
304.05user 6.89system 1:24.11elapsed 369%CPU (0avgtext+0avgdata 241100maxresident)k
2952inputs+168outputs (0major+548221minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3322486575'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
33.08user 0.28system 0:12.05elapsed 276%CPU (0avgtext+0avgdata 68352maxresident)k
56inputs+0outputs (0major+89328minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user rober@frantil.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4520
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4520/display/redirect?page=changes>
Changes:
[tgroh] Cleanups in GroupAlsoByWindowEvaluatorFactory
[tgroh] Allow Fusion to Continue with unknown PTransforms
[tgroh] fixup! Allow Fusion to Continue with unknown PTransforms
[tgroh] fixup! fixup! Allow Fusion to Continue with unknown PTransforms
[chamikara] [BEAM-3744] Expand Pubsub read API for Python. (#4901)
------------------------------------------
[...truncated 291.28 KB...]
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 23:31:42.087540
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 23:31:42.847013
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 23:31:43.094108
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 23:31:43.123137
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 23:31:43.154884
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 23:31:43.323650
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 23:31:43.683206
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 23:31:43.714757
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 23:31:43.833021
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 23:31:43.883226
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
365.06user 7.86system 2:28.10elapsed 251%CPU (0avgtext+0avgdata 247240maxresident)k
2584inputs+168outputs (0major+653498minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,pytz==2018.3,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3777436987'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
36.94user 0.30system 0:17.23elapsed 216%CPU (0avgtext+0avgdata 68036maxresident)k
8inputs+0outputs (0major+88548minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4519
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4519/display/redirect>
------------------------------------------
[...truncated 290.23 KB...]
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 21:09:34.211296
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 21:09:34.770462
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 21:09:34.924515
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 21:09:34.938766
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 21:09:34.958238
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 21:09:35.063953
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 21:09:35.368337
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 21:09:35.398836
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 21:09:35.514931
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 21:09:35.564043
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
343.58user 7.77system 1:43.41elapsed 339%CPU (0avgtext+0avgdata 251956maxresident)k
8inputs+168outputs (0major+647018minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1006003864'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.76user 0.29system 0:10.39elapsed 269%CPU (0avgtext+0avgdata 68400maxresident)k
0inputs+0outputs (0major+89309minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4518
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4518/display/redirect?page=changes>
Changes:
[wcn] Fix documentation around pipeline creation.
------------------------------------------
[...truncated 290.24 KB...]
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 20:46:21.617160
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 20:46:22.146742
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 20:46:22.291014
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 20:46:22.306284
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 20:46:22.322953
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 20:46:22.413034
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 20:46:22.695605
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 20:46:22.728397
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 20:46:22.846190
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 20:46:22.885004
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
343.53user 7.16system 1:46.70elapsed 328%CPU (0avgtext+0avgdata 254324maxresident)k
1632inputs+168outputs (0major+644389minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==4.0.0,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3708149440'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.30user 0.26system 0:11.10elapsed 266%CPU (0avgtext+0avgdata 68368maxresident)k
8inputs+0outputs (0major+89427minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4517
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4517/display/redirect?page=changes>
Changes:
[dawid] [BEAM-2831] Do not wrap IOException in SerializableCoder
------------------------------------------
[...truncated 290.23 KB...]
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 18:30:08.641331
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 18:30:09.159732
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 18:30:09.301554
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 18:30:09.316018
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 18:30:09.332157
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 18:30:09.421399
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 18:30:09.693870
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 18:30:09.723681
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 18:30:09.838274
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 18:30:09.876828
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
341.14user 7.16system 1:40.06elapsed 348%CPU (0avgtext+0avgdata 247056maxresident)k
968inputs+168outputs (0major+648111minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3926754265'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.48user 0.40system 0:10.61elapsed 262%CPU (0avgtext+0avgdata 68284maxresident)k
8inputs+0outputs (0major+89457minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4516
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4516/display/redirect>
------------------------------------------
[...truncated 290.24 KB...]
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 15:13:10.703033
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 15:13:11.219433
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 15:13:11.363370
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 15:13:11.378451
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 15:13:11.394413
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 15:13:11.481371
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 15:13:11.752115
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 15:13:11.782312
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 15:13:11.898112
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 15:13:11.936502
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
347.96user 7.23system 1:42.49elapsed 346%CPU (0avgtext+0avgdata 253064maxresident)k
1400inputs+168outputs (0major+646600minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2016293441'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.27user 0.23system 0:10.68elapsed 257%CPU (0avgtext+0avgdata 68456maxresident)k
8inputs+0outputs (0major+88992minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4515
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4515/display/redirect>
------------------------------------------
[...truncated 290.24 KB...]
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 09:53:24.788261
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 09:53:25.313710
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 09:53:25.467825
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 09:53:25.481946
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 09:53:25.497861
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 09:53:25.595865
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 09:53:25.938747
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 09:53:25.978847
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 09:53:26.129052
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 09:53:26.179968
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
341.72user 7.08system 1:45.29elapsed 331%CPU (0avgtext+0avgdata 246616maxresident)k
2648inputs+168outputs (0major+652285minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='388605322'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
33.62user 0.27system 0:11.97elapsed 282%CPU (0avgtext+0avgdata 68292maxresident)k
8inputs+0outputs (0major+89422minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4514
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4514/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-3931] Remove commons-text dependency from Spark runner
------------------------------------------
[...truncated 290.26 KB...]
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 07:48:04.662292
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 07:48:05.194156
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 07:48:05.340619
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 07:48:05.354976
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 07:48:05.371158
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 07:48:05.457660
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 07:48:05.736169
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 07:48:05.766922
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 07:48:05.882481
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 07:48:05.926667
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
338.03user 8.64system 1:40.40elapsed 345%CPU (0avgtext+0avgdata 257968maxresident)k
0inputs+168outputs (0major+651766minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2663711275'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.79user 0.27system 0:10.49elapsed 277%CPU (0avgtext+0avgdata 68504maxresident)k
0inputs+0outputs (0major+89648minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4513
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4513/display/redirect?page=changes>
Changes:
[aljoscha.krettek] [BEAM-622] Add checkpointing tests for DoFnOperator and
[aljoscha.krettek] [BEAM-3087] Make reader state update and element emission atomic
[aljoscha.krettek] [BEAM-2393] Make BoundedSource fault-tolerant
------------------------------------------
[...truncated 290.31 KB...]
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 07:14:20.015406
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 07:14:20.533060
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 07:14:20.671941
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 07:14:20.685920
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 07:14:20.702018
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 07:14:20.787804
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 07:14:21.054361
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 07:14:21.083886
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 07:14:21.201452
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 07:14:21.239257
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
339.83user 10.16system 1:40.11elapsed 349%CPU (0avgtext+0avgdata 255988maxresident)k
1784inputs+168outputs (9major+646459minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1269107773'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.79user 0.40system 0:11.14elapsed 261%CPU (0avgtext+0avgdata 68420maxresident)k
0inputs+0outputs (0major+89838minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4512
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4512/display/redirect?page=changes>
Changes:
[ehudm] Fix test_pre_finalize_error to test exceptions.
------------------------------------------
[...truncated 290.19 KB...]
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 04:36:26.076255
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 04:36:26.641964
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 04:36:26.802871
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 04:36:26.818487
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 04:36:26.836247
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 04:36:26.933473
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 04:36:27.244579
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 04:36:27.278305
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 04:36:27.411156
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 04:36:27.455859
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
345.55user 8.82system 1:54.51elapsed 309%CPU (0avgtext+0avgdata 251916maxresident)k
288inputs+168outputs (2major+636278minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1448963031'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
33.85user 0.41system 0:12.64elapsed 271%CPU (0avgtext+0avgdata 68092maxresident)k
0inputs+0outputs (0major+89873minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4511
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4511/display/redirect>
------------------------------------------
[...truncated 290.17 KB...]
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 03:29:31.906515
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 03:29:32.473091
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 03:29:32.650853
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 03:29:32.667921
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 03:29:32.683952
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 03:29:32.773815
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 03:29:33.088647
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 03:29:33.126182
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 03:29:33.266292
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 03:29:33.315179
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
340.15user 7.00system 1:44.96elapsed 330%CPU (0avgtext+0avgdata 240552maxresident)k
32inputs+168outputs (0major+647185minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3724713863'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.73user 0.20system 0:10.69elapsed 261%CPU (0avgtext+0avgdata 68276maxresident)k
8inputs+0outputs (0major+88880minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4510
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4510/display/redirect?page=changes>
Changes:
[github] Updated to Ubuntu 16 version of python 2
------------------------------------------
[...truncated 290.19 KB...]
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-27 00:37:26.752944
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-27 00:37:27.323411
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-27 00:37:27.497816
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-27 00:37:27.512230
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-27 00:37:27.529033
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-27 00:37:27.625827
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-27 00:37:27.924886
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-27 00:37:27.958086
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-27 00:37:28.098347
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-27 00:37:28.143168
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
340.04user 7.24system 1:43.36elapsed 335%CPU (0avgtext+0avgdata 279436maxresident)k
2048inputs+168outputs (0major+634513minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3444374173'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
33.42user 0.29system 0:12.15elapsed 277%CPU (0avgtext+0avgdata 68256maxresident)k
8inputs+0outputs (0major+89177minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4509
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4509/display/redirect>
------------------------------------------
[...truncated 290.16 KB...]
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-26 21:41:51.353371
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-26 21:41:51.874260
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-26 21:41:52.013890
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-26 21:41:52.028268
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-26 21:41:52.044280
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-26 21:41:52.131054
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-26 21:41:52.401953
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-26 21:41:52.431688
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-26 21:41:52.548448
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-26 21:41:52.588915
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
338.00user 6.98system 1:38.65elapsed 349%CPU (0avgtext+0avgdata 263996maxresident)k
2656inputs+168outputs (0major+660859minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2672169147'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.42user 0.23system 0:10.93elapsed 262%CPU (0avgtext+0avgdata 68288maxresident)k
24inputs+0outputs (0major+89273minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4508
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4508/display/redirect>
------------------------------------------
[...truncated 290.28 KB...]
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-26 16:11:42.559555
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-26 16:11:43.131539
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-26 16:11:43.293339
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-26 16:11:43.307942
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-26 16:11:43.324458
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-26 16:11:43.425194
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-26 16:11:43.742448
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-26 16:11:43.775242
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-26 16:11:43.919391
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-26 16:11:43.969688
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
338.41user 6.93system 1:39.95elapsed 345%CPU (0avgtext+0avgdata 250632maxresident)k
0inputs+168outputs (0major+647342minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1953718376'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.65user 0.23system 0:10.51elapsed 265%CPU (0avgtext+0avgdata 68320maxresident)k
0inputs+0outputs (0major+89409minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4507
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4507/display/redirect>
------------------------------------------
[...truncated 290.15 KB...]
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-26 15:56:42.614265
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-26 15:56:43.133979
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-26 15:56:43.273515
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-26 15:56:43.287467
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-26 15:56:43.303091
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-26 15:56:43.389428
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-26 15:56:43.659768
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-26 15:56:43.690227
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-26 15:56:43.804654
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-26 15:56:43.842921
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
339.91user 8.95system 1:39.81elapsed 349%CPU (0avgtext+0avgdata 254216maxresident)k
0inputs+168outputs (0major+653202minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='790254716'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.83user 0.28system 0:10.88elapsed 267%CPU (0avgtext+0avgdata 68360maxresident)k
0inputs+0outputs (0major+88927minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4506
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4506/display/redirect?page=changes>
Changes:
[echauchot] [BEAM-3892] Make MetricQueryResults and related classes more
------------------------------------------
[...truncated 290.18 KB...]
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-26 15:10:57.964281
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-26 15:10:58.488785
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-26 15:10:58.632020
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-26 15:10:58.646353
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-26 15:10:58.662463
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-26 15:10:58.752009
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-26 15:10:59.022592
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-26 15:10:59.052739
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-26 15:10:59.172038
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-26 15:10:59.210584
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
336.06user 7.03system 1:39.33elapsed 345%CPU (0avgtext+0avgdata 261400maxresident)k
2896inputs+168outputs (0major+660413minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3650347632'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.36user 0.26system 0:10.52elapsed 271%CPU (0avgtext+0avgdata 68348maxresident)k
8inputs+0outputs (0major+89433minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4505
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4505/display/redirect?page=changes>
Changes:
[grzegorz.kolakowski] [BEAM-3800] Set uids on Flink operators
------------------------------------------
[...truncated 290.16 KB...]
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-26 11:51:53.116114
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-26 11:51:53.665143
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-26 11:51:53.812290
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-26 11:51:53.827252
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-26 11:51:53.843203
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-26 11:51:53.933716
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-26 11:51:54.210985
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-26 11:51:54.243640
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-26 11:51:54.360994
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-26 11:51:54.400197
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
343.10user 7.39system 1:42.17elapsed 343%CPU (0avgtext+0avgdata 253912maxresident)k
256inputs+168outputs (1major+648338minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2055229411'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.46user 0.21system 0:10.71elapsed 258%CPU (0avgtext+0avgdata 68332maxresident)k
0inputs+0outputs (0major+90036minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4504
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4504/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-26 09:26:42.944511
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-26 09:26:43.485502
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-26 09:26:43.631601
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-26 09:26:43.645825
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-26 09:26:43.662910
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-26 09:26:43.749138
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-26 09:26:44.023328
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-26 09:26:44.056618
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-26 09:26:44.181720
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-26 09:26:44.224106
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
345.62user 8.03system 1:43.51elapsed 341%CPU (0avgtext+0avgdata 251696maxresident)k
2640inputs+168outputs (0major+653712minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1768164610'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.80user 0.25system 0:10.79elapsed 269%CPU (0avgtext+0avgdata 68456maxresident)k
8inputs+0outputs (0major+89649minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4503
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4503/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-26 03:36:50.946238
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-26 03:36:51.478445
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-26 03:36:51.621914
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-26 03:36:51.636542
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-26 03:36:51.653305
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-26 03:36:51.748038
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-26 03:36:52.033177
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-26 03:36:52.064001
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-26 03:36:52.180769
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-26 03:36:52.219713
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
346.58user 8.74system 1:47.00elapsed 332%CPU (0avgtext+0avgdata 260000maxresident)k
2704inputs+168outputs (0major+642136minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3633909680'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
30.30user 0.31system 0:12.33elapsed 248%CPU (0avgtext+0avgdata 68440maxresident)k
8inputs+0outputs (0major+89546minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4502
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4502/display/redirect>
------------------------------------------
[...truncated 290.20 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-25 21:09:56.782176
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-25 21:09:57.310637
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-25 21:09:57.455403
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-25 21:09:57.469902
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-25 21:09:57.486236
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-25 21:09:57.574372
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-25 21:09:57.858772
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-25 21:09:57.889364
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-25 21:09:58.008567
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-25 21:09:58.047628
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
346.58user 8.70system 1:43.42elapsed 343%CPU (0avgtext+0avgdata 245852maxresident)k
0inputs+168outputs (0major+633831minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2832046607'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.80user 0.23system 0:10.50elapsed 267%CPU (0avgtext+0avgdata 68464maxresident)k
0inputs+0outputs (0major+89887minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4501
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4501/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-25 15:09:35.421955
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-25 15:09:35.979421
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-25 15:09:36.141155
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-25 15:09:36.159067
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-25 15:09:36.178748
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-25 15:09:36.277759
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-25 15:09:36.555502
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-25 15:09:36.585194
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-25 15:09:36.712180
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-25 15:09:36.750813
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
341.01user 9.00system 1:48.04elapsed 323%CPU (0avgtext+0avgdata 246512maxresident)k
0inputs+168outputs (0major+647119minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1604060843'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
26.93user 0.26system 0:10.31elapsed 263%CPU (0avgtext+0avgdata 68428maxresident)k
0inputs+0outputs (0major+89102minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4500
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4500/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-25 09:09:42.527987
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-25 09:09:43.175720
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-25 09:09:43.350336
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-25 09:09:43.368930
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-25 09:09:43.390007
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-25 09:09:43.487659
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-25 09:09:43.799152
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-25 09:09:43.839103
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-25 09:09:43.989904
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-25 09:09:44.041522
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
345.92user 9.94system 1:43.30elapsed 344%CPU (0avgtext+0avgdata 248776maxresident)k
0inputs+168outputs (0major+651618minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3075720948'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
31.07user 0.27system 0:11.29elapsed 277%CPU (0avgtext+0avgdata 68252maxresident)k
0inputs+0outputs (0major+89677minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4499
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4499/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-25 03:09:41.337551
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-25 03:09:42.293274
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-25 03:09:42.471370
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-25 03:09:42.488965
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-25 03:09:42.509145
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-25 03:09:42.602040
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-25 03:09:42.950088
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-25 03:09:42.990531
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-25 03:09:43.136531
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-25 03:09:43.186379
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
345.02user 8.47system 1:49.76elapsed 322%CPU (0avgtext+0avgdata 262528maxresident)k
0inputs+168outputs (0major+656731minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1950250777'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.87user 0.30system 0:11.29elapsed 267%CPU (0avgtext+0avgdata 68200maxresident)k
0inputs+0outputs (0major+89878minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4498
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4498/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-24 21:09:26.605181
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-24 21:09:27.178116
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-24 21:09:27.342745
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-24 21:09:27.360761
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-24 21:09:27.382479
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-24 21:09:27.495797
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-24 21:09:27.771570
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-24 21:09:27.809950
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-24 21:09:27.938679
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-24 21:09:27.978559
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
343.36user 9.32system 1:48.62elapsed 324%CPU (0avgtext+0avgdata 239276maxresident)k
0inputs+168outputs (0major+645860minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2190104406'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.53user 0.28system 0:10.79elapsed 276%CPU (0avgtext+0avgdata 68224maxresident)k
0inputs+0outputs (0major+89363minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4497
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4497/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-24 15:09:25.817733
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-24 15:09:26.463524
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-24 15:09:26.626510
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-24 15:09:26.642178
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-24 15:09:26.659412
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-24 15:09:26.764035
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-24 15:09:27.106794
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-24 15:09:27.148143
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-24 15:09:27.296707
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-24 15:09:27.346845
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
357.19user 10.17system 1:53.08elapsed 324%CPU (0avgtext+0avgdata 248120maxresident)k
0inputs+168outputs (0major+645399minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3372956463'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.08user 0.27system 0:10.79elapsed 262%CPU (0avgtext+0avgdata 64180maxresident)k
0inputs+0outputs (0major+90434minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4496
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4496/display/redirect>
------------------------------------------
[...truncated 290.11 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-24 09:09:22.836612
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-24 09:09:23.397605
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-24 09:09:23.541815
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-24 09:09:23.555981
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-24 09:09:23.571560
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-24 09:09:23.655759
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-24 09:09:23.934006
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-24 09:09:23.972170
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-24 09:09:24.100959
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-24 09:09:24.148681
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
341.43user 9.60system 1:45.34elapsed 333%CPU (0avgtext+0avgdata 242044maxresident)k
0inputs+168outputs (0major+642785minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='48259413'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.40user 0.23system 0:10.39elapsed 275%CPU (0avgtext+0avgdata 68344maxresident)k
0inputs+0outputs (0major+89245minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4495
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4495/display/redirect>
------------------------------------------
[...truncated 290.12 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-24 03:09:42.687154
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-24 03:09:43.217807
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-24 03:09:43.361293
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-24 03:09:43.376873
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-24 03:09:43.393095
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-24 03:09:43.480863
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-24 03:09:43.771236
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-24 03:09:43.802474
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-24 03:09:43.920319
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-24 03:09:43.959114
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
343.87user 9.74system 1:47.46elapsed 329%CPU (0avgtext+0avgdata 244592maxresident)k
2624inputs+168outputs (0major+634339minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='2762554573'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.15user 0.26system 0:10.91elapsed 260%CPU (0avgtext+0avgdata 68324maxresident)k
8inputs+0outputs (0major+89436minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4494
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4494/display/redirect?page=changes>
Changes:
[wcn] Updating generated files.
------------------------------------------
[...truncated 264.89 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-23 23:59:26.858301
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-23 23:59:27.394002
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-23 23:59:27.535269
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-23 23:59:27.549958
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-23 23:59:27.565876
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-23 23:59:27.654488
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-23 23:59:27.932098
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-23 23:59:27.965952
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-23 23:59:28.090184
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-23 23:59:28.129558
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
339.20user 6.67system 1:39.82elapsed 346%CPU (0avgtext+0avgdata 245064maxresident)k
56inputs+168outputs (0major+636758minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1144163912'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
29.60user 0.27system 0:11.21elapsed 266%CPU (0avgtext+0avgdata 68416maxresident)k
8inputs+0outputs (0major+89481minor)pagefaults 0swaps
___________________________________ summary ____________________________________
ERROR: cover: commands failed
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4493
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4493/display/redirect>
------------------------------------------
[...truncated 290.24 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-23 21:45:33.046206
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-23 21:45:33.577484
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-23 21:45:33.719489
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-23 21:45:33.733857
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-23 21:45:33.749746
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-23 21:45:33.838003
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-23 21:45:34.124235
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-23 21:45:34.155367
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-23 21:45:34.273100
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-23 21:45:34.312456
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
341.44user 7.77system 1:41.39elapsed 344%CPU (0avgtext+0avgdata 265644maxresident)k
2840inputs+168outputs (0major+653663minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='1339397244'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
28.80user 0.25system 0:11.21elapsed 259%CPU (0avgtext+0avgdata 68456maxresident)k
8inputs+0outputs (0major+89482minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4492
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4492/display/redirect?page=changes>
Changes:
[coheigea] Put the String literal first when comparing it to an Object
[jb] [BEAM-3500] "Attach" JDBC connection to the bundle (improve the pooling)
[jb] [BEAM-3500] Test if the user provides both withDataSourceConfiguration()
[jb] [BEAM-3500] Wrap the datasource as a poolable datasource and expose
[jb] [BEAM-3500] Add commons-pool2 dependency
[jb] [BEAM-3500] Only expose max number of connections in the pool to the
[jb] [BEAM-3500] Cleanup pool configuration parameters
[jb] [BEAM-3500] Remove dataSourceFactory
[jb] [BEAM-3500] Remove unecessary check on dataSourceConfiguration
[mariand] Switched AvroIO default codec to snappyCodec().
[aaltay] [BEAM-3738] Enable py3 lint and cleanup tox.ini. (#4877)
------------------------------------------
[...truncated 290.28 KB...]
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import wordcount
from apache_beam.examples import wordcount_fnapi
from apache_beam.testing.pipeline_verifiers import FileChecksumMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.test_utils import delete_files
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class WordCountIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:before 2018-03-23 17:50:29.204663
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/streaming_wordcount_it_test.py>:after 2018-03-23 19:26:43.761648
@@ -29,15 +29,14 @@
import unittest
import uuid
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples import streaming_wordcount
from apache_beam.io.gcp.tests.pubsub_matcher import PubSubMessageMatcher
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
INPUT_TOPIC = 'wc_topic_input'
OUTPUT_TOPIC = 'wc_topic_output'
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:before 2018-01-24 00:22:36.719312
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py>:after 2018-03-23 19:26:44.298138
@@ -21,14 +21,13 @@
import time
import unittest
-from hamcrest.core.core.allof import all_of
-from nose.plugins.attrib import attr
-
from apache_beam.examples.cookbook import bigquery_tornadoes
from apache_beam.io.gcp.tests import utils
from apache_beam.io.gcp.tests.bigquery_matcher import BigqueryMatcher
from apache_beam.testing.pipeline_verifiers import PipelineStateMatcher
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.core.allof import all_of
+from nose.plugins.attrib import attr
class BigqueryTornadoesIT(unittest.TestCase):
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline_test.py>:after 2018-03-23 19:26:44.443558
@@ -20,12 +20,11 @@
import logging
import unittest
-from hamcrest.core.assert_that import assert_that as hc_assert_that
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.testing.test_pipeline import TestPipeline
+from hamcrest.core.assert_that import assert_that as hc_assert_that
+from hamcrest.core.base_matcher import BaseMatcher
# A simple matcher that is ued for testing extra options appending.
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:before 2018-01-24 00:22:36.959311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers.py>:after 2018-03-23 19:26:44.458369
@@ -25,12 +25,11 @@
import logging
import time
-from hamcrest.core.base_matcher import BaseMatcher
-
from apache_beam.io.filesystems import FileSystems
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import test_utils as utils
from apache_beam.utils import retry
+from hamcrest.core.base_matcher import BaseMatcher
__all__ = [
'PipelineStateMatcher',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:before 2018-02-14 17:17:58.815289
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/pipeline_verifiers_test.py>:after 2018-03-23 19:26:44.475372
@@ -21,7 +21,6 @@
import tempfile
import unittest
-from hamcrest import assert_that as hc_assert_that
from mock import Mock
from mock import patch
@@ -30,6 +29,7 @@
from apache_beam.runners.runner import PipelineState
from apache_beam.testing import pipeline_verifiers as verifiers
from apache_beam.testing.test_utils import patch_retry
+from hamcrest import assert_that as hc_assert_that
try:
# pylint: disable=wrong-import-order, wrong-import-position
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:before 2018-03-21 03:17:48.486161
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/testing/test_pipeline.py>:after 2018-03-23 19:26:44.564841
@@ -20,12 +20,11 @@
import argparse
import shlex
-from nose.plugins.skip import SkipTest
-
from apache_beam.internal import pickler
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.pipeline import Pipeline
from apache_beam.runners.runner import PipelineState
+from nose.plugins.skip import SkipTest
__all__ = [
'TestPipeline',
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:before 2018-02-14 00:08:23.317406
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/combiners_test.py>:after 2018-03-23 19:26:44.848531
@@ -19,10 +19,9 @@
import unittest
-import hamcrest as hc
-
import apache_beam as beam
import apache_beam.transforms.combiners as combine
+import hamcrest as hc
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:before 2018-03-06 17:44:37.983556
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/display_test.py>:after 2018-03-23 19:26:44.879364
@@ -22,16 +22,16 @@
import unittest
from datetime import datetime
+import six
+
+import apache_beam as beam
# pylint: disable=ungrouped-imports
import hamcrest as hc
-import six
-from hamcrest.core.base_matcher import BaseMatcher
-
-import apache_beam as beam
from apache_beam.options.pipeline_options import PipelineOptions
from apache_beam.transforms.display import DisplayData
from apache_beam.transforms.display import DisplayDataItem
from apache_beam.transforms.display import HasDisplayData
+from hamcrest.core.base_matcher import BaseMatcher
# pylint: enable=ungrouped-imports
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:before 2018-03-01 20:03:53.966026
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/ptransform_test.py>:after 2018-03-23 19:26:45.003122
@@ -26,13 +26,11 @@
import unittest
from functools import reduce
-import hamcrest as hc
-from nose.plugins.attrib import attr
-
import apache_beam as beam
import apache_beam.pvalue as pvalue
import apache_beam.transforms.combiners as combine
import apache_beam.typehints as typehints
+import hamcrest as hc
from apache_beam.io.iobase import Read
from apache_beam.metrics import Metrics
from apache_beam.metrics.metric import MetricsFilter
@@ -49,6 +47,7 @@
from apache_beam.typehints import with_output_types
from apache_beam.typehints.typehints_test import TypeHintTestCase
from apache_beam.utils.windowed_value import WindowedValue
+from nose.plugins.attrib import attr
# Disable frequent lint warning due to pipe operator for chaining transforms.
# pylint: disable=expression-not-assigned
ERROR: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py> Imports are incorrectly sorted.
--- <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:before 2018-01-24 00:22:36.983311
+++ <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/transforms/sideinputs_test.py>:after 2018-03-23 19:26:45.050930
@@ -20,13 +20,12 @@
import logging
import unittest
-from nose.plugins.attrib import attr
-
import apache_beam as beam
from apache_beam.testing.test_pipeline import TestPipeline
from apache_beam.testing.util import assert_that
from apache_beam.testing.util import equal_to
from apache_beam.transforms import window
+from nose.plugins.attrib import attr
class SideInputsTest(unittest.TestCase):
Command exited with non-zero status 1
346.45user 6.78system 1:59.63elapsed 295%CPU (0avgtext+0avgdata 242264maxresident)k
2776inputs+168outputs (1major+645237minor)pagefaults 0swaps
ERROR: InvocationError: '/usr/bin/time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_pylint.sh'>
py3-lint create: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint>
py3-lint installdeps: pycodestyle==2.3.1, pylint==1.7.2, future==0.16.0, isort==4.2.15, flake8==3.5.0
py3-lint inst: <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/dist/apache-beam-2.5.0.dev0.zip>
py3-lint installed: apache-beam==2.5.0.dev0,astroid==1.6.2,avro==1.8.2,backports.functools-lru-cache==1.5,certifi==2018.1.18,chardet==3.0.4,configparser==3.5.0,crcmod==1.7,dill==0.2.6,docopt==0.6.2,enum34==1.1.6,flake8==3.5.0,funcsigs==1.0.2,future==0.16.0,futures==3.2.0,grpcio==1.10.0,hdfs==2.1.0,httplib2==0.9.2,idna==2.6,isort==4.2.15,lazy-object-proxy==1.3.1,mccabe==0.6.1,mock==2.0.0,oauth2client==4.1.2,pbr==3.1.1,protobuf==3.5.2.post1,pyasn1==0.4.2,pyasn1-modules==0.2.1,pycodestyle==2.3.1,pyflakes==1.6.0,pylint==1.7.2,PyVCF==0.6.8,PyYAML==3.12,requests==2.18.4,rsa==3.4.2,singledispatch==3.4.0.3,six==1.11.0,typing==3.6.4,urllib3==1.22,wrapt==1.10.11
py3-lint runtests: PYTHONHASHSEED='3583413236'
py3-lint runtests: commands[0] | python --version
Python 2.7.6
py3-lint runtests: commands[1] | pip --version
pip 9.0.3 from <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py3-lint/local/lib/python2.7/site-packages> (python 2.7)
py3-lint runtests: commands[2] | time <https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/run_mini_py3lint.sh>
Running flake8 for module apache_beam:
0
27.46user 0.24system 0:10.19elapsed 271%CPU (0avgtext+0avgdata 68324maxresident)k
8inputs+0outputs (0major+89651minor)pagefaults 0swaps
___________________________________ summary ____________________________________
cover: commands succeeded
ERROR: docs: commands failed
ERROR: py27: commands failed
ERROR: py27-cython2: commands failed
ERROR: py27-gcp: commands failed
ERROR: py27-lint: commands failed
py3-lint: commands succeeded
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4491
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4491/display/redirect?page=changes>
Changes:
[szewinho] [BEAM-3060] Fixing mvn dependency issue when runnning filebasedIOIT
[szewinho] Jax-api added to dependencyManagement.
[szewinho] Jaxb-api added to beam root pom.xml
[szewinho] Removed empty line
[szewinho] Updated gradle build to use jaxb-api. Jaxb-api version set to 2.2.12
[szewinho] Scope removed from root pom.xml and jaxb-api dependency set to
[tgroh] Move getId to the top-level pipeline node
[tgroh] Add FusedPipeline#toPipeline
[markliu] [BEAM-3861] Complete streaming wordcount test in Python SDK
------------------------------------------
[...truncated 1.12 MB...]
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s15"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1"
}
},
{
"kind": "ParallelDo",
"name": "s33",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2018-03-23T18:18:12.533246Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-03-23_11_18_11-14760280691419771484'
location: u'us-central1'
name: u'beamapp-jenkins-0323181810-013745'
projectId: u'apache-beam-testing'
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-23_11_18_11-14760280691419771484]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_11_18_11-14760280691419771484?project=apache-beam-testing
root: INFO: Job 2018-03-23_11_18_11-14760280691419771484 is in state JOB_STATE_PENDING
root: INFO: 2018-03-23T18:18:11.759Z: JOB_MESSAGE_WARNING: Job 2018-03-23_11_18_11-14760280691419771484 might autoscale up to 250 workers.
root: INFO: 2018-03-23T18:18:11.792Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-23_11_18_11-14760280691419771484. The number of workers will be between 1 and 250.
root: INFO: 2018-03-23T18:18:11.815Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-23_11_18_11-14760280691419771484.
root: INFO: 2018-03-23T18:18:14.092Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-23T18:18:14.255Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-23T18:18:14.567Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T18:18:14.604Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-23T18:18:14.633Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-23T18:18:14.666Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T18:18:14.694Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-23T18:18:14.732Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-23T18:18:14.775Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-23T18:18:14.816Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T18:18:14.847Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T18:18:14.873Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T18:18:14.907Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T18:18:14.938Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-23T18:18:14.966Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-23T18:18:14.999Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-23T18:18:15.034Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-23T18:18:15.094Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-23T18:18:15.145Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-23T18:18:15.182Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-23T18:18:15.214Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-23T18:18:15.248Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-23T18:18:15.272Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-23T18:18:15.308Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-23T18:18:15.340Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-23T18:18:15.375Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-23T18:18:15.404Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-23T18:18:15.424Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T18:18:15.460Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T18:18:15.496Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T18:18:15.533Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T18:18:15.567Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T18:18:15.601Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T18:18:15.649Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-23T18:18:15.685Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-23T18:18:15.721Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-23T18:18:15.759Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-23T18:18:15.794Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-23T18:18:15.839Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-23T18:18:15.874Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: Job 2018-03-23_11_18_11-14760280691419771484 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-23T18:18:16.034Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-23T18:18:16.099Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-23T18:18:16.135Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-23T18:18:16.137Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T18:18:16.186Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T18:18:23.702Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T18:18:23.768Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-23T18:18:23.807Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-23T18:18:23.876Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-23T18:18:28.987Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-23T18:18:40.569Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T18:18:40.596Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-23T18:18:56.433Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T18:19:12.873Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-23T18:23:42.425Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-23T18:25:10.243Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 170, in execute
op.finish()
File "dataflow_worker/native_operations.py", line 93, in dataflow_worker.native_operations.NativeWriteOperation.finish
def finish(self):
File "dataflow_worker/native_operations.py", line 94, in dataflow_worker.native_operations.NativeWriteOperation.finish
with self.scoped_finish_state:
File "dataflow_worker/native_operations.py", line 95, in dataflow_worker.native_operations.NativeWriteOperation.finish
self.writer.__exit__(None, None, None)
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/nativeavroio.py", line 161, in __exit__
self._data_file_writer.close()
File "/usr/local/lib/python2.7/dist-packages/avro/datafile.py", line 219, in close
self.flush()
File "/usr/local/lib/python2.7/dist-packages/avro/datafile.py", line 215, in flush
self.writer.flush()
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/filesystemio.py", line 186, in write
self._uploader.put(b)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/gcp/gcsio.py", line 569, in put
self._conn.send_bytes(data.tobytes())
IOError: [Errno 32] Broken pipe
root: INFO: 2018-03-23T18:26:17.308Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-23T18:26:17.334Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S01:write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0 failed., Unable to rename output files from gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323181810-013745.1521829090.013889/dax-tmp-2018-03-23_11_18_11-14760280691419771484-S01-2-3b29ba0936731441/tmp-3b29ba09367316ce@DAX.avro to gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323181810-013745.1521829090.013889/tmp-3b29ba09367316ce@*.avro., Unable to rename "gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323181810-013745.1521829090.013889/dax-tmp-2018-03-23_11_18_11-14760280691419771484-S01-2-3b29ba0936731441/tmp-3b29ba09367316ce-shard--try-504d971526771022-endshard.avro" to "gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323181810-013745.1521829090.013889/tmp-3b29ba09367316ce-00000-of-00001.avro".
root: INFO: 2018-03-23T18:26:17.444Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-23T18:26:17.491Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-23T18:26:17.517Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-23T18:27:54.455Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T18:27:54.490Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-03-23T18:27:54.516Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-23_11_18_11-14760280691419771484 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 4 tests in 594.592s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_11_18_11-14760280691419771484?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_11_18_10-1000826102184644317?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_11_18_10-17602005899166351106?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_11_18_22-10310897882069753127?project=apache-beam-testing.
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4490
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4490/display/redirect>
------------------------------------------
[...truncated 1.02 MB...]
copying apache_beam/runners/sdf_common.py -> apache-beam-2.5.0.dev0/apache_beam/runners
copying apache_beam/runners/dataflow/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_metrics.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_metrics_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/ptransform_overrides.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/template_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/test_dataflow_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/internal/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/apiclient.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/apiclient_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/dependency.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/dependency_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/names.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/clients/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients
copying apache_beam/runners/dataflow/internal/clients/dataflow/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_messages.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/message_matchers.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/message_matchers_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/native_io/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/dataflow/native_io/iobase.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/dataflow/native_io/iobase_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/dataflow/native_io/streaming_create.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/direct/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/bundle_factory.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/clock.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/consumer_tracking_pipeline_visitor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/consumer_tracking_pipeline_visitor_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_metrics.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_metrics_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/evaluation_context.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/executor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/helper_transforms.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/sdf_direct_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/sdf_direct_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/transform_evaluator.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/util.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/watermark_manager.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/experimental/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental
copying apache_beam/runners/experimental/python_rpc_direct/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental/python_rpc_direct
copying apache_beam/runners/experimental/python_rpc_direct/python_rpc_direct_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental/python_rpc_direct
copying apache_beam/runners/experimental/python_rpc_direct/server.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental/python_rpc_direct
copying apache_beam/runners/job/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/manager.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/utils.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/data/standard_coders.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/tools/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
Writing apache-beam-2.5.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.5.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run integration tests on the Google Cloud Dataflow service
# and validate that jobs finish successfully.
echo ">>> RUNNING TEST DATAFLOW RUNNER it tests"
>>> RUNNING TEST DATAFLOW RUNNER it tests
python setup.py nosetests \
--attr IT \
--nocapture \
--processes=4 \
--process-timeout=900 \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--staging_location=$GCS_LOCATION/staging-it \
--temp_location=$GCS_LOCATION/temp-it \
--output=$GCS_LOCATION/py-it-cloud/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--sleep_secs=20"
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/setuptools/dist.py>:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
running nosetests
running egg_info
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_08_28_06-8460792149394878073?project=apache-beam-testing
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
======================================================================
ERROR: test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py",> line 812, in run
test(orig)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py",> line 45, in __call__
return self.run(*arg, **kwarg)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py",> line 133, in run
self.runTest(result)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py",> line 151, in runTest
test(result)
File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__
return self.run(*args, **kwds)
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 66, in test_wordcount_it
wordcount.run(test_pipeline.get_full_options_as_args(**extra_opts))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 115, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline.py",> line 389, in run
self.to_runner_api(), self.runner, self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline.py",> line 402, in run
return self.runner.run_pipeline(self)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 57, in run_pipeline
self.result.wait_until_finish()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1071, in wait_until_finish
time.sleep(5.0)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py",> line 276, in signalhandler
raise TimedOutException()
TimedOutException: 'test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT)'
----------------------------------------------------------------------
Ran 3 tests in 901.108s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_08_28_05-2247507685079779109?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_08_28_06-14536084024593006979?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4489
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4489/display/redirect>
------------------------------------------
[...truncated 1.02 MB...]
copying apache_beam/runners/sdf_common.py -> apache-beam-2.5.0.dev0/apache_beam/runners
copying apache_beam/runners/dataflow/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_metrics.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_metrics_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/dataflow_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/ptransform_overrides.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/template_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/test_dataflow_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow
copying apache_beam/runners/dataflow/internal/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/apiclient.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/apiclient_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/dependency.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/dependency_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/names.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal
copying apache_beam/runners/dataflow/internal/clients/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients
copying apache_beam/runners/dataflow/internal/clients/dataflow/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_messages.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/message_matchers.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/internal/clients/dataflow/message_matchers_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/internal/clients/dataflow
copying apache_beam/runners/dataflow/native_io/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/dataflow/native_io/iobase.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/dataflow/native_io/iobase_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/dataflow/native_io/streaming_create.py -> apache-beam-2.5.0.dev0/apache_beam/runners/dataflow/native_io
copying apache_beam/runners/direct/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/bundle_factory.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/clock.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/consumer_tracking_pipeline_visitor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/consumer_tracking_pipeline_visitor_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_metrics.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_metrics_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/direct_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/evaluation_context.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/executor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/helper_transforms.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/sdf_direct_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/sdf_direct_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/transform_evaluator.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/util.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/direct/watermark_manager.py -> apache-beam-2.5.0.dev0/apache_beam/runners/direct
copying apache_beam/runners/experimental/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental
copying apache_beam/runners/experimental/python_rpc_direct/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental/python_rpc_direct
copying apache_beam/runners/experimental/python_rpc_direct/python_rpc_direct_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental/python_rpc_direct
copying apache_beam/runners/experimental/python_rpc_direct/server.py -> apache-beam-2.5.0.dev0/apache_beam/runners/experimental/python_rpc_direct
copying apache_beam/runners/job/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/manager.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/utils.py -> apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/data/standard_coders.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/testing/data/trigger_transcripts.yaml -> apache-beam-2.5.0.dev0/apache_beam/testing/data
copying apache_beam/tools/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py -> apache-beam-2.5.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py -> apache-beam-2.5.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py -> apache-beam-2.5.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py -> apache-beam-2.5.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py -> apache-beam-2.5.0.dev0/apache_beam/utils
Writing apache-beam-2.5.0.dev0/setup.cfg
creating dist
Creating tar archive
removing 'apache-beam-2.5.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run integration tests on the Google Cloud Dataflow service
# and validate that jobs finish successfully.
echo ">>> RUNNING TEST DATAFLOW RUNNER it tests"
>>> RUNNING TEST DATAFLOW RUNNER it tests
python setup.py nosetests \
--attr IT \
--nocapture \
--processes=4 \
--process-timeout=900 \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--staging_location=$GCS_LOCATION/staging-it \
--temp_location=$GCS_LOCATION/temp-it \
--output=$GCS_LOCATION/py-it-cloud/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--sleep_secs=20"
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/local/lib/python2.7/site-packages/setuptools/dist.py>:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
running nosetests
running egg_info
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:168: DeprecationWarning: object() takes no parameters
super(GcsIO, cls).__new__(cls, storage_client))
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ok
test_bigquery_tornadoes_it (apache_beam.examples.cookbook.bigquery_tornadoes_it_test.BigqueryTornadoesIT) ... ok
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_02_27_56-7914118929481027902?project=apache-beam-testing
test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... ERROR
======================================================================
ERROR: test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py",> line 812, in run
test(orig)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py",> line 45, in __call__
return self.run(*arg, **kwarg)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py",> line 133, in run
self.runTest(result)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/case.py",> line 151, in runTest
test(result)
File "/usr/lib/python2.7/unittest/case.py", line 395, in __call__
return self.run(*args, **kwds)
File "/usr/lib/python2.7/unittest/case.py", line 331, in run
testMethod()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py",> line 66, in test_wordcount_it
wordcount.run(test_pipeline.get_full_options_as_args(**extra_opts))
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/examples/wordcount.py",> line 115, in run
result = p.run()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline.py",> line 389, in run
self.to_runner_api(), self.runner, self._options).run(False)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/pipeline.py",> line 402, in run
return self.runner.run_pipeline(self)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py",> line 57, in run_pipeline
self.result.wait_until_finish()
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py",> line 1071, in wait_until_finish
time.sleep(5.0)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/.eggs/nose-1.3.7-py2.7.egg/nose/plugins/multiprocess.py",> line 276, in signalhandler
raise TimedOutException()
TimedOutException: 'test_wordcount_it (apache_beam.examples.wordcount_it_test.WordCountIT)'
----------------------------------------------------------------------
Ran 3 tests in 901.082s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_02_27_55-5858532687445735970?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-23_02_28_01-11047777274297853583?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4488
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4488/display/redirect?page=changes>
Changes:
[altay] Convert big query writes to beam.io.WriteToBigQuery
------------------------------------------
[...truncated 1.12 MB...]
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0"
}
},
{
"kind": "ParallelDo",
"name": "s32",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s15"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1"
}
},
{
"kind": "ParallelDo",
"name": "s33",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "<lambda>"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2018-03-23T06:55:57.024374Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-03-22_23_55_55-11818490079660522886'
location: u'us-central1'
name: u'beamapp-jenkins-0323065553-986875'
projectId: u'apache-beam-testing'
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-22_23_55_55-11818490079660522886]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_23_55_55-11818490079660522886?project=apache-beam-testing
root: INFO: Job 2018-03-22_23_55_55-11818490079660522886 is in state JOB_STATE_PENDING
root: INFO: 2018-03-23T06:55:55.718Z: JOB_MESSAGE_WARNING: Job 2018-03-22_23_55_55-11818490079660522886 might autoscale up to 250 workers.
root: INFO: 2018-03-23T06:55:55.726Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-22_23_55_55-11818490079660522886. The number of workers will be between 1 and 250.
root: INFO: 2018-03-23T06:55:55.738Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_23_55_55-11818490079660522886.
root: INFO: 2018-03-23T06:55:58.849Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-23T06:55:59.009Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-23T06:55:59.316Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T06:55:59.335Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-23T06:55:59.355Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-23T06:55:59.367Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T06:55:59.389Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-23T06:55:59.410Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-23T06:55:59.438Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-23T06:55:59.457Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T06:55:59.478Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T06:55:59.489Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T06:55:59.509Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T06:55:59.528Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-23T06:55:59.550Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-23T06:55:59.570Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-23T06:55:59.584Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-23T06:55:59.601Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-23T06:55:59.617Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-23T06:55:59.631Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-23T06:55:59.649Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-23T06:55:59.662Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-23T06:55:59.675Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-23T06:55:59.691Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-23T06:55:59.705Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-23T06:55:59.719Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-23T06:55:59.735Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-23T06:55:59.749Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T06:55:59.763Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T06:55:59.775Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T06:55:59.795Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T06:55:59.805Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T06:55:59.818Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T06:55:59.830Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-23T06:55:59.845Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-23T06:55:59.862Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-23T06:55:59.876Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-23T06:55:59.897Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-23T06:55:59.908Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-23T06:55:59.926Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-23T06:56:00.031Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-23T06:56:00.081Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-23T06:56:00.103Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-23T06:56:00.116Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-23T06:56:00.123Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T06:56:00.138Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-22_23_55_55-11818490079660522886 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-23T06:56:09.293Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T06:56:09.339Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-23T06:56:09.361Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-23T06:56:09.405Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-23T06:56:14.549Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-23T06:56:26.225Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T06:56:26.248Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-23T06:56:40.286Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-23T06:56:42.087Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T07:01:04.434Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-23T07:01:54.230Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-23T07:01:54.253Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S01:write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0 failed., Unable to rename output files from gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323065553-986875.1521788153.987010/dax-tmp-2018-03-22_23_55_55-11818490079660522886-S01-2-ce13482c0d0d758a/tmp-ce13482c0d0d7b01@DAX.avro to gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323065553-986875.1521788153.987010/tmp-ce13482c0d0d7b01@*.avro., Unable to rename "gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323065553-986875.1521788153.987010/dax-tmp-2018-03-22_23_55_55-11818490079660522886-S01-2-ce13482c0d0d758a/tmp-ce13482c0d0d7b01-shard--try-45a581cdfeee976d-endshard.avro" to "gs://temp-storage-for-end-to-end-tests/temp-it/beamapp-jenkins-0323065553-986875.1521788153.987010/tmp-ce13482c0d0d7b01-00000-of-00001.avro".
root: INFO: 2018-03-23T07:01:54.391Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-23T07:01:54.437Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-23T07:01:54.465Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-23T07:03:43.106Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T07:03:43.155Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-03-23T07:03:43.195Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_23_55_55-11818490079660522886 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 479.838s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_23_55_55-11818490079660522886?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_23_55_54-9845132974698820726?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_23_55_55-13126312791456585243?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4487
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4487/display/redirect>
------------------------------------------
[...truncated 1.14 MB...]
File "dataflow_worker/native_operations.py", line 95, in dataflow_worker.native_operations.NativeWriteOperation.finish
self.writer.__exit__(None, None, None)
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/nativeavroio.py", line 161, in __exit__
self._data_file_writer.close()
File "/usr/local/lib/python2.7/dist-packages/avro/datafile.py", line 219, in close
self.flush()
File "/usr/local/lib/python2.7/dist-packages/avro/datafile.py", line 215, in flush
self.writer.flush()
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/filesystemio.py", line 186, in write
self._uploader.put(b)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/gcp/gcsio.py", line 569, in put
self._conn.send_bytes(data.tobytes())
IOError: [Errno 32] Broken pipe
root: INFO: 2018-03-23T05:53:48.620Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 170, in execute
op.finish()
File "dataflow_worker/native_operations.py", line 93, in dataflow_worker.native_operations.NativeWriteOperation.finish
def finish(self):
File "dataflow_worker/native_operations.py", line 94, in dataflow_worker.native_operations.NativeWriteOperation.finish
with self.scoped_finish_state:
File "dataflow_worker/native_operations.py", line 95, in dataflow_worker.native_operations.NativeWriteOperation.finish
self.writer.__exit__(None, None, None)
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/nativeavroio.py", line 161, in __exit__
self._data_file_writer.close()
File "/usr/local/lib/python2.7/dist-packages/avro/datafile.py", line 219, in close
self.flush()
File "/usr/local/lib/python2.7/dist-packages/avro/datafile.py", line 215, in flush
self.writer.flush()
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/filesystemio.py", line 186, in write
self._uploader.put(b)
File "/usr/local/lib/python2.7/dist-packages/apache_beam/io/gcp/gcsio.py", line 569, in put
self._conn.send_bytes(data.tobytes())
IOError: [Errno 32] Broken pipe
root: INFO: 2018-03-23T05:54:14.111Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-23T05:54:14.143Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T05:54:14.156Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T05:54:14.179Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T05:54:14.211Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T05:54:14.241Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T05:54:14.270Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T05:54:14.313Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T05:54:14.344Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T05:54:14.374Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T05:54:14.419Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-23T05:54:14.864Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:14.946Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:15.333Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:16.716Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:17.103Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:17.273Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:17.656Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:18.506Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T05:54:18.554Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-23T05:54:18.578Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032305420-03222242-a6c0-harness-4q9f,
beamapp-jenkins-032305420-03222242-a6c0-harness-4q9f,
beamapp-jenkins-032305420-03222242-a6c0-harness-4q9f,
beamapp-jenkins-032305420-03222242-a6c0-harness-4q9f
root: INFO: 2018-03-23T05:54:18.685Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-23T05:54:18.729Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-23T05:54:18.757Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-23T05:55:51.380Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T05:55:51.713Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_22_42_10-10376722176566405489 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 4 tests in 836.014s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_22_42_10-10376722176566405489?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_22_42_09-4215214317990891874?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_22_42_19-2549265158218595875?project=apache-beam-testing.
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_22_42_09-15253419427098323011?project=apache-beam-testing.
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4486
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4486/display/redirect?page=changes>
Changes:
[alex] Correct BigQuery.write JavaDoc example
[ccy] Replace side inputs when applying PTransformOverrides
[Pablo] Updating dataflow API protocol buffers.
------------------------------------------
[...truncated 1.13 MB...]
root: INFO: 2018-03-23T04:09:51.865Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_21_09_51-16872146442058122105.
root: INFO: 2018-03-23T04:09:54.060Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-23T04:09:54.156Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-23T04:09:54.360Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T04:09:54.380Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-23T04:09:54.401Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-23T04:09:54.427Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T04:09:54.454Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-23T04:09:54.486Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-23T04:09:54.516Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-23T04:09:54.541Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T04:09:54.570Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T04:09:54.581Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T04:09:54.613Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-23T04:09:54.645Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-23T04:09:54.674Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-23T04:09:54.707Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-23T04:09:54.731Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-23T04:09:54.756Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-23T04:09:54.782Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-23T04:09:54.812Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-23T04:09:54.836Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-23T04:09:54.857Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-23T04:09:54.889Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-23T04:09:54.914Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-23T04:09:54.928Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-23T04:09:54.951Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-23T04:09:54.975Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-23T04:09:54.987Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T04:09:55.018Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T04:09:55.040Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T04:09:55.072Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T04:09:55.098Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T04:09:55.130Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-23T04:09:55.161Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-23T04:09:55.191Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-23T04:09:55.220Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-23T04:09:55.252Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-23T04:09:55.274Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-23T04:09:55.302Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-23T04:09:55.333Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-23T04:09:55.471Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-23T04:09:55.532Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-23T04:09:55.544Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-23T04:09:55.555Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-23T04:09:55.573Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-23T04:09:55.586Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-22_21_09_51-16872146442058122105 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-23T04:10:02.809Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T04:10:02.876Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-23T04:10:02.899Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-23T04:10:02.929Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-23T04:10:08.157Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-23T04:10:19.834Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T04:10:19.858Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-23T04:10:35.191Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-23T04:10:35.550Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T04:14:46.864Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-23T04:15:05.330Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-23T04:15:05.362Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T04:15:05.376Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T04:15:05.409Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T04:15:05.442Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T04:15:05.473Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T04:15:05.504Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T04:15:05.561Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T04:15:05.592Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T04:15:05.618Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T04:15:05.674Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-23T04:15:08.119Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T04:15:08.129Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T04:15:10.500Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T04:15:11.535Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T04:15:11.935Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T04:15:12.903Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T04:15:15.315Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T04:15:15.351Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-23T04:15:15.385Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032304094-03222109-c674-harness-8kr1,
beamapp-jenkins-032304094-03222109-c674-harness-8kr1,
beamapp-jenkins-032304094-03222109-c674-harness-8kr1,
beamapp-jenkins-032304094-03222109-c674-harness-8kr1
root: INFO: 2018-03-23T04:15:15.498Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-23T04:15:15.546Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-23T04:15:15.584Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-23T04:17:01.216Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T04:17:01.249Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-03-23T04:17:01.653Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_21_09_51-16872146442058122105 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 444.303s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_21_09_51-16872146442058122105?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_21_09_50-9252830186140073982?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_21_09_51-9187131657095403657?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4485
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4485/display/redirect>
------------------------------------------
[...truncated 956.40 KB...]
test_match_type_variables (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_invalid_key_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_invalid_value_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_valid_composite_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_check_valid_simple_type (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_type_checks_not_dict (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_value_type_must_be_valid_composite_param (apache_beam.typehints.typehints_test.DictHintTestCase) ... ok
test_compatibility (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_generator_argument_hint_invalid_yield_type (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_generator_return_hint_invalid_yield_type (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.GeneratorHintTestCase) ... ok
test_compatibility (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_tuple_compatibility (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_must_be_iterable (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_invalid_composite_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_invalid_simple_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_valid_composite_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_type_check_violation_valid_simple_type (apache_beam.typehints.typehints_test.IterableHintTestCase) ... ok
test_enforce_kv_type_constraint (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_getitem_param_must_be_tuple (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_getitem_param_must_have_length_2 (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_getitem_proxy_to_tuple (apache_beam.typehints.typehints_test.KVHintTestCase) ... ok
test_enforce_list_type_constraint_invalid_composite_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_enforce_list_type_constraint_invalid_simple_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_enforce_list_type_constraint_valid_composite_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_enforce_list_type_constraint_valid_simple_type (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_list_constraint_compatibility (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_list_repr (apache_beam.typehints.typehints_test.ListHintTestCase) ... ok
test_getitem_proxy_to_union (apache_beam.typehints.typehints_test.OptionalHintTestCase) ... ok
test_getitem_sequence_not_allowed (apache_beam.typehints.typehints_test.OptionalHintTestCase) ... ok
test_any_return_type_hint (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_must_be_primitive_type_or_type_constraint (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_must_be_single_return_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_no_kwargs_accepted (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_type_check_composite_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_type_check_simple_type (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_type_check_violation (apache_beam.typehints.typehints_test.ReturnsDecoratorTestCase) ... ok
test_compatibility (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_getitem_invalid_composite_type_param (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_invalid_elem_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_must_be_set (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_valid_elem_composite_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_type_check_valid_elem_simple_type (apache_beam.typehints.typehints_test.SetHintTestCase) ... ok
test_any_argument_type_hint (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_basic_type_assertion (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_composite_type_assertion (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_invalid_only_positional_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_must_be_primitive_type_or_constraint (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_valid_mix_positional_and_keyword_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_valid_only_positional_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_valid_simple_type_arguments (apache_beam.typehints.typehints_test.TakesDecoratorTestCase) ... ok
test_functions_as_regular_generator (apache_beam.typehints.typehints_test.TestGeneratorWrapper) ... ok
test_compatibility (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_compatibility_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_getitem_invalid_ellipsis_type_param (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_getitem_params_must_be_type_or_constraint (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_raw_tuple (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_repr (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_composite_type (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_composite_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_simple_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_invalid_simple_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_must_be_tuple (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_must_have_same_arity (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_composite_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_composite_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_simple_type_arbitrary_length (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_type_check_valid_simple_types (apache_beam.typehints.typehints_test.TupleHintTestCase) ... ok
test_getitem_duplicates_ignored (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_getitem_must_be_valid_type_param (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_getitem_must_be_valid_type_param_cant_be_object_instance (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_getitem_nested_unions_flattened (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_nested_compatibility (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_compatibility (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_enforcement_composite_type_in_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_enforcement_not_part_of_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_enforcement_part_of_union (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_union_hint_repr (apache_beam.typehints.typehints_test.UnionHintTestCase) ... ok
test_deprecated_with_since_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_with_since_current_message (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_deprecated_without_since_should_fail (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_with_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_with_current_message (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_experimental_without_current (apache_beam.utils.annotations_test.AnnotationTests) ... ok
test_frequency (apache_beam.utils.annotations_test.AnnotationTests)
Tests that the filter 'once' is sufficient to print once per ... ok
test_equal_objects (apache_beam.utils.counters_test.CounterNameTest) ... ok
test_hash_two_objects (apache_beam.utils.counters_test.CounterNameTest) ... ok
test_method_forwarding_not_windows (apache_beam.utils.processes_test.Exec) ... ok
test_method_forwarding_windows (apache_beam.utils.processes_test.Exec) ... ok
test_call_two_objects (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_single_failure (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_two_failures (apache_beam.utils.retry_test.RetryStateTest) ... ok
test_log_calls_for_permanent_failure (apache_beam.utils.retry_test.RetryTest) ... ok
test_log_calls_for_transient_failure (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_default_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_decorator (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_initial_delay (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_explicit_number_of_retries (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_http_error_that_should_be_retried (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_http_error_that_should_not_be_retried (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_no_retry_decorator (apache_beam.utils.retry_test.RetryTest) ... ok
test_with_real_clock (apache_beam.utils.retry_test.RetryTest) ... ok
test_arithmetic (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_of (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_precision (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_sort_order (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_str (apache_beam.utils.timestamp_test.DurationTest) ... ok
test_arithmetic (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_of (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_precision (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_sort_order (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_str (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_utc_timestamp (apache_beam.utils.timestamp_test.TimestampTest) ... ok
test_equality (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_hash (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_pickle (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_timestamps (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_with_value (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_no_partial_writeouts (apache_beam.pipeline_test.DirectRunnerRetryTests) ... ok
test_retry_fork_graph (apache_beam.pipeline_test.DirectRunnerRetryTests) ... ok
test_element (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_no_tag (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_tagged (apache_beam.pipeline_test.DoFnTest) ... ok
test_timestamp_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_timestamp_param_map (apache_beam.pipeline_test.DoFnTest) ... ok
test_window_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_attribute_setting (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_defaults (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_dir (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_flag_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_keyword_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_view_as (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_aggregator_empty_input (apache_beam.pipeline_test.PipelineTest) ... ok
test_apply_custom_transform (apache_beam.pipeline_test.PipelineTest) ... ok
test_create (apache_beam.pipeline_test.PipelineTest) ... ok
test_create_singleton_pcollection (apache_beam.pipeline_test.PipelineTest) ... ok
test_fake_read (apache_beam.pipeline_test.PipelineTest) ... ok
test_flatmap_builtin (apache_beam.pipeline_test.PipelineTest) ... ok
test_memory_usage (apache_beam.pipeline_test.PipelineTest) ... ok
test_metrics_in_fake_source (apache_beam.pipeline_test.PipelineTest) ... ok
test_pipeline_as_context (apache_beam.pipeline_test.PipelineTest) ... ok
test_ptransform_override_type_hints (apache_beam.pipeline_test.PipelineTest) ... ok
test_ptransform_overrides (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_cloned_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) ... ok
test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... ok
test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok
test_parent_pointer (apache_beam.pipeline_test.RunnerApiTest) ... ok
test_pickling (apache_beam.pipeline_test.RunnerApiTest) ... ok
test_simple (apache_beam.pipeline_test.RunnerApiTest)
Tests serializing, deserializing, and running a simple pipeline. ... ok
test_assingleton_multi_element (apache_beam.pvalue_test.PValueTest) ... ok
test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok
test_file_checksum_matchcer_invalid_sleep_time (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_read_failed (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_service_error (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_sleep_before_verify (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_success (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_pipeline_state_matcher_fails (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher fails when using default expected state ... ok
test_pipeline_state_matcher_given_state (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when matches given state ... ok
test_pipeline_state_matcher_success (apache_beam.testing.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when using default expected state ... ok
test_append_extra_options (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_append_verifier_in_extra_opt (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_create_test_pipeline_options (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_empty_option_args_parsing (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_get_option (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_option_args_parsing (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... ok
test_skip_IT (apache_beam.testing.test_pipeline_test.TestPipelineTest) ... SKIP: IT is skipped because --test-pipeline-options is not specified
test_basic_execution (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_basic_execution_sideinputs (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_basic_execution_sideinputs_batch (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_basic_test_stream (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_gbk_execution_after_processing_trigger_fired (apache_beam.testing.test_stream_test.TestStreamTest)
Advance TestClock to (X + delta) and see the pipeline does finish. ... ok
test_gbk_execution_after_watermark_trigger (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_gbk_execution_no_triggers (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_test_stream_errors (apache_beam.testing.test_stream_test.TestStreamTest) ... ok
test_cleanup_subscriptions (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_cleanup_topics (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_delete_files_fails_with_invalid_arg (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_delete_files_fails_with_io_error (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_delete_files_succeeds (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_temp_dir_removes_files (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_temp_file_field_correct (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_subscriptions_created_fails (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_subscriptions_created_succeeds (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_topics_created_fails (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_wait_for_topics_created_succeeds (apache_beam.testing.test_utils_test.TestUtilsTest) ... ok
test_assert_that_fails (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_fails_on_empty_expected (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_fails_on_empty_input (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_passes (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_passes_empty_equal_to (apache_beam.testing.util_test.UtilTest) ... ok
test_assert_that_passes_empty_is_empty (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_assert_fail_unmatched_timestamp (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_assert_fail_unmatched_value (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_assert_fail_unmatched_window (apache_beam.testing.util_test.UtilTest) ... ok
test_windowed_value_passes (apache_beam.testing.util_test.UtilTest) ... ok
======================================================================
FAIL: test_message_matcher_mismatch (apache_beam.io.gcp.tests.pubsub_matcher_test.PubSubMatcherTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27gcp/local/lib/python2.7/site-packages/mock/mock.py",> line 1305, in patched
return func(*args, **keywargs)
File "<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/apache_beam/io/gcp/tests/pubsub_matcher_test.py",> line 72, in test_message_matcher_mismatch
'%s.\n' % (1, 2, ['a', 'c', 'd']), str(error.exception.args[0]))
AssertionError: "\nExpected: Expected 1 messages.\n but: Got 2 messages. Diffs: ['a', 'c', 'd'].\n" != "\nExpected: Expected 1 messages.\n but: Got 2 messages. Diffs: ['c', 'a', 'd'].\n"
-------------------- >> begin captured logging << --------------------
google.auth.transport._http_client: DEBUG: Making request: GET http://169.254.169.254
google.auth.transport._http_client: DEBUG: Making request: GET http://metadata.google.internal/computeMetadata/v1/project/project-id
root: DEBUG: Start pulling messages from <MagicMock name='subscription().full_name' id='140694631978960'>
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 1544 tests in 183.054s
FAILED (failures=1, skipped=44)
Test failed: <unittest.runner.TextTestResult run=1544 errors=0 failures=1>
error: Test failed: <unittest.runner.TextTestResult run=1544 errors=0 failures=1>
ERROR: InvocationError: '<https://builds.apache.org/job/beam_PostCommit_Python_Verify/ws/src/sdks/python/target/.tox/py27gcp/bin/python> setup.py test'
___________________________________ summary ____________________________________
ERROR: cover: commands failed
docs: commands succeeded
ERROR: lint_py2: commands failed
lint_py3: commands succeeded
py27: commands succeeded
py27cython: commands succeeded
ERROR: py27gcp: commands failed
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4484
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4484/display/redirect?page=changes>
Changes:
[andreas.ehrencrona] [BEAM-2264] Credentials were not being reused between GCS calls
[boyuanz] Add cython annotation to make DistributionAccumulator faster
[ankurgoenka] Send worker_id in all channels to runner Adding
[ehudm] Reduce precommit test timeouts for Java and Go.
[altay] More graceful fallback when grpc is not present.
------------------------------------------
[...truncated 1.20 MB...]
"output_name": "out",
"user_name": "pair_with_one.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s2"
},
"serialized_fn": "ref_AppliedPTransform_pair_with_one_5",
"user_name": "pair_with_one"
}
},
{
"kind": "GroupByKey",
"name": "s4",
"properties": {
"display_data": [],
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "StrUtf8Coder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlzBJUWhJWkWziAeVyGDZmMhY20hU5IeAAajEkY=",
"component_encodings": []
},
{
"@type": "kind:stream",
"component_encodings": [
{
"@type": "VarIntCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxhiUWeeSXOIA5XIYNmYyFjbSFTkh4A89cR+g==",
"component_encodings": []
}
],
"is_stream_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "group_and_sum/GroupByKey.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s3"
},
"serialized_fn": "%0AD%22B%0A%1Dref_Coder_GlobalWindowCoder_1%12%21%0A%1F%0A%1D%0A%1Bbeam%3Acoder%3Aglobal_window%3Av1jT%0A%25%0A%23%0A%21beam%3Awindowfn%3Aglobal_windows%3Av0.1%10%01%1A%1Dref_Coder_GlobalWindowCoder_1%22%02%3A%00%28%010%018%01H%01",
"user_name": "group_and_sum/GroupByKey"
}
},
{
"kind": "ParallelDo",
"name": "s5",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CombineValuesDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CombineValuesDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "group_and_sum/Combine/ParDo(CombineValuesDoFn).out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s4"
},
"serialized_fn": "ref_AppliedPTransform_group_and_sum/Combine/ParDo(CombineValuesDoFn)_9",
"user_name": "group_and_sum/Combine/ParDo(CombineValuesDoFn)"
}
},
{
"kind": "ParallelDo",
"name": "s6",
"properties": {
"display_data": [
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.CallableWrapperDoFn",
"type": "STRING",
"value": "format_result"
},
{
"key": "fn",
"label": "Transform Function",
"namespace": "apache_beam.transforms.core.ParDo",
"shortValue": "CallableWrapperDoFn",
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "format.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s5"
},
"serialized_fn": "ref_AppliedPTransform_format_10",
"user_name": "format"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2018-03-23T01:49:42.973143Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-03-22_18_49_41-4392158031952189039'
location: u'us-central1'
name: u'beamapp-jenkins-0323014940-130141'
projectId: u'apache-beam-testing'
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-22_18_49_41-4392158031952189039]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_18_49_41-4392158031952189039?project=apache-beam-testing
root: INFO: Job 2018-03-22_18_49_41-4392158031952189039 is in state JOB_STATE_PENDING
root: INFO: 2018-03-23T01:49:41.302Z: JOB_MESSAGE_WARNING: Job 2018-03-22_18_49_41-4392158031952189039 might autoscale up to 250 workers.
root: INFO: 2018-03-23T01:49:41.339Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-22_18_49_41-4392158031952189039. The number of workers will be between 1 and 250.
root: INFO: 2018-03-23T01:49:41.544Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_18_49_41-4392158031952189039.
root: INFO: 2018-03-23T01:49:45.686Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-23T01:49:45.857Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-23T01:49:46.161Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts.
root: INFO: 2018-03-23T01:49:46.200Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T01:49:46.220Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group_and_sum/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-23T01:49:46.250Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-23T01:49:46.280Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-23T01:49:46.321Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-23T01:49:46.353Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-23T01:49:46.377Z: JOB_MESSAGE_DETAILED: Fusing consumer group_and_sum/GroupByKey/Reify into pair_with_one
root: INFO: 2018-03-23T01:49:46.398Z: JOB_MESSAGE_DETAILED: Fusing consumer format into group_and_sum/Combine/ParDo(CombineValuesDoFn)
root: INFO: 2018-03-23T01:49:46.424Z: JOB_MESSAGE_DETAILED: Fusing consumer group_and_sum/Combine/ParDo(CombineValuesDoFn) into group_and_sum/GroupByKey/GroupByWindow
root: INFO: 2018-03-23T01:49:46.457Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-23T01:49:46.490Z: JOB_MESSAGE_DETAILED: Fusing consumer group_and_sum/GroupByKey/Write into group_and_sum/GroupByKey/Reify
root: INFO: 2018-03-23T01:49:46.518Z: JOB_MESSAGE_DETAILED: Fusing consumer group_and_sum/GroupByKey/GroupByWindow into group_and_sum/GroupByKey/Read
root: INFO: 2018-03-23T01:49:46.549Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-23T01:49:46.579Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-23T01:49:46.605Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-23T01:49:46.627Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-23T01:49:46.753Z: JOB_MESSAGE_DEBUG: Executing wait step start13
root: INFO: 2018-03-23T01:49:46.814Z: JOB_MESSAGE_BASIC: Executing operation group_and_sum/GroupByKey/Create
root: INFO: 2018-03-23T01:49:46.854Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-23T01:49:46.888Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-23T01:49:46.959Z: JOB_MESSAGE_DEBUG: Value "group_and_sum/GroupByKey/Session" materialized.
root: INFO: 2018-03-23T01:49:47.026Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group_and_sum/GroupByKey/Reify+group_and_sum/GroupByKey/Write
root: INFO: Job 2018-03-22_18_49_41-4392158031952189039 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-23T01:49:56.267Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T01:50:51.642Z: JOB_MESSAGE_ERROR: Startup of the worker pool in zone us-central1-f failed to bring up any of the desired 1 workers. QUOTA_EXCEEDED: Quota 'DISKS_TOTAL_GB' exceeded. Limit: 21000.0 in region us-central1.
root: INFO: 2018-03-23T01:50:51.674Z: JOB_MESSAGE_ERROR: Workflow failed.
root: INFO: 2018-03-23T01:50:51.787Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-23T01:50:51.818Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-23T01:50:51.848Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-23T01:51:07.948Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-03-23T01:51:07.991Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_18_49_41-4392158031952189039 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 99.087s
FAILED (errors=4)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_18_49_41-4392158031952189039?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_18_49_41-3990634883316058175?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_18_49_40-1977680738515558545?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user ankurgoenka@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4483
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4483/display/redirect>
------------------------------------------
[...truncated 1.12 MB...]
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2018-03-22T23:57:55.542221Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-03-22_16_57_54-5194148899779802903'
location: u'us-central1'
name: u'beamapp-jenkins-0322235751-641716'
projectId: u'apache-beam-testing'
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-22_16_57_54-5194148899779802903]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_16_57_54-5194148899779802903?project=apache-beam-testing
root: INFO: Job 2018-03-22_16_57_54-5194148899779802903 is in state JOB_STATE_PENDING
root: INFO: 2018-03-22T23:57:54.598Z: JOB_MESSAGE_WARNING: Job 2018-03-22_16_57_54-5194148899779802903 might autoscale up to 250 workers.
root: INFO: 2018-03-22T23:57:54.606Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-22_16_57_54-5194148899779802903. The number of workers will be between 1 and 250.
root: INFO: 2018-03-22T23:57:54.618Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_16_57_54-5194148899779802903.
root: INFO: 2018-03-22T23:57:57.360Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-22T23:57:57.520Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-22T23:57:57.771Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T23:57:57.787Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T23:57:57.798Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T23:57:57.811Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T23:57:57.825Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-22T23:57:57.842Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-22T23:57:57.866Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-22T23:57:57.877Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T23:57:57.889Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T23:57:57.900Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T23:57:57.910Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T23:57:57.920Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-22T23:57:57.934Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-22T23:57:57.955Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-22T23:57:57.966Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-22T23:57:57.993Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-22T23:57:58.064Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-22T23:57:58.101Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-22T23:57:58.114Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-22T23:57:58.126Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-22T23:57:58.137Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-22T23:57:58.152Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-22T23:57:58.164Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-22T23:57:58.175Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-22T23:57:58.189Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-22T23:57:58.200Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T23:57:58.211Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T23:57:58.222Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T23:57:58.233Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T23:57:58.243Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T23:57:58.254Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T23:57:58.265Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-22T23:57:58.276Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T23:57:58.289Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T23:57:58.303Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-22T23:57:58.314Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-22T23:57:58.327Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-22T23:57:58.339Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-22T23:57:58.429Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-22T23:57:58.456Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-22T23:57:58.467Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-22T23:57:58.480Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-22T23:57:58.485Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-22T23:57:58.493Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-22_16_57_54-5194148899779802903 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-22T23:58:08.270Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T23:58:08.310Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-22T23:58:08.335Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-22T23:58:08.371Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-22T23:58:13.559Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-22T23:58:57.478Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T23:58:57.495Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-22T23:59:13.600Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T00:00:35.332Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-23T00:03:31.410Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-23T00:03:31.454Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T00:03:31.491Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T00:03:31.523Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-23T00:03:31.563Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T00:03:31.604Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T00:03:31.633Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-23T00:03:31.701Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T00:03:31.733Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T00:03:31.770Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-23T00:03:33.809Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-23T00:03:33.867Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-23T00:03:37.147Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 343, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 344, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 376, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 484, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 202, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 312, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T00:03:40.671Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 343, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 344, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 376, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 484, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 202, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 312, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T00:03:44.089Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 343, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 344, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 376, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 484, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 202, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 312, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T00:03:47.504Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 343, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 344, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 376, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 484, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 202, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 312, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-23T00:03:47.552Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-23T00:03:47.583Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032223575-03221657-720a-harness-bkxr,
beamapp-jenkins-032223575-03221657-720a-harness-bkxr,
beamapp-jenkins-032223575-03221657-720a-harness-bkxr,
beamapp-jenkins-032223575-03221657-720a-harness-bkxr
root: INFO: 2018-03-23T00:03:47.696Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-23T00:03:47.749Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-23T00:03:47.780Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-23T00:05:06.747Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-23T00:05:07.148Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_16_57_54-5194148899779802903 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 452.290s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_16_57_51-17802523902231668139?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_16_57_52-16106480042311032250?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_16_57_54-5194148899779802903?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user markliu@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4482
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4482/display/redirect?page=changes>
Changes:
[coheigea] Remove "i == numSplits" condition, which can never be reached as i is
[wcn] BEAM-3894: Add Protocol Buffer support
[aaltay] Improve test util for PubSub exist check (#4922)
[XuMingmin] [BEAM-3851] Option to preserve element timestamp while publishing to
------------------------------------------
[...truncated 1.12 MB...]
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2018-03-22T20:21:39.396842Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-03-22_13_21_38-9685367195362563694'
location: u'us-central1'
name: u'beamapp-jenkins-0322202136-775893'
projectId: u'apache-beam-testing'
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-22_13_21_38-9685367195362563694]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_13_21_38-9685367195362563694?project=apache-beam-testing
root: INFO: Job 2018-03-22_13_21_38-9685367195362563694 is in state JOB_STATE_PENDING
root: INFO: 2018-03-22T20:21:38.483Z: JOB_MESSAGE_WARNING: Job 2018-03-22_13_21_38-9685367195362563694 might autoscale up to 250 workers.
root: INFO: 2018-03-22T20:21:38.512Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-22_13_21_38-9685367195362563694. The number of workers will be between 1 and 250.
root: INFO: 2018-03-22T20:21:38.526Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_13_21_38-9685367195362563694.
root: INFO: 2018-03-22T20:21:41.389Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-22T20:21:41.557Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-22T20:21:41.973Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T20:21:42.005Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T20:21:42.039Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T20:21:42.072Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T20:21:42.106Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-22T20:21:42.148Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-22T20:21:42.207Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-22T20:21:42.243Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T20:21:42.267Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T20:21:42.306Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T20:21:42.339Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T20:21:42.380Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-22T20:21:42.411Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-22T20:21:42.448Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-22T20:21:42.483Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-22T20:21:42.526Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-22T20:21:42.553Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-22T20:21:42.590Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-22T20:21:42.627Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-22T20:21:42.668Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-22T20:21:42.691Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-22T20:21:42.729Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-22T20:21:42.766Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-22T20:21:42.798Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-22T20:21:42.835Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-22T20:21:42.873Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T20:21:42.900Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T20:21:42.936Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T20:21:42.972Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T20:21:43.006Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T20:21:43.031Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T20:21:43.064Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-22T20:21:43.108Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T20:21:43.148Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T20:21:43.196Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-22T20:21:43.239Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-22T20:21:43.274Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-22T20:21:43.310Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-22T20:21:43.484Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-22T20:21:43.558Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-22T20:21:43.595Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-22T20:21:43.609Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-22T20:21:43.630Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-22T20:21:43.643Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-22_13_21_38-9685367195362563694 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-22T20:21:52.836Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T20:21:52.906Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-22T20:21:52.929Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-22T20:21:52.993Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-22T20:21:58.081Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-22T20:22:09.559Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T20:22:09.575Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-22T20:22:25.391Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T20:23:48.373Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-22T20:26:47.733Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-22T20:26:48.138Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T20:26:48.172Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T20:26:48.213Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T20:26:48.318Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T20:26:48.354Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T20:26:48.398Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T20:26:48.426Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T20:26:48.468Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T20:26:48.496Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T20:26:50.457Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-22T20:26:50.518Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-22T20:26:53.002Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T20:26:53.828Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T20:26:54.454Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T20:26:56.881Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T20:26:57.209Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T20:26:58.265Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T20:26:58.328Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-22T20:26:58.352Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032220213-03221321-9c9d-harness-cvp7,
beamapp-jenkins-032220213-03221321-9c9d-harness-cvp7,
beamapp-jenkins-032220213-03221321-9c9d-harness-cvp7,
beamapp-jenkins-032220213-03221321-9c9d-harness-cvp7
root: INFO: 2018-03-22T20:26:58.474Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-22T20:26:58.524Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-22T20:26:58.560Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-22T20:28:22.836Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T20:28:23.089Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_13_21_38-9685367195362563694 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 443.916s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_13_21_37-15144457536487170844?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_13_21_37-11671473997083909740?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_13_21_38-9685367195362563694?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user markliu@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4481
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4481/display/redirect>
------------------------------------------
[...truncated 1.12 MB...]
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-22_08_27_48-4503521538329967508]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_08_27_48-4503521538329967508?project=apache-beam-testing
root: INFO: Job 2018-03-22_08_27_48-4503521538329967508 is in state JOB_STATE_PENDING
root: INFO: 2018-03-22T15:27:48.911Z: JOB_MESSAGE_WARNING: Job 2018-03-22_08_27_48-4503521538329967508 might autoscale up to 250 workers.
root: INFO: 2018-03-22T15:27:48.927Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-22_08_27_48-4503521538329967508. The number of workers will be between 1 and 250.
root: INFO: 2018-03-22T15:27:48.940Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_08_27_48-4503521538329967508.
root: INFO: 2018-03-22T15:27:51.555Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-22T15:27:51.838Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-22T15:27:52.222Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T15:27:52.250Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T15:27:52.267Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T15:27:52.289Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T15:27:52.312Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-22T15:27:52.343Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-22T15:27:52.383Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-22T15:27:52.402Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T15:27:52.430Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T15:27:52.444Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T15:27:52.459Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T15:27:52.473Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-22T15:27:52.491Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-22T15:27:52.505Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-22T15:27:52.519Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-22T15:27:52.535Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-22T15:27:52.560Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-22T15:27:52.583Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-22T15:27:52.608Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-22T15:27:52.659Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-22T15:27:52.688Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-22T15:27:52.733Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-22T15:27:52.775Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-22T15:27:52.791Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-22T15:27:52.813Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-22T15:27:52.826Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T15:27:52.842Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T15:27:52.861Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T15:27:52.882Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T15:27:52.902Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T15:27:52.916Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T15:27:52.929Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-22T15:27:52.950Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T15:27:52.973Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T15:27:52.989Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-22T15:27:53.019Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-22T15:27:53.042Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-22T15:27:53.059Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-22T15:27:53.186Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-22T15:27:53.226Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-22T15:27:53.245Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-22T15:27:53.260Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-22T15:27:53.267Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-22T15:27:53.281Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-22_08_27_48-4503521538329967508 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-22T15:28:01.087Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T15:28:01.138Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-22T15:28:01.161Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-22T15:28:01.190Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-22T15:28:06.475Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-22T15:28:34.415Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T15:28:34.434Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-22T15:28:50.403Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T15:29:39.626Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-22T15:33:11.618Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-22T15:33:12.484Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-22T15:33:12.498Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T15:33:12.516Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T15:33:12.538Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T15:33:12.555Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T15:33:12.566Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T15:33:12.587Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T15:33:12.637Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T15:33:12.652Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T15:33:12.670Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T15:33:12.705Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-22T15:33:14.149Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T15:33:14.187Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T15:33:17.528Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T15:33:17.579Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T15:33:18.896Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T15:33:20.019Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T15:33:20.326Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T15:33:20.363Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-22T15:33:20.383Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032215274-03220827-7691-harness-ks7c,
beamapp-jenkins-032215274-03220827-7691-harness-741z,
beamapp-jenkins-032215274-03220827-7691-harness-741z,
beamapp-jenkins-032215274-03220827-7691-harness-741z
root: INFO: 2018-03-22T15:33:20.478Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-22T15:33:20.516Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-22T15:33:20.528Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-22T15:35:20.807Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T15:35:20.835Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-03-22T15:35:21.204Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_08_27_48-4503521538329967508 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 479.382s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_08_27_48-12079285622098993197?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_08_27_48-4503521538329967508?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_08_27_48-7029751093444118654?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user markliu@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4480
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4480/display/redirect?page=changes>
Changes:
[robertwb] Add mapper microbenchmark.
[robertwb] Remove from docs generation.
------------------------------------------
[...truncated 1.13 MB...]
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-22_02_39_48-18192979392599446984]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_02_39_48-18192979392599446984?project=apache-beam-testing
root: INFO: Job 2018-03-22_02_39_48-18192979392599446984 is in state JOB_STATE_PENDING
root: INFO: 2018-03-22T09:39:48.795Z: JOB_MESSAGE_WARNING: Job 2018-03-22_02_39_48-18192979392599446984 might autoscale up to 250 workers.
root: INFO: 2018-03-22T09:39:48.823Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-22_02_39_48-18192979392599446984. The number of workers will be between 1 and 250.
root: INFO: 2018-03-22T09:39:48.854Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_02_39_48-18192979392599446984.
root: INFO: 2018-03-22T09:39:52.275Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-22T09:39:52.381Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-22T09:39:52.673Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T09:39:52.703Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T09:39:52.730Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T09:39:52.763Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T09:39:52.795Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-22T09:39:52.833Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-22T09:39:52.871Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-22T09:39:52.898Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T09:39:52.919Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T09:39:52.956Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T09:39:52.987Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T09:39:53.010Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-22T09:39:53.044Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-22T09:39:53.076Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-22T09:39:53.100Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-22T09:39:53.134Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-22T09:39:53.164Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-22T09:39:53.180Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-22T09:39:53.214Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-22T09:39:53.245Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-22T09:39:53.269Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-22T09:39:53.291Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-22T09:39:53.320Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-22T09:39:53.338Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-22T09:39:53.365Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-22T09:39:53.397Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T09:39:53.419Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T09:39:53.446Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T09:39:53.479Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T09:39:53.503Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T09:39:53.525Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T09:39:53.555Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-22T09:39:53.587Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T09:39:53.611Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T09:39:53.642Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-22T09:39:53.672Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-22T09:39:53.698Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-22T09:39:53.723Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-22T09:39:53.857Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-22T09:39:53.916Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-22T09:39:53.935Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-22T09:39:53.947Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-22T09:39:53.957Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-22T09:39:53.978Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-22_02_39_48-18192979392599446984 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-22T09:40:01.835Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T09:40:01.980Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-22T09:40:02.024Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-22T09:40:02.108Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-22T09:40:07.427Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-22T09:40:18.905Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T09:40:18.935Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-22T09:40:34.944Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T09:40:50.171Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-22T09:44:17.538Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-22T09:44:22.728Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-22T09:44:22.765Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T09:44:22.794Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T09:44:22.827Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T09:44:22.864Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T09:44:22.886Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T09:44:22.921Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T09:44:22.958Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T09:44:23.003Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T09:44:23.040Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T09:44:23.110Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-22T09:44:25.585Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T09:44:29.007Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T09:44:32.419Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T09:44:35.803Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T09:44:36.402Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T09:44:38.786Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T09:44:39.182Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T09:44:39.229Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-22T09:44:39.261Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032209394-03220239-569d-harness-8sdz,
beamapp-jenkins-032209394-03220239-569d-harness-8sdz,
beamapp-jenkins-032209394-03220239-569d-harness-8sdz,
beamapp-jenkins-032209394-03220239-569d-harness-8sdz
root: INFO: 2018-03-22T09:44:39.362Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-22T09:44:39.410Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-22T09:44:39.463Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-22T09:45:54.613Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T09:45:54.648Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-03-22T09:45:54.964Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_02_39_48-18192979392599446984 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 379.069s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_02_39_47-1871890338158709136?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_02_39_48-18192979392599446984?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_02_39_48-9166520415542744106?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user markliu@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4479
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4479/display/redirect>
------------------------------------------
[...truncated 1.12 MB...]
"type": "STRING",
"value": "apache_beam.transforms.core.CallableWrapperDoFn"
}
],
"non_parallel_inputs": {},
"output_info": [
{
"encoding": {
"@type": "kind:windowed_value",
"component_encodings": [
{
"@type": "kind:pair",
"component_encodings": [
{
"@type": "kind:bytes"
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": [
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
},
{
"@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/",
"component_encodings": []
}
],
"is_pair_like": true
}
],
"is_pair_like": true
},
{
"@type": "kind:global_window"
}
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s20"
},
"serialized_fn": "<string of 952 bytes>",
"user_name": "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: u'2018-03-22T07:47:25.893654Z'
currentStateTime: u'1970-01-01T00:00:00Z'
id: u'2018-03-22_00_47_24-14565009293034269606'
location: u'us-central1'
name: u'beamapp-jenkins-0322074723-463807'
projectId: u'apache-beam-testing'
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-22_00_47_24-14565009293034269606]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_00_47_24-14565009293034269606?project=apache-beam-testing
root: INFO: Job 2018-03-22_00_47_24-14565009293034269606 is in state JOB_STATE_PENDING
root: INFO: 2018-03-22T07:47:24.951Z: JOB_MESSAGE_WARNING: Job 2018-03-22_00_47_24-14565009293034269606 might autoscale up to 250 workers.
root: INFO: 2018-03-22T07:47:24.983Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-22_00_47_24-14565009293034269606. The number of workers will be between 1 and 250.
root: INFO: 2018-03-22T07:47:25.013Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-22_00_47_24-14565009293034269606.
root: INFO: 2018-03-22T07:47:27.542Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-22T07:47:27.835Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-22T07:47:28.102Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T07:47:28.126Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T07:47:28.161Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-22T07:47:28.183Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-22T07:47:28.213Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-22T07:47:28.247Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-22T07:47:28.280Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-22T07:47:28.304Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T07:47:28.337Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T07:47:28.371Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T07:47:28.394Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-22T07:47:28.418Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-22T07:47:28.439Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-22T07:47:28.460Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-22T07:47:28.482Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-22T07:47:28.504Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-22T07:47:28.533Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-22T07:47:28.563Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-22T07:47:28.595Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-22T07:47:28.626Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-22T07:47:28.663Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-22T07:47:28.692Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-22T07:47:28.716Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-22T07:47:28.747Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-22T07:47:28.778Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-22T07:47:28.806Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T07:47:28.837Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T07:47:28.868Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T07:47:28.900Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T07:47:28.931Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T07:47:28.963Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-22T07:47:28.992Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-22T07:47:29.024Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T07:47:29.055Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T07:47:29.081Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-22T07:47:29.113Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-22T07:47:29.134Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-22T07:47:29.168Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: Job 2018-03-22_00_47_24-14565009293034269606 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-22T07:47:29.299Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-22T07:47:29.362Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-22T07:47:29.394Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-22T07:47:29.406Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-22T07:47:29.422Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-22T07:47:29.434Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-22T07:47:37.393Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T07:47:37.464Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-22T07:47:37.495Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-22T07:47:37.526Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-22T07:47:42.682Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-22T07:47:54.781Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T07:47:54.813Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-22T07:48:08.271Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-22T07:48:32.331Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T07:52:03.707Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-22T07:52:03.785Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T07:52:03.814Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T07:52:03.837Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T07:52:03.865Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T07:52:03.897Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T07:52:03.910Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T07:52:03.965Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T07:52:03.980Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T07:52:04.033Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T07:52:09.737Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-22T07:52:09.799Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-22T07:52:13.031Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T07:52:16.428Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T07:52:19.833Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T07:52:23.251Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T07:52:23.298Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-22T07:52:23.334Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032207472-03220047-2975-harness-0fxm,
beamapp-jenkins-032207472-03220047-2975-harness-0fxm,
beamapp-jenkins-032207472-03220047-2975-harness-0fxm,
beamapp-jenkins-032207472-03220047-2975-harness-0fxm
root: INFO: 2018-03-22T07:52:23.460Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-22T07:52:23.514Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-22T07:52:23.540Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-22T07:53:37.851Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T07:53:38.236Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-22_00_47_24-14565009293034269606 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 384.108s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_00_47_24-14565009293034269606?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_00_47_24-14067514210805660469?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-22_00_47_24-1069003937643754699?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user markliu@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4478
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4478/display/redirect?page=changes>
Changes:
[herohde] [BEAM-3897] Add Go wordcount example with multi output DoFns
[herohde] [BEAM-3866] Remove windowed value requirement for External
[markliu] Clean up terminal state check in TestDataflowRunner
[tgroh] Make RemoteEnvironment public
------------------------------------------
[...truncated 1.13 MB...]
root: INFO: 2018-03-22T02:22:43.709Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-22T02:22:43.741Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T02:22:43.775Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-22T02:22:43.810Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-22T02:22:43.842Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-22T02:22:43.876Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-22T02:22:43.911Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-22T02:22:44.091Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-22T02:22:44.177Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-22T02:22:44.209Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-22T02:22:44.223Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-22T02:22:44.225Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-22T02:22:44.246Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-21_19_22_38-2399826686858835030 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-22T02:22:51.766Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T02:22:51.840Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-22T02:22:51.863Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-22T02:22:51.924Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-22T02:22:57.073Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-22T02:23:09.044Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T02:23:09.075Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-22T02:23:22.955Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-22T02:23:24.974Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T02:27:45.472Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-22T02:27:48.714Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-22T02:27:48.735Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T02:27:48.758Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T02:27:48.789Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-22T02:27:48.824Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T02:27:48.856Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T02:27:48.891Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-22T02:27:48.930Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T02:27:48.961Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T02:27:48.992Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-22T02:27:49.050Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-22T02:27:51.524Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:51.530Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:52.915Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:53.335Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:54.725Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:54.953Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:56.160Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:56.554Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:57.341Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-22T02:27:57.385Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-22T02:27:57.415Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032202223-03211922-31e7-harness-fhjp,
beamapp-jenkins-032202223-03211922-31e7-harness-fhjp,
beamapp-jenkins-032202223-03211922-31e7-harness-fhjp,
beamapp-jenkins-032202223-03211922-31e7-harness-2s1j
root: INFO: 2018-03-22T02:27:57.537Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-22T02:27:57.595Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-22T02:27:57.622Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-22T02:29:16.637Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-22T02:29:17.083Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-21_19_22_38-2399826686858835030 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 418.859s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_19_22_34-9863111785664501396?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_19_22_35-9367960069665094921?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_19_22_38-2399826686858835030?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user markliu@google.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4477
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4477/display/redirect?page=changes>
Changes:
[Pablo] Fixing check for sideinput_io_metrics experiment flag.
[iemejia] Remove testing package-info from main package for GCP IO
[iemejia] Update maven failsafe/surefire plugin to version 2.21.0
[iemejia] [BEAM-3873] Update commons-compress to version 1.16.1 (fix
[iemejia] Remove maven warnings
[tgroh] Add Side Inputs to ExecutableStage
------------------------------------------
[...truncated 1.12 MB...]
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-21_15_53_16-214525430219642121]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_15_53_16-214525430219642121?project=apache-beam-testing
root: INFO: Job 2018-03-21_15_53_16-214525430219642121 is in state JOB_STATE_PENDING
root: INFO: 2018-03-21T22:53:16.074Z: JOB_MESSAGE_WARNING: Job 2018-03-21_15_53_16-214525430219642121 might autoscale up to 250 workers.
root: INFO: 2018-03-21T22:53:16.111Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-21_15_53_16-214525430219642121. The number of workers will be between 1 and 250.
root: INFO: 2018-03-21T22:53:16.139Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-21_15_53_16-214525430219642121.
root: INFO: 2018-03-21T22:53:19.047Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-21T22:53:19.158Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-21T22:53:19.459Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-21T22:53:19.475Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-21T22:53:19.513Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-21T22:53:19.549Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-21T22:53:19.571Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-21T22:53:19.605Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-21T22:53:19.649Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-21T22:53:19.678Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T22:53:19.710Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T22:53:19.732Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T22:53:19.756Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T22:53:19.789Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-21T22:53:19.829Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-21T22:53:19.859Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-21T22:53:19.889Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-21T22:53:19.916Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-21T22:53:19.948Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-21T22:53:19.972Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-21T22:53:20.009Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-21T22:53:20.051Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-21T22:53:20.085Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-21T22:53:20.118Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-21T22:53:20.151Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-21T22:53:20.187Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-21T22:53:20.220Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-21T22:53:20.248Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T22:53:20.281Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T22:53:20.315Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T22:53:20.349Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T22:53:20.380Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T22:53:20.415Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T22:53:20.441Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-21T22:53:20.468Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T22:53:20.498Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T22:53:20.527Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-21T22:53:20.547Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-21T22:53:20.572Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-21T22:53:20.597Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-21T22:53:20.742Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-21T22:53:20.794Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-21T22:53:20.817Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-21T22:53:20.828Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-21T22:53:20.849Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T22:53:20.864Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-21_15_53_16-214525430219642121 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-21T22:53:28.637Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T22:53:28.696Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-21T22:53:28.719Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-21T22:53:28.779Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-21T22:53:33.908Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-21T22:53:56.213Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T22:53:56.237Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-21T22:54:12.051Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T22:55:37.405Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-21T22:58:25.993Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-21T22:58:31.577Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-21T22:58:31.605Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T22:58:31.640Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T22:58:31.663Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T22:58:31.700Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T22:58:31.723Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T22:58:31.760Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T22:58:31.791Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T22:58:31.836Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T22:58:31.893Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T22:58:31.953Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-21T22:58:34.462Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T22:58:37.866Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T22:58:41.271Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T22:58:44.338Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T22:58:44.657Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T22:58:45.729Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T22:58:48.038Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 339, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 372, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T22:58:48.087Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-21T22:58:48.109Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032122531-03211553-9d33-harness-8sg5,
beamapp-jenkins-032122531-03211553-9d33-harness-8sg5,
beamapp-jenkins-032122531-03211553-9d33-harness-8sg5,
beamapp-jenkins-032122531-03211553-9d33-harness-8sg5
root: INFO: 2018-03-21T22:58:48.231Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-21T22:58:48.279Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-21T22:58:48.312Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-21T23:00:20.567Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T23:00:20.897Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-21_15_53_16-214525430219642121 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 488.818s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_15_53_15-7902778553015328114?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_15_53_14-15407973245667696338?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_15_53_16-214525430219642121?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4476
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4476/display/redirect?page=changes>
Changes:
[herohde] Allow manual override of Go worker binary
[lcwik] [BEAM-3903] Build the Go SDK examples using gradle
------------------------------------------
[...truncated 1.12 MB...]
stageStates: []
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2018-03-21_11_16_23-1465920177427462671]
root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_11_16_23-1465920177427462671?project=apache-beam-testing
root: INFO: Job 2018-03-21_11_16_23-1465920177427462671 is in state JOB_STATE_PENDING
root: INFO: 2018-03-21T18:16:23.654Z: JOB_MESSAGE_WARNING: Job 2018-03-21_11_16_23-1465920177427462671 might autoscale up to 250 workers.
root: INFO: 2018-03-21T18:16:23.693Z: JOB_MESSAGE_DETAILED: Autoscaling is enabled for job 2018-03-21_11_16_23-1465920177427462671. The number of workers will be between 1 and 250.
root: INFO: 2018-03-21T18:16:23.723Z: JOB_MESSAGE_DETAILED: Autoscaling was automatically enabled for job 2018-03-21_11_16_23-1465920177427462671.
root: INFO: 2018-03-21T18:16:26.871Z: JOB_MESSAGE_DETAILED: Checking required Cloud APIs are enabled.
root: INFO: 2018-03-21T18:16:27.032Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account.
root: INFO: 2018-03-21T18:16:27.330Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts.
root: INFO: 2018-03-21T18:16:27.359Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step write/Write/WriteImpl/GroupByKey: GroupByKey not followed by a combiner.
root: INFO: 2018-03-21T18:16:27.389Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step group: GroupByKey not followed by a combiner.
root: INFO: 2018-03-21T18:16:27.421Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts.
root: INFO: 2018-03-21T18:16:27.456Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2018-03-21T18:16:27.495Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information.
root: INFO: 2018-03-21T18:16:27.537Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations
root: INFO: 2018-03-21T18:16:27.562Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T18:16:27.595Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T18:16:27.618Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T18:16:27.641Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T18:16:27.673Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-21T18:16:27.707Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-21T18:16:27.740Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-21T18:16:27.765Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-21T18:16:27.798Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-21T18:16:27.831Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-21T18:16:27.864Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-21T18:16:27.899Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-21T18:16:27.931Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-21T18:16:27.964Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-21T18:16:27.987Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-21T18:16:28.018Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-21T18:16:28.051Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-21T18:16:28.077Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-21T18:16:28.108Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T18:16:28.133Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T18:16:28.165Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T18:16:28.196Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T18:16:28.215Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T18:16:28.247Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T18:16:28.279Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-21T18:16:28.309Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T18:16:28.335Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T18:16:28.368Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-21T18:16:28.394Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-21T18:16:28.427Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-21T18:16:28.457Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-21T18:16:28.619Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-21T18:16:28.689Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-21T18:16:28.723Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-21T18:16:28.734Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-21T18:16:28.736Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T18:16:28.760Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: Job 2018-03-21_11_16_23-1465920177427462671 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-21T18:16:36.994Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T18:16:37.050Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-21T18:16:37.076Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-21T18:16:37.103Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-21T18:16:42.255Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-21T18:16:54.071Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T18:16:54.099Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-21T18:17:10.125Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T18:18:42.905Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-21T18:21:48.766Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-21T18:21:48.797Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T18:21:48.831Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T18:21:48.865Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T18:21:48.894Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T18:21:48.922Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T18:21:48.946Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T18:21:49.028Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T18:21:49.057Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T18:21:49.089Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T18:21:55.544Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-21T18:21:55.611Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-21T18:21:58.885Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T18:22:02.284Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T18:22:05.659Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T18:22:06.219Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T18:22:07.620Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T18:22:08.012Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T18:22:09.037Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T18:22:09.083Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-21T18:22:09.110Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032118162-03211116-3956-harness-9l8j,
beamapp-jenkins-032118162-03211116-3956-harness-9l8j,
beamapp-jenkins-032118162-03211116-3956-harness-9l8j,
beamapp-jenkins-032118162-03211116-3956-harness-9l8j
root: INFO: 2018-03-21T18:22:09.223Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-21T18:22:09.269Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-21T18:22:09.292Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-21T18:23:43.669Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T18:23:44.063Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-21_11_16_23-1465920177427462671 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 455.035s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_11_16_23-1465920177427462671?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_11_16_22-11832904031069193979?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_11_16_27-1442778674505625886?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com
Build failed in Jenkins: beam_PostCommit_Python_Verify #4475
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PostCommit_Python_Verify/4475/display/redirect?page=changes>
Changes:
[tgroh] Enable Proto Round Trips in the DirectRunner Tests
[tgroh] Add a suborder parameter to Networks#topologicalOrder
[tgroh] Add QueryablePipeline#forTransforms
------------------------------------------
[...truncated 1.13 MB...]
root: INFO: 2018-03-21T17:00:45.513Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T17:00:45.539Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T17:00:45.566Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T17:00:45.599Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey1 into write/Write/WriteImpl/Extract
root: INFO: 2018-03-21T17:00:45.632Z: JOB_MESSAGE_DETAILED: Fusing consumer pair_with_one into split
root: INFO: 2018-03-21T17:00:45.658Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Reify into pair_with_one
root: INFO: 2018-03-21T17:00:45.680Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Reify into write/Write/WriteImpl/WindowInto(WindowIntoFn)
root: INFO: 2018-03-21T17:00:45.715Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WindowInto(WindowIntoFn) into write/Write/WriteImpl/Pair
root: INFO: 2018-03-21T17:00:45.738Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/WriteBundles into format
root: INFO: 2018-03-21T17:00:45.754Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Pair into write/Write/WriteImpl/WriteBundles/WriteBundles
root: INFO: 2018-03-21T17:00:45.783Z: JOB_MESSAGE_DETAILED: Fusing consumer split into read/Read
root: INFO: 2018-03-21T17:00:45.808Z: JOB_MESSAGE_DETAILED: Fusing consumer count into group/GroupByWindow
root: INFO: 2018-03-21T17:00:45.842Z: JOB_MESSAGE_DETAILED: Fusing consumer format into count
root: INFO: 2018-03-21T17:00:45.876Z: JOB_MESSAGE_DETAILED: Fusing consumer group/Write into group/Reify
root: INFO: 2018-03-21T17:00:45.894Z: JOB_MESSAGE_DETAILED: Fusing consumer group/GroupByWindow into group/Read
root: INFO: 2018-03-21T17:00:45.914Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/Extract into write/Write/WriteImpl/GroupByKey/GroupByWindow
root: INFO: 2018-03-21T17:00:45.947Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/Write into write/Write/WriteImpl/GroupByKey/Reify
root: INFO: 2018-03-21T17:00:46.004Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/GroupByKey/GroupByWindow into write/Write/WriteImpl/GroupByKey/Read
root: INFO: 2018-03-21T17:00:46.029Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T17:00:46.056Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T17:00:46.081Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T17:00:46.124Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/PreFinalize/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T17:00:46.157Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T17:00:46.206Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/WriteBundles/MapToVoidKey0 into write/Write/WriteImpl/InitializeWrite
root: INFO: 2018-03-21T17:00:46.250Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/InitializeWrite into write/Write/WriteImpl/DoOnce/Read
root: INFO: 2018-03-21T17:00:46.293Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T17:00:46.321Z: JOB_MESSAGE_DETAILED: Fusing consumer write/Write/WriteImpl/FinalizeWrite/MapToVoidKey2 into write/Write/WriteImpl/PreFinalize/PreFinalize
root: INFO: 2018-03-21T17:00:46.345Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec.
root: INFO: 2018-03-21T17:00:46.382Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph.
root: INFO: 2018-03-21T17:00:46.419Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps.
root: INFO: 2018-03-21T17:00:46.444Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2018-03-21T17:00:46.594Z: JOB_MESSAGE_DEBUG: Executing wait step start26
root: INFO: 2018-03-21T17:00:46.661Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/DoOnce/Read+write/Write/WriteImpl/InitializeWrite+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0+write/Write/WriteImpl/PreFinalize/MapToVoidKey0+write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0+write/Write/WriteImpl/WriteBundles/MapToVoidKey0
root: INFO: 2018-03-21T17:00:46.681Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/GroupByKey/Create
root: INFO: 2018-03-21T17:00:46.692Z: JOB_MESSAGE_DEBUG: Starting worker pool setup.
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: Job 2018-03-21_10_00_41-9840485252195089948 is in state JOB_STATE_RUNNING
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-f...
root: INFO: 2018-03-21T17:00:46.711Z: JOB_MESSAGE_BASIC: Executing operation group/Create
root: INFO: 2018-03-21T17:00:56.366Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T17:00:56.451Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/GroupByKey/Session" materialized.
root: INFO: 2018-03-21T17:00:56.482Z: JOB_MESSAGE_DEBUG: Value "group/Session" materialized.
root: INFO: 2018-03-21T17:00:56.539Z: JOB_MESSAGE_BASIC: Executing operation read/Read+split+pair_with_one+group/Reify+group/Write
root: INFO: 2018-03-21T17:01:01.659Z: JOB_MESSAGE_BASIC: Autoscaling: Resizing worker pool from 1 to 2.
root: INFO: 2018-03-21T17:01:13.537Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T17:01:13.564Z: JOB_MESSAGE_DETAILED: Resized worker pool to 1, though goal was 2. This could be a quota issue.
root: INFO: 2018-03-21T17:01:29.274Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T17:01:45.506Z: JOB_MESSAGE_DETAILED: Workers have started successfully.
root: INFO: 2018-03-21T17:05:53.476Z: JOB_MESSAGE_BASIC: Executing operation group/Close
root: INFO: 2018-03-21T17:05:54.513Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/DoOnce/Read.out" materialized.
root: INFO: 2018-03-21T17:05:54.537Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T17:05:54.573Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T17:05:54.596Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/MapToVoidKey0.out" materialized.
root: INFO: 2018-03-21T17:05:54.619Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T17:05:54.866Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T17:05:54.900Z: JOB_MESSAGE_BASIC: Executing operation write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0)
root: INFO: 2018-03-21T17:05:54.927Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/PreFinalize/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T17:05:54.972Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/WriteBundles/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T17:05:54.995Z: JOB_MESSAGE_DEBUG: Value "write/Write/WriteImpl/FinalizeWrite/_DataflowIterableSideInput(MapToVoidKey0.out.0).output" materialized.
root: INFO: 2018-03-21T17:05:55.028Z: JOB_MESSAGE_BASIC: Executing operation group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write
root: INFO: 2018-03-21T17:05:56.498Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T17:05:57.492Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T17:05:58.997Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T17:05:59.377Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T17:05:59.876Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T17:06:01.304Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T17:06:02.794Z: JOB_MESSAGE_ERROR: Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 609, in do_work
work_executor.execute()
File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/executor.py", line 167, in execute
op.start()
File "apache_beam/runners/worker/operations.py", line 340, in apache_beam.runners.worker.operations.DoOperation.start
def start(self):
File "apache_beam/runners/worker/operations.py", line 341, in apache_beam.runners.worker.operations.DoOperation.start
with self.scoped_start_state:
File "apache_beam/runners/worker/operations.py", line 373, in apache_beam.runners.worker.operations.DoOperation.start
self.dofn_runner = common.DoFnRunner(
File "apache_beam/runners/common.py", line 483, in apache_beam.runners.common.DoFnRunner.__init__
self.do_fn_invoker = DoFnInvoker.create_invoker(
File "apache_beam/runners/common.py", line 203, in apache_beam.runners.common.DoFnInvoker.create_invoker
return PerWindowInvoker(
File "apache_beam/runners/common.py", line 313, in apache_beam.runners.common.PerWindowInvoker.__init__
input_args, input_kwargs, [si[global_window] for si in side_inputs])
File "/usr/local/lib/python2.7/dist-packages/apache_beam/transforms/sideinputs.py", line 62, in __getitem__
self._cache[window] = self._view_class._from_runtime_iterable(
AttributeError: type object '_DataflowIterableSideInput' has no attribute '_from_runtime_iterable'
root: INFO: 2018-03-21T17:06:02.831Z: JOB_MESSAGE_DEBUG: Executing failure step failure25
root: INFO: 2018-03-21T17:06:02.871Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S08:group/Read+group/GroupByWindow+count+format+write/Write/WriteImpl/WriteBundles/WriteBundles+write/Write/WriteImpl/Pair+write/Write/WriteImpl/WindowInto(WindowIntoFn)+write/Write/WriteImpl/GroupByKey/Reify+write/Write/WriteImpl/GroupByKey/Write failed., A work item was attempted 4 times without success. Each time the worker eventually lost contact with the service. The work item was attempted on:
beamapp-jenkins-032117004-03211000-fff2-harness-trct,
beamapp-jenkins-032117004-03211000-fff2-harness-7f7d,
beamapp-jenkins-032117004-03211000-fff2-harness-7f7d,
beamapp-jenkins-032117004-03211000-fff2-harness-7f7d
root: INFO: 2018-03-21T17:06:02.981Z: JOB_MESSAGE_DETAILED: Cleaning up.
root: INFO: 2018-03-21T17:06:03.050Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown.
root: INFO: 2018-03-21T17:06:03.072Z: JOB_MESSAGE_BASIC: Stopping worker pool...
root: INFO: 2018-03-21T17:07:32.981Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s).
root: INFO: 2018-03-21T17:07:33.014Z: JOB_MESSAGE_BASIC: Worker pool stopped.
root: INFO: 2018-03-21T17:07:33.422Z: JOB_MESSAGE_DEBUG: Tearing down pending resources...
root: INFO: Job 2018-03-21_10_00_41-9840485252195089948 is in state JOB_STATE_FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
Ran 3 tests in 424.622s
FAILED (errors=1)
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_10_00_41-9840485252195089948?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_10_00_40-808610744177135573?project=apache-beam-testing
Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-03-21_10_00_41-1656507014656882809?project=apache-beam-testing
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user aaltay@gmail.com