You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Scott Wegner (JIRA)" <ji...@apache.org> on 2018/10/04 17:37:00 UTC

[jira] [Commented] (BEAM-5648) Test failure: test_as_list_and_as_dict_side_inputs (beam_PostCommit_Py_VR_Dataflow)

    [ https://issues.apache.org/jira/browse/BEAM-5648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638597#comment-16638597 ] 

Scott Wegner commented on BEAM-5648:
------------------------------------

It seems the [pip download|https://github.com/apache/beam/blame/70259e13e83ce3e2bb8d9ee9731e09f9ff456b05/sdks/python/apache_beam/runners/portability/stager.py#L411] command failed, but I don't see any command output. Is it this line from above:

{{Could not find a version that satisfies the requirement setuptools (from pyhamcrest->-r postcommit_requirements.txt (line 1)) (from versions: )}}

> Test failure: test_as_list_and_as_dict_side_inputs (beam_PostCommit_Py_VR_Dataflow)
> -----------------------------------------------------------------------------------
>
>                 Key: BEAM-5648
>                 URL: https://issues.apache.org/jira/browse/BEAM-5648
>             Project: Beam
>          Issue Type: Test
>          Components: test-failures
>            Reporter: Scott Wegner
>            Assignee: Boyuan Zhang
>            Priority: Major
>              Labels: blocking-postcommit
>             Fix For: Not applicable
>
>
> _Use this form to file an issue for test failure:_
>  * Link to [Jenkins Job|https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/1242/], [Gradle Build Scan|https://scans.gradle.com/s/lnbv3q5xz7zjc/console-log?task=:beam-sdks-python:validatesRunnerStreamingTests]
>  * Failing test: test_as_list_and_as_dict_side_inputs, [source code|https://github.com/apache/beam/blob/70259e13e83ce3e2bb8d9ee9731e09f9ff456b05/sdks/python/apache_beam/transforms/sideinputs_test.py#L185]
> Initial investigation:
>  * Seems to be a flaky test, as subsequent runs have passed: [https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/buildTimeTrend]
>  * Not sure from the [build scan|https://scans.gradle.com/s/lnbv3q5xz7zjc/console-log?task=:beam-sdks-python:validatesRunnerStreamingTests] what the root cause is.
>  
> {{======================================================================}}
> ERROR: test_as_list_and_as_dict_side_inputs (apache_beam.transforms.sideinputs_test.SideInputsTest)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/transforms/sideinputs_test.py", line 205, in test_as_list_and_as_dict_side_inputs
>  pipeline.run()
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/testing/test_pipeline.py", line 104, in run
>  result = super(TestPipeline, self).run(test_runner_api)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/pipeline.py", line 403, in run
>  self.to_runner_api(), self.runner, self._options).run(False)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/pipeline.py", line 416, in run
>  return self.runner.run_pipeline(self)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py", line 50, in run_pipeline
>  self.result = super(TestDataflowRunner, self).run_pipeline(pipeline)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py", line 383, in run_pipeline
>  self.dataflow_client.create_job(self.job), self)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/utils/retry.py", line 184, in wrapper
>  return fun(*args, **kwargs)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py", line 490, in create_job
>  self.create_job_description(job)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py", line 519, in create_job_description
>  resources = 
> self._stage_resources(job.options)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py", line 452, in _stage_resources
>  staging_location=google_cloud_options.staging_location)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/portability/stager.py", line 161, in stage_job_resources
>  requirements_cache_path)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/runners/portability/stager.py", line 411, in _populate_requirements_cache
>  processes.check_call(cmd_args)
>  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/apache_beam/utils/processes.py", line 46, in check_call
>  return subprocess.check_call(*args, **kwargs)
>  File "/usr/lib/python2.7/subprocess.py", line 541, in check_call
>  raise CalledProcessError(retcode, cmd)
> {{CalledProcessError: Command '['/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Py_VR_Dataflow/src/sdks/python/build/gradleenv/bin/python', '-m', 'pip', 'download', '--dest', '/tmp/dataflow-requirements-cache', '-r', 'postcommit_requirements.txt', '--exists-action', 'i', '--no-binary', ':all:']' returned non-zero exit status 1}}
>  
> ----
> _After you've filled out the above details, please [assign the issue to an individual|https://beam.apache.org/contribute/postcommits-guides/index.html#find_specialist]. Assignee should [treat test failures as high-priority|https://beam.apache.org/contribute/postcommits-policies/#assigned-failing-test], helping to fix the issue or find a more appropriate owner. See [Apache Beam Post-Commit Policies|https://beam.apache.org/contribute/postcommits-policies]._



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)