[jira] [Commented] (BEAM-3809) beam_PerformanceTests_Python failing

["Mark Liu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391749#comment-16391749 ] 

Mark Liu commented on BEAM-3809:
--------------------------------

The command pkb use to execute pipeline is:
python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/runs/9e009d45/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz
which looks good to me. Probably need more investigate on pkb side.

 

> beam_PerformanceTests_Python failing
> ------------------------------------
>
>                 Key: BEAM-3809
>                 URL: https://issues.apache.org/jira/browse/BEAM-3809
>             Project: Beam
>          Issue Type: Bug
>          Components: testing
>            Reporter: Ahmet Altay
>            Assignee: Mark Liu
>            Priority: Major
>
> Looks like a misconfiguration based on the error.
>  
> Example test:
> [https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_Python/1000/console]
>  
> Error I see:
> error: option --test-pipeline-options not recognized
> 2018-03-08 18:48:08,202 9e009d45 MainThread beam_integration_benchmark(1/1) ERROR    Error during benchmark beam_integration_benchmark
> Traceback (most recent call last):
>   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 622, in RunBenchmark
>     DoRunPhase(spec, collector, detailed_timer)
>   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/pkb.py", line 525, in DoRunPhase
>     samples = spec.BenchmarkRun(spec)
>   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py", line 159, in Run
>     job_type=job_type)
>   File "/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Python/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py", line 90, in SubmitJob
>     assert retcode == 0, "Integration Test Failed."



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)