You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Sourabh Bajaj (JIRA)" <ji...@apache.org> on 2017/03/15 20:31:41 UTC
[jira] [Commented] (BEAM-1730) Python post commits timing out
[ https://issues.apache.org/jira/browse/BEAM-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15926928#comment-15926928 ]
Sourabh Bajaj commented on BEAM-1730:
-------------------------------------
Reverting the changes in the commit as this needs broader discussion.
> Python post commits timing out
> ------------------------------
>
> Key: BEAM-1730
> URL: https://issues.apache.org/jira/browse/BEAM-1730
> Project: Beam
> Issue Type: Bug
> Components: sdk-py
> Reporter: Ahmet Altay
> Assignee: Sourabh Bajaj
>
> https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/1514/
> Dataflow worker logs:
> https://pantheon.corp.google.com/logs/viewer?logName=projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup&project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2017-03-15_10_30_20-1232538583050549167&minLogLevel=0&expandAll=false×tamp=2017-03-15T19:15:33.000000000Z
> Stack trace:
> I Executing: /usr/bin/python -m dataflow_worker.start -Djob_id=2017-03-15_10_30_20-1232538583050549167 -Dproject_id=apache-beam-testing -Dreporting_enabled=True -Droot_url=https://dataflow.googleapis.com -Dservice_path=https://dataflow.googleapis.com/ -Dtemp_gcs_directory=gs://unused -Dworker_id=py-validatesrunner-148959-03151030-f51b-harness-t79h -Ddataflow.worker.logging.location=/var/log/dataflow/python-dataflow-0-json.log -Dlocal_staging_directory=/var/opt/google/dataflow -Dsdk_pipeline_options={"display_data":[{"key":"requirements_file","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"postcommit_requirements.txt"},{"key":"sdk_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"dist/apache-beam-0.7.0.dev0.tar.gz"},{"key":"num_workers","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"INTEGER","value":1},{"key":"runner","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"TestDataflowRunner"},{"key":"staging_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"project","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"apache-beam-testing"},{"key":"temp_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"job_name","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"py-validatesrunner-1489599007"}],"options":{"autoscalingAlgorithm":"NONE","dataflowJobId":"2017-03-15_10_30_20-1232538583050549167","dataflow_endpoint":"https://dataflow.googleapis.com","direct_runner_use_stacked_bundle":true,"gcpTempLocation":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","job_name":"py-validatesrunner-1489599007","male":false,"maxNumWorkers":0,"mock_flag":false,"no_auth":false,"numWorkers":1,"num_workers":1,"pipeline_type_check":true,"profile_cpu":false,"profile_memory":false,"project":"apache-beam-testing","requirements_file":"postcommit_requirements.txt","runner":"TestDataflowRunner","runtime_type_check":false,"save_main_session":false,"sdk_location":"dist/apache-beam-0.7.0.dev0.tar.gz","staging_location":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","streaming":false,"style":"scrambled","temp_location":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","type_check_strictness":"DEFAULT_TO_ANY"}}
> I Traceback (most recent call last):
> I File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
> I
> I "__main__", fname, loader, pkg_name)
> I File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
> I
> I exec code in run_globals
> I File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/start.py", line 26, in <module>
> I
> I from dataflow_worker import batchworker
> I File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 51, in <module>
> I
> I from apache_beam.internal import pickler
> I File "/usr/local/lib/python2.7/dist-packages/apache_beam/__init__.py", line 85, in <module>
> I
> I __version__ = version.get_version()
> I File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 30, in get_version
> I
> I __version__ = get_version_from_pom()
> I File "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 36, in get_version_from_pom
> I
> I with open('pom.xml', 'r') as f:
> I IOError
> I
> I [Errno 2] No such file or directory: 'pom.xml'
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)