You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kamil Wasilewski (Jira)" <ji...@apache.org> on 2020/01/10 12:16:00 UTC

[jira] [Created] (BEAM-9085) Investigate performance difference between Python 2/3 on Dataflow

Kamil Wasilewski created BEAM-9085:
--------------------------------------

             Summary: Investigate performance difference between Python 2/3 on Dataflow
                 Key: BEAM-9085
                 URL: https://issues.apache.org/jira/browse/BEAM-9085
             Project: Beam
          Issue Type: Bug
          Components: sdk-py-core
            Reporter: Kamil Wasilewski


Tests show that the performance of core Beam operations in Python 3.x on Dataflow can be a few time slower than in Python 2.7. We should investigate what's the cause of the problem.

Currently, we have one ParDo test that is run both in Py3 and Py2 [1]. A dashboard with runtime results can be found here [2].

[1] sdks/python/apache_beam/testing/load_tests/pardo_test.py

[2] https://apache-beam-testing.appspot.com/explore?dashboard=5678187241537536



--
This message was sent by Atlassian Jira
(v8.3.4#803005)