You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Valentyn Tymofieiev (Jira)" <ji...@apache.org> on 2020/04/15 21:17:00 UTC
[jira] [Closed] (BEAM-9085) Performance regression in
np.random.RandomState() skews performance test results across Python 2/3 on
Dataflow
[ https://issues.apache.org/jira/browse/BEAM-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Valentyn Tymofieiev closed BEAM-9085.
-------------------------------------
Fix Version/s: Not applicable
Resolution: Fixed
> Performance regression in np.random.RandomState() skews performance test results across Python 2/3 on Dataflow
> --------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-9085
> URL: https://issues.apache.org/jira/browse/BEAM-9085
> Project: Beam
> Issue Type: Bug
> Components: testing
> Reporter: Kamil Wasilewski
> Assignee: Kamil Wasilewski
> Priority: Major
> Fix For: Not applicable
>
> Time Spent: 9h 20m
> Remaining Estimate: 0h
>
> Tests show that the performance of core Beam operations in Python 3.x on Dataflow can be a few time slower than in Python 2.7. We should investigate what's the cause of the problem.
> Currently, we have one ParDo test that is run both in Py3 and Py2 [1]. A dashboard with runtime results can be found here [2].
> [1] sdks/python/apache_beam/testing/load_tests/pardo_test.py
> [2] https://apache-beam-testing.appspot.com/explore?dashboard=5678187241537536
--
This message was sent by Atlassian Jira
(v8.3.4#803005)