[jira] [Commented] (BEAM-3937) Track performance of output_counter before feature enabled

["Boyuan Zhang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16472241#comment-16472241 ] 

Boyuan Zhang commented on BEAM-3937:
------------------------------------

map_fn_microbenchmark results:

*master branch:*

1 element 0.933464 sec
 1001 elements 1.06012 sec
 2001 elements 0.934909 sec
 3001 elements 1.15741 sec
 4001 elements 1.27047 sec
 5001 elements 1.26135 sec
 6001 elements 1.45606 sec
 7001 elements 1.52727 sec
 8001 elements 1.77093 sec
 9001 elements 1.77884 sec
Fixed cost 0.866818664086
Per-element 9.95919805585e-07
R^2 0.937672723377

 

*with output_counter disabled:*

1 element 0.958226 sec
 1001 elements 1.05919 sec
 2001 elements 1.28162 sec
 3001 elements 1.31227 sec
 4001 elements 1.40519 sec
 5001 elements 1.51206 sec
 6001 elements 1.61142 sec
 7001 elements 1.54992 sec
 8001 elements 1.78247 sec
 9001 elements 1.86212 sec
Fixed cost 1.0094320736
Per-element 9.42051511822e-07
R^2 0.961541943626

 

*with output_counter enabled:*

1 element 0.94276 sec
 1001 elements 1.08143 sec
 2001 elements 0.974028 sec
 3001 elements 1.17406 sec
 4001 elements 1.37558 sec
 5001 elements 1.48795 sec
 6001 elements 1.61986 sec
 7001 elements 1.58129 sec
 8001 elements 1.76979 sec
 9001 elements 1.95007 sec
Fixed cost 0.894560134938
Per-element 1.11335530426e-06
R^2 0.954196274191

 

> Track performance of output_counter before feature enabled
> ----------------------------------------------------------
>
>                 Key: BEAM-3937
>                 URL: https://issues.apache.org/jira/browse/BEAM-3937
>             Project: Beam
>          Issue Type: Task
>          Components: sdk-py-harness
>            Reporter: Boyuan Zhang
>            Assignee: Boyuan Zhang
>            Priority: Major
>
> To track performance of output_counter before feature enabled by default.
> Need to make sure there is no adversely reflect before enbale
> Related PR: [https://github.com/apache/beam/pull/4741]
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)