[GitHub] [beam] damccorm opened a new issue, #21993: Profile and improve performance for the local FnApiRunner

[GitBox <gi...@apache.org>]

damccorm opened a new issue, #21993:
URL: https://github.com/apache/beam/issues/21993

   The FnApiRunner is undergoing a series of changes to support streaming. These changes are altering its execution significantly, and may introduce inefficiencies.
   
   This project has the following deliverables:
    * A report with results from profiling the execution of a pipeline, and finding hotspots, and inefficiencies
    * Code improvements to speed up the execution of the FnApiRunner
    * Improvements to the [FnApiRunner manual](https://docs.google.com/document/d/18-AhNn1VG134ti1A7A__BtLQQg-99VmjRoNlcWg-8Qg/edit#) to instruct others on how to do profiling.
   
    
   
   Tools that you may need to use:
    * Benchmarks for the Python direct runner in [http://metrics.beam.apache.org](http://metrics.beam.apache.org/)
    * The FnApiRunner and TestStream microbenchmarks in sdks/python/apache_beam/tools/
    * A profiling tool like: [https://pypi.org/project/flameprof/](https://pypi.org/project/flameprof/) or [https://github.com/uber-archive/pyflame](https://github.com/uber-archive/pyflame) 
    * Google Docs
   
   Contact  Pablo in [dev@beam.apache.org|mailto:dev@beam.apache.org] to ask questions about this project.
   
   Imported from Jira [BEAM-11869](https://issues.apache.org/jira/browse/BEAM-11869). Original Jira may contain additional context.
   Reported by: pabloem.
   Subtask of issue #21987


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org