[PR] [v3-0-test] Improve PR candidate finder performance by 90x (#52740) [airflow]

["github-actions[bot] (via GitHub)" <gi...@apache.org>]

github-actions[bot] opened a new pull request, #52750:
URL: https://github.com/apache/airflow/pull/52750

   Dramatically improved performance from 1-1.5 hours to ~40 seconds by:
   - Implementing GraphQL bulk fetching with proper pagination
   - Adding parallel processing with ThreadPoolExecutor
   - Introducing intelligent pre-filtering of PR candidates
   - Optimizing search queries to prioritize high-engagement PRs
   
   The script now processes the same data 90x faster while maintaining
   all original functionality and improving code readability.
   (cherry picked from commit 2b90db5c1e50393de2e6b9e39bd79f05d357f6f3)
   
   Co-authored-by: Kaxil Naik <ka...@gmail.com>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [v3-0-test] Improve PR candidate finder performance by 90x (#52740) [airflow]

["potiuk (via GitHub)" <gi...@apache.org>]

potiuk merged PR #52750:
URL: https://github.com/apache/airflow/pull/52750


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org