You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/11/16 00:11:52 UTC

[GitHub] [airflow] uranusjr opened a new pull request, #27699: Optimize TI.xcom_pull() when explicit task_ids and map_indexes are passed

uranusjr opened a new pull request, #27699:
URL: https://github.com/apache/airflow/pull/27699

   Two optimizations here:
   
   1. If the provided `map_indexes` value is a `range` object with `step=1`, we can optimize the query to use `>=` and `<` instead of `IN`.
   2. Instead of eagerly pulling values from database and sort in Python, we can use `CASE` to make the database perform the sorting instead.
   
   The first one I’m pretty sure is harmless. Less sure about the second; while this likely requires a full scan, it is needed anyway at the Python side when the values are returned, so it’s probably never (much) worse?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [airflow] uranusjr merged pull request #27699: Optimize TI.xcom_pull() with explicit task_ids and map_indexes

Posted by GitBox <gi...@apache.org>.
uranusjr merged PR #27699:
URL: https://github.com/apache/airflow/pull/27699


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org