[GitHub] [airflow] zambadruzaman commented on issue #25750: Metadata DB lock wait timeout exceeded when delete from xcom table(airflow 2.1.0)

["zambadruzaman (via GitHub)" <gi...@apache.org>]

zambadruzaman commented on issue #25750:
URL: https://github.com/apache/airflow/issues/25750#issuecomment-1434132239

   Hi @potiuk i am using Airlfow 2.3.2 and face the exact same issue, the below query is fired lots of time, and since the xcom table grows a lot in my case teh query execution time is getting higher (~18 sec) at the moment. In the xcom table i don't see a composite index for these where clause combination, so the query always do the sequential scan in Postgres :
   `DELETE
   FROM
     xcom
   WHERE
     xcom.dag_id = $1
     AND xcom.task_id = $2
     AND xcom.run_id = $3`
   
   seems like this deletion process is fired for each running task. i couldn't find in the codebase from which process this query comes from, could you advice here?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org