You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by "Ferruzzi, Dennis" <fe...@amazon.com.INVALID> on 2023/01/04 00:29:26 UTC

Re: [Discuss]whether fail early for Xcom.set when value exceeds the BLOB limit

100% fail early sounds like the right answer here.


________________________________
From: Ping Zhang <pi...@umich.edu>
Sent: Monday, December 19, 2022 7:02 PM
To: dev@airflow.apache.org
Subject: [EXTERNAL] [Discuss]whether fail early for Xcom.set when value exceeds the BLOB limit


CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.


Hi community,

I would like to discuss if we want to fail early for Xcom.set when the value exceeds the storage limit. Otherwise, the database (default xcom backend) truncates the value leading to failure when Xcom reads it, (e.g. on UI, Admin -> Xcoms will also fail).

But I am not sure whether we want to fail the whole task execution if Xcom.set fails and would like to have your inputs.

Thanks,

Ping