You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2019/12/02 22:14:42 UTC

[GitHub] [airflow] kaxil commented on issue #6714: [AIRFLOW-6153] Allow adding Custom Fields to Serialized Operators

kaxil commented on issue #6714: [AIRFLOW-6153] Allow adding Custom Fields to Serialized Operators
URL: https://github.com/apache/airflow/pull/6714#issuecomment-560726423
 
 
   > @potiuk We once talked that DAG serialization can be done by serializing class arguments in the database. This PR brings us closer to implementing this idea.
   
   We discussed this initially, however that can easily become a pain as the Serialized Blob grows in sizes rapidly. We don't need all the information (of a task) for the Webserver and the Scheduler. Hence, the 1st task of DAG Serialization was to figure out what information is actually required by the Webserver.
   
   Increased JSON Blob size caused performance issues when we benchmarked it #5743 so we reduced the blob size to as small as we could.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services