[GitHub] [airflow] khalidmammadov edited a comment on issue #18598: SerializedDagNotFound - when create 1000 dags

[GitBox <gi...@apache.org>]

khalidmammadov edited a comment on issue #18598:
URL: https://github.com/apache/airflow/issues/18598#issuecomment-930215434


   I have modified your Dag a bit and produced 1000 copy of it.  And scheduler processed it without any issues:
   
   =====================================================
   ```
   import numpy as np
   from airflow import DAG
   from airflow.operators.python import PythonOperator
   from datetime import datetime
   from pathlib import Path
   
   
   with DAG(
       dag_id=Path(__file__).stem,
       schedule_interval=None,
       start_date=datetime(2021, 1, 1),
       catchup=False,
       tags=["example"]
   ) as dag:
       def print_array():
           """Print Numpy array."""
           a = np.arange(15).reshape(3, 5)
           print(a)
           time_wait_cuy = get_time_wait_cuy()
           print(time_wait_cuy)
           return time_wait_cuy
   
   
       run_this = PythonOperator(
           task_id="print_the_context",
           python_callable=print_array,
       )
   ```
   =====================================================
   
   And bash command to make it 1000
   
   `for i in {1..1000} ; do $(cp my_dag.py "my_dag$i.py") ; done`
   
   Is it possible the issue is related to your setup i.e. files, folder etc.? 
   If not can you please help to reproduce the issue so we can investigate?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org