You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "yash1thsa (via GitHub)" <gi...@apache.org> on 2025/10/01 04:26:07 UTC

Re: [I] Deferred SnowflakeSqlApiOperator + Airflow 3.0.3 failure [airflow]

yash1thsa commented on issue #55747:
URL: https://github.com/apache/airflow/issues/55747#issuecomment-3354698586

   @remus-smg  , i ran the following airflow dag triggering snowflake, the job did not fail in deferrable mode.   Am i missing anything
   
   Version - airflow 3.0.3
   airflow - apache-airflow-providers-snowflake 6.4.0
   
   
   
   `import pendulum
   from airflow.models.dag import dag
   from airflow.providers.snowflake.operators.snowflake import (
       SnowflakeSqlApiOperator,
   )
   
   @dag(
       dag_id="test_snowflake_dag",
       default_args={
           "owner": "data-engineering",
           "depends_on_past": False,
           "retries": 0,
       },
       start_date=pendulum.today("UTC").add(days=-1),
       schedule=None,
       max_active_runs=1,
       tags=["data-engineering", "test"],
   )
   def create_dag():
   
       snow = SnowflakeSqlApiOperator(
           deferrable=True,
           task_id="snow",
           snowflake_conn_id="snowflake_test",
           poll_interval=60,
           sql="SELECT * from AIRFLOW_DB.AIRFLOW_SCHEMA.AIRFLOW_SAMPLE_TABLE",
       )
   
       (
           snow
       )
   
   
   dag = create_dag()
   
   Log - 
   
   `2025-10-01T04:23:08.601682 | INFO
   Event: DAG bundles loaded: dags-folder
   Logger: airflow.dag_processing.bundles.manager.DagBundlesManager
   
   2025-10-01T04:23:08.602512 | INFO
   Event: Filling up the DagBag from /files/dags/test_snowflake_dag.py
   Logger: airflow.models.dagbag.DagBag
   
   2025-10-01T04:23:10.151702 | INFO
   Event: Executing: SELECT * from AIRFLOW_DB.AIRFLOW_SCHEMA.AIRFLOW_SAMPLE_TABLE
   Logger: airflow.task.operators.airflow.providers.snowflake.operators.snowflake.SnowflakeSqlApiOperator
   
   2025-10-01T04:23:10.208071 | INFO
   Event: Connection Retrieved 'snowflake_test'
   Logger: airflow.hooks.base
   
   2025-10-01T04:23:10.254262 | INFO
   Event: Connection Retrieved 'snowflake_test'
   Logger: airflow.hooks.base
   
   2025-10-01T04:23:10.289601 | INFO
   Event: Creating JWTGenerator with arguments:
     account: iqnwtlc-zp51632, user: AIRFLOW_USER, lifetime: 0:59:00, renewal_delay: 0:54:00
   Logger: airflow.providers.snowflake.utils.sql_api_generate_jwt
   
   2025-10-01T04:23:10.289688 | INFO
   Event: Generating a new token because the present time (2025-10-01 04:23:10.289654+00:00) is later than the renewal time (2025-10-01 04:23:10.289651+00:00)
   Logger: airflow.providers.snowflake.utils.sql_api_generate_jwt
   
   2025-10-01T04:23:10.776938 | INFO
   Event: Snowflake SQL POST API response: {
    code: '333334',
    message: 'Asynchronous execution in progress. Use provided query id to perform query monitoring and management.',
    statementHandle: '01bf6947-0003-975a-0009-c8660001a0ca',
    statementStatusUrl: '/api/v2/statements/01bf6947-0003-975a-0009-c8660001a0ca'
   }
   Logger: airflow.task.hooks.airflow.providers.snowflake.hooks.snowflake_sql_api.SnowflakeSqlApiHook
   
   2025-10-01T04:23:10.780927 | INFO
   Event: List of query ids ['01bf6947-0003-975a-0009-c8660001a0ca']
   Logger: airflow.task.operators.airflow.providers.snowflake.operators.snowflake.SnowflakeSqlApiOperator
   
   2025-10-01T04:23:10.842328 | INFO
   Event: Retrieving status for query id 01bf6947-0003-975a-0009-c8660001a0ca
   Logger: airflow.task.operators.airflow.providers.snowflake.operators.snowflake.SnowflakeSqlApiOperator
   
   2025-10-01T04:23:10.842464 | INFO
   Event: Retrieving status for query id 01bf6947-0003-975a-0009-c8660001a0ca
   Logger: airflow.task.hooks.airflow.providers.snowflake.hooks.snowflake_sql_api.SnowflakeSqlApiHook
   
   2025-10-01T04:23:10.842572 | INFO
   Event: Creating JWTGenerator with arguments:
     account: iqnwtlc-zp51632, user: AIRFLOW_USER, lifetime: 0:59:00, renewal_delay: 0:54:00
   Logger: airflow.providers.snowflake.utils.sql_api_generate_jwt
   
   2025-10-01T04:23:10.842653 | INFO
   Event: Generating a new token because the present time (2025-10-01 04:23:10.842612+00:00) is later than the renewal time (2025-10-01 04:23:10.842610+00:00)
   Logger: airflow.providers.snowflake.utils.sql_api_generate_jwt
   
   2025-10-01T04:23:11.104325 | INFO
   Event: Snowflake SQL GET statements status API response: {
    resultSetMetaData: { numRows: 1, format: 'jsonv2', partitionInfo: [{ rowCount: 1, uncompressedSize: 78 }], rowType: [...] },
    data: [['1', 'First Test Record from Airflow Setup', '1759076954.323000000']],
    code: '090001',
    statementStatusUrl: '/api/v2/statements/01bf6947-0003-975a-0009-c8660001a0ca?requestId=17a3d458-bc6f-4000-9351-e2c6e00cc9b2',
    message: 'Statement executed successfully.',
    createdOn: 1759292590783
   }
   Logger: airflow.task.hooks.airflow.providers.snowflake.hooks.snowflake_sql_api.SnowflakeSqlApiHook
   
   2025-10-01T04:23:11.107731 | INFO
   Event: Snowflake completed successfully.
   Logger: airflow.task.operators.airflow.providers.snowflake.operators.snowflake.SnowflakeSqlApiOperator`
   `


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org