You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/09/23 17:22:42 UTC
[GitHub] [airflow] hpatel-higi edited a comment on issue #18448: DagTimeout and AirflowTaskTimeout from running multiple dags at one time

hpatel-higi edited a comment on issue #18448:
URL: https://github.com/apache/airflow/issues/18448#issuecomment-926008086


   This is the error i got while just 4 DAGs were running.   I didn't have these problems in 1.10.8
   ```
   2021-09-21T15:44:31.288689942Z [[34m2021-09-21 15:44:31,281[0m] {{[34mtimeout.py:[0m36}} ERROR[0m - Process timed out, PID: 3002[0m
   2021-09-21T15:44:31.495731398Z [[34m2021-09-21 15:44:31,287[0m] {{[34mdagbag.py:[0m329}} ERROR[0m - Failed to import: /usr/local/airflow/dags/build_dbs/build_api_audit_logs.py[0m
   2021-09-21T15:44:31.495763098Z Traceback (most recent call last):
   2021-09-21T15:44:31.495778898Z File "/usr/local/lib/python3.9/site-packages/airflow/models/dagbag.py", line 326, in _load_modules_from_file
   2021-09-21T15:44:31.495784798Z loader.exec_module(new_module)
   2021-09-21T15:44:31.495788798Z File "<frozen importlib._bootstrap_external>", line 850, in exec_module
   2021-09-21T15:44:31.495793298Z File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
   2021-09-21T15:44:31.495797698Z File "/usr/local/airflow/dags/build_dbs/build_api_audit_logs.py", line 5, in <module>
   2021-09-21T15:44:31.495802198Z from helper_functions.snowflake_operator import SnowflakeOperator
   2021-09-21T15:44:31.495806298Z File "/usr/local/airflow/dags/helper_functions/snowflake_operator.py", line 1, in <module>
   2021-09-21T15:44:31.495810298Z from airflow.contrib.operators.snowflake_operator import SnowflakeOperator as sfo
   2021-09-21T15:44:31.495814198Z File "/usr/local/lib/python3.9/site-packages/airflow/contrib/operators/snowflake_operator.py", line 22, in <module>
   2021-09-21T15:44:31.495818398Z from airflow.providers.snowflake.operators.snowflake import SnowflakeOperator # noqa
   2021-09-21T15:44:31.495822398Z File "/usr/local/lib/python3.9/site-packages/airflow/providers/snowflake/operators/snowflake.py", line 21, in <module>
   2021-09-21T15:44:31.495826598Z from airflow.providers.snowflake.hooks.snowflake import SnowflakeHook
   2021-09-21T15:44:31.495830398Z File "/usr/local/lib/python3.9/site-packages/airflow/providers/snowflake/hooks/snowflake.py", line 25, in <module>
   2021-09-21T15:44:31.495834598Z from snowflake import connector
   2021-09-21T15:44:31.495838298Z File "/usr/local/lib/python3.9/site-packages/snowflake/connector/__init__.py", line 15, in <module>
   2021-09-21T15:44:31.495842398Z from .connection import SnowflakeConnection
   2021-09-21T15:44:31.495846198Z File "/usr/local/lib/python3.9/site-packages/snowflake/connector/connection.py", line 65, in <module>
   2021-09-21T15:44:31.495867199Z from .cursor import LOG_MAX_QUERY_LENGTH, SnowflakeCursor
   2021-09-21T15:44:31.495882499Z File "/usr/local/lib/python3.9/site-packages/snowflake/connector/cursor.py", line 51, in <module>
   2021-09-21T15:44:31.495886999Z from .file_transfer_agent import SnowflakeFileTransferAgent
   2021-09-21T15:44:31.495890499Z File "/usr/local/lib/python3.9/site-packages/snowflake/connector/file_transfer_agent.py", line 45, in <module>
   2021-09-21T15:44:31.495894399Z from .gcs_util import SnowflakeGCSUtil
   2021-09-21T15:44:31.495898999Z File "/usr/local/lib/python3.9/site-packages/snowflake/connector/gcs_util.py", line 15, in <module>
   2021-09-21T15:44:31.495902999Z from .encryption_util import EncryptionMetadata
   2021-09-21T15:44:31.495906499Z File "/usr/local/lib/python3.9/site-packages/snowflake/connector/encryption_util.py", line 15, in <module>
   2021-09-21T15:44:31.495931599Z from Cryptodome.Cipher import AES
   2021-09-21T15:44:31.495935899Z File "/usr/local/lib/python3.9/site-packages/Cryptodome/Cipher/__init__.py", line 36, in <module>
   2021-09-21T15:44:31.495939899Z from Cryptodome.Cipher._mode_gcm import _create_gcm_cipher
   2021-09-21T15:44:31.495943499Z File "/usr/local/lib/python3.9/site-packages/Cryptodome/Cipher/_mode_gcm.py", line 84, in <module>
   2021-09-21T15:44:31.495947499Z _ghash_portable = _get_ghash_portable()
   2021-09-21T15:44:31.495951099Z File "/usr/local/lib/python3.9/site-packages/Cryptodome/Cipher/_mode_gcm.py", line 81, in _get_ghash_portable
   2021-09-21T15:44:31.495954999Z lib = load_pycryptodome_raw_lib("Cryptodome.Hash._ghash_portable", api)
   2021-09-21T15:44:31.495958899Z File "/usr/local/lib/python3.9/site-packages/Cryptodome/Util/_raw_api.py", line 293, in load_pycryptodome_raw_lib
   2021-09-21T15:44:31.495979099Z return load_lib(pycryptodome_filename(dir_comps, filename),
   2021-09-21T15:44:31.495982599Z File "/usr/local/lib/python3.9/site-packages/Cryptodome/Util/_raw_api.py", line 95, in load_lib
   2021-09-21T15:44:31.495986399Z lib = ffi.dlopen(name)
   2021-09-21T15:44:31.495990099Z File "/usr/local/lib/python3.9/site-packages/cffi/api.py", line 150, in dlopen
   2021-09-21T15:44:31.495993899Z lib, function_cache = _make_ffi_library(self, name, flags)
   2021-09-21T15:44:31.496015900Z File "/usr/local/lib/python3.9/site-packages/cffi/api.py", line 832, in _make_ffi_library
   2021-09-21T15:44:31.496020000Z backendlib = _load_backend_lib(backend, libname, flags)
   2021-09-21T15:44:31.496023700Z File "/usr/local/lib/python3.9/site-packages/cffi/api.py", line 818, in _load_backend_lib
   2021-09-21T15:44:31.496027600Z path = ctypes.util.find_library(name)
   2021-09-21T15:44:31.496031200Z File "/usr/local/lib/python3.9/ctypes/util.py", line 330, in find_library
   2021-09-21T15:44:31.496035000Z _get_soname(_findLib_gcc(name)) or _get_soname(_findLib_ld(name))
   2021-09-21T15:44:31.496038800Z File "/usr/local/lib/python3.9/ctypes/util.py", line 131, in _findLib_gcc
   2021-09-21T15:44:31.496045800Z trace = proc.stdout.read()
   2021-09-21T15:44:31.496049600Z File "/usr/local/lib/python3.9/site-packages/airflow/utils/timeout.py", line 37, in handle_timeout
   2021-09-21T15:44:31.496053500Z raise AirflowTaskTimeout(self.error_message)
   2021-09-21T15:44:31.496057800Z airflow.exceptions.AirflowTaskTimeout: DagBag import timeout for /usr/local/airflow/dags/build_dbs/build_api_audit_logs.py after 30.0s, PID: 3002
   2021-09-21T15:44:31.500108928Z [[34m2021-09-21 15:44:31,496[0m] {{[34mlocal_executor.py:[0m128}} ERROR[0m - Failed to execute task dag_id could not be found: build_api_audit_logs. Either the dag did not exist or it failed to parse..[0m
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org