You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2021/06/09 21:11:30 UTC

[GitHub] [airflow] apyshkin opened a new issue #16356: exception when root account goes to http://airflow.ordercapital.com/dag-dependencies

apyshkin opened a new issue #16356:
URL: https://github.com/apache/airflow/issues/16356


   Happens every time 
   
   
   Python version: 3.8.10
   Airflow version: 2.1.0
   Node: airflow-web-55974db849-5bdxq
   -------------------------------------------------------------------------------
   Traceback (most recent call last):
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/flask/app.py", line 2447, in wsgi_app
       response = self.full_dispatch_request()
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/flask/app.py", line 1952, in full_dispatch_request
       rv = self.handle_user_exception(e)
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/flask/app.py", line 1821, in handle_user_exception
       reraise(exc_type, exc_value, tb)
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/flask/_compat.py", line 39, in reraise
       raise value
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/flask/app.py", line 1950, in full_dispatch_request
       rv = self.dispatch_request()
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/flask/app.py", line 1936, in dispatch_request
       return self.view_functions[rule.endpoint](**req.view_args)
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/www/auth.py", line 34, in decorated
       return func(*args, **kwargs)
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/www/decorators.py", line 97, in view_func
       return f(*args, **kwargs)
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/www/decorators.py", line 60, in wrapper
       return f(*args, **kwargs)
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/www/views.py", line 4004, in list
       self._calculate_graph()
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/www/views.py", line 4023, in _calculate_graph
       for dag, dependencies in SerializedDagModel.get_dag_dependencies().items():
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/utils/session.py", line 70, in wrapper
       return func(*args, session=session, **kwargs)
     File "/opt/bitnami/airflow/venv/lib/python3.8/site-packages/airflow/models/serialized_dag.py", line 321, in get_dag_dependencies
       dependencies[row[0]] = [DagDependency(**d) for d in row[1]]
   TypeError: 'NoneType' object is not iterable
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] ashb edited a comment on issue #16356: exception when root account goes to http://airflow.ordercapital.com/dag-dependencies

Posted by GitBox <gi...@apache.org>.

ashb edited a comment on issue #16356:
URL: https://github.com/apache/airflow/issues/16356#issuecomment-859604501


   @uranusjr Just assume no dependencies -- the serialized dag _should_ get updated quickly enough by the scheduler anyway.
   
   Ohh, I wonder if this happens if _no_ dags have any dependencies.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil closed issue #16356: exception when root account goes to http://airflow.ordercapital.com/dag-dependencies

Posted by GitBox <gi...@apache.org>.

kaxil closed issue #16356:
URL: https://github.com/apache/airflow/issues/16356


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #16356: exception when root account goes to http://airflow.ordercapital.com/dag-dependencies

Posted by GitBox <gi...@apache.org>.

boring-cyborg[bot] commented on issue #16356:
URL: https://github.com/apache/airflow/issues/16356#issuecomment-858104401


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] uranusjr commented on issue #16356: exception when root account goes to http://airflow.ordercapital.com/dag-dependencies

Posted by GitBox <gi...@apache.org>.

uranusjr commented on issue #16356:
URL: https://github.com/apache/airflow/issues/16356#issuecomment-859590374


   Actually no. The error message suggests `row[1]` is `None`, which is a value returned by Postgres’s `json_extract_path`:
   
   https://github.com/apache/airflow/blob/304e174674ff6921cb7ed79c0158949b50eff8fe/airflow/models/serialized_dag.py#L318-L321
   
   I *think* this means `data["dag"]["dag_dependencies"]` is not found or None? This is a new field in 2.1.0, but I think we didn’t migrate previously-serialised DAG rows correctly. Reading its original implementation (#13199), I think we should either add a data migration to backfill previously-serialised rows, or just pretend those DAGs don’t have dependencies.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] jedcunningham commented on issue #16356: exception when root account goes to http://airflow.ordercapital.com/dag-dependencies

Posted by GitBox <gi...@apache.org>.

jedcunningham commented on issue #16356:
URL: https://github.com/apache/airflow/issues/16356#issuecomment-858143786


   I'm guessing this might be related to #16328. Different traceback, but might be the same root cause?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] ashb commented on issue #16356: exception when root account goes to http://airflow.ordercapital.com/dag-dependencies

Posted by GitBox <gi...@apache.org>.

ashb commented on issue #16356:
URL: https://github.com/apache/airflow/issues/16356#issuecomment-859604501






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org