You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "UTRI-JR7 (via GitHub)" <gi...@apache.org> on 2023/10/11 16:31:00 UTC
[I] Dataset view shows nothing when DAGs inlet and outlet are the same [airflow]
UTRI-JR7 opened a new issue, #34867:
URL: https://github.com/apache/airflow/issues/34867
### Apache Airflow version
2.7.1
### What happened
I have noticed that when I create a DAG which starts right after a dataset update and the same DAG updates the same dataset, Dataset view in webserver cant render
### What you think should happen instead
It could be possible that instead of that dag and dataset refers each other as in dag dependency view?
### How to reproduce
Creating a DAG with a dataset which is an inlet and outlet
### Operating System
Debian GNU/Linux 11 (bullseye)
### Versions of Apache Airflow Providers
_No response_
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Dataset view shows nothing when DAGs inlet and outlet are the same [airflow]
Posted by "UTRI-JR7 (via GitHub)" <gi...@apache.org>.
UTRI-JR7 commented on issue #34867:
URL: https://github.com/apache/airflow/issues/34867#issuecomment-1764174544
Hi,
We simply have a DAG which sensor a storage, whenever a file which match a prefix arrives, launch the nexts tasks.
It's like a kind of CDC in batch that nowadays runs once a day (we don't know when) but we would like to increase frecuencies.
The schedule behaviour works as follow:
We have a DAG "associated" with a Dataset that updates it, and every time that this Dataset is updated, DAG is restarted
The point is that the DAG Dependicies View show something like this:
But in Dataset view, there must be a render problem due to a loop in DAG-Dataset dependencies.
I don't know whether i am misusing airflow Datasets, or this behaviour can be considered as a bug in the react-flow code, that could be render as the DAG Dependencies view with a loop in the flow.
Thanks in advance!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Dataset view shows nothing when DAGs inlet and outlet are the same [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #34867: Dataset view shows nothing when DAGs inlet and outlet are the same
URL: https://github.com/apache/airflow/issues/34867
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Dataset view shows nothing when DAGs inlet and outlet are the same [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34867:
URL: https://github.com/apache/airflow/issues/34867#issuecomment-1786237187
This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further activity occurs from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Dataset view shows nothing when DAGs inlet and outlet are the same [airflow]
Posted by "jens-scheffler-bosch (via GitHub)" <gi...@apache.org>.
jens-scheffler-bosch commented on issue #34867:
URL: https://github.com/apache/airflow/issues/34867#issuecomment-1758601396
Okay, having a circular reference in DAG triggers might be generating effects unforseen. Can you tell about the use case? Otherwise I rather believe that we might need to think about validation that circular references in dataset triggers are prevented (we do the same validation within DAG tasks). But before preventing for such to happen, I would like to understand "why".
Can you tell us your use case?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Dataset view shows nothing when DAGs inlet and outlet are the same [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #34867:
URL: https://github.com/apache/airflow/issues/34867#issuecomment-1758071871
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Dataset view shows nothing when DAGs inlet and outlet are the same [airflow]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #34867:
URL: https://github.com/apache/airflow/issues/34867#issuecomment-1797064114
This issue has been closed because it has not received response from the issue author.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org