You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "zhaorui2022 (via GitHub)" <gi...@apache.org> on 2026/05/13 02:36:51 UTC
[I] Improve Databricks operators with query tags [airflow]
zhaorui2022 opened a new issue, #66839:
URL: https://github.com/apache/airflow/issues/66839
### Description
Databricks supports query tags which allows us to track where the source of a query is on Databricks UI. Reference: https://docs.databricks.com/aws/en/sql/user/queries/query-tags
Currently when a query is sent to Databricks, on Databricks UI, the only info we can see is the query is from Airflow, but there is no other metadata like airflow dag id, task id, run id and etc.
### Use case/motivation
With query tags instrumented, it will be easy for organizations to track and do Databricks cost contribution across different Airflow DAGs.
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve Databricks operators with query tags [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #66839:
URL: https://github.com/apache/airflow/issues/66839#issuecomment-4438051446
cc @moomindani @mwojtyczka I think this should be easy to implement?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve Databricks operators with query tags [airflow]
Posted by "Shaan-alpha (via GitHub)" <gi...@apache.org>.
Shaan-alpha commented on issue #66839:
URL: https://github.com/apache/airflow/issues/66839#issuecomment-4444558491
I would like to work on this issue! I will submit a PR with the required changes soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve Databricks operators with query tags [airflow]
Posted by "shashbha14 (via GitHub)" <gi...@apache.org>.
shashbha14 commented on issue #66839:
URL: https://github.com/apache/airflow/issues/66839#issuecomment-4438141824
I'd like to work on this if it's still available.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve Databricks operators with query tags [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #66839:
URL: https://github.com/apache/airflow/issues/66839#issuecomment-4438207718
It is. If you have experience with databricks go for it.
This needs to be tested and validated against real databricks env
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve Databricks operators with query tags [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal closed issue #66839: Improve Databricks operators with query tags
URL: https://github.com/apache/airflow/issues/66839
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Improve Databricks operators with query tags [airflow]
Posted by "SkastVnT (via GitHub)" <gi...@apache.org>.
SkastVnT commented on issue #66839:
URL: https://github.com/apache/airflow/issues/66839#issuecomment-4447591711
Hi, sorry that I did not leave a note here before opening the PR.
I have submitted a PR for this issue: https://github.com/apache/airflow/pull/66895
The PR includes the implementation, tests, and real Databricks validation evidence in the PR comments.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org