You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "dolfinus (via GitHub)" <gi...@apache.org> on 2026/01/26 14:03:11 UTC

[I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

dolfinus opened a new issue, #61069:
URL: https://github.com/apache/airflow/issues/61069

   ### Description
   
   Allow users to specify Airflow tags in format like these, and treat them line OpenLineage tuples of `(key, value, source)`:
   - `["sometag:somevalue"] -> [{"key": "sometag", "value": "somevalue", "source": "DBT"}]`
   - `["sometag:somevalue:somesource"] -> [{"key": "sometag", "value": "somevalue", "source": "somesource"}]`
   
   ### Use case/motivation
   
   OpenLineage tag facets are tuples of `(key, value, source)`. Custom Job/Run tags specified in OpenLineage config can be defined as either `key:value` or `key:value:source` strings, allowing users to pass 2 or 3 components in the same time.
   
   This is not the case for Airflow tags - here tags are `list[str]`, and converting them to OpenLineage tags looks like this: `["sometag"] -> [{"key": "sometag", "value": "sometag", "source": "AIRFLOW"}]`
   https://github.com/apache/airflow/blob/4e8274c3616fde8b59f633b543af3509148f2bc1/providers/openlineage/src/airflow/providers/openlineage/plugins/adapter.py#L598-L613
   
   
   ### Related issues
   
   https://github.com/OpenLineage/OpenLineage/issues/4281
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "dolfinus (via GitHub)" <gi...@apache.org>.
dolfinus commented on issue #61069:
URL: https://github.com/apache/airflow/issues/61069#issuecomment-3803505500

   @jroachgolf84 please remove me from issue assignee


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "dolfinus (via GitHub)" <gi...@apache.org>.
dolfinus commented on issue #61069:
URL: https://github.com/apache/airflow/issues/61069#issuecomment-3801456397

   No, I didn't. It's PR in another repo there I've mentioned this feature request.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "jroachgolf84 (via GitHub)" <gi...@apache.org>.
jroachgolf84 commented on issue #61069:
URL: https://github.com/apache/airflow/issues/61069#issuecomment-3801365480

   @noeunkim - looks like @dolfinus has already opened a PR for this issue. Please feel free to find another issue to contribute to!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "noeunkim (via GitHub)" <gi...@apache.org>.
noeunkim commented on issue #61069:
URL: https://github.com/apache/airflow/issues/61069#issuecomment-3805885470

   then I'll work on this :-) 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "kacpermuda (via GitHub)" <gi...@apache.org>.
kacpermuda commented on issue #61069:
URL: https://github.com/apache/airflow/issues/61069#issuecomment-4066908718

   We decided not to pursue this, see [related issue](https://github.com/OpenLineage/OpenLineage/issues/4281) for details


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "jroachgolf84 (via GitHub)" <gi...@apache.org>.
jroachgolf84 commented on issue #61069:
URL: https://github.com/apache/airflow/issues/61069#issuecomment-3805202800

   Apologies, thanks for the heads up @dolfinus. @noeunkim, please feel free to create a PR for this issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "kacpermuda (via GitHub)" <gi...@apache.org>.
kacpermuda closed issue #61069: Parsing tags like somekey:somevalue in OpenLineage provider
URL: https://github.com/apache/airflow/issues/61069


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Parsing tags like somekey:somevalue in OpenLineage provider [airflow]

Posted by "noeunkim (via GitHub)" <gi...@apache.org>.
noeunkim commented on issue #61069:
URL: https://github.com/apache/airflow/issues/61069#issuecomment-3800069323

   If available, Iā€™d like to work on this šŸ™Œ 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org