You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "kaxil (via GitHub)" <gi...@apache.org> on 2025/01/09 12:49:06 UTC
[I] Add/port metrics to the new Execution interface [airflow]
kaxil opened a new issue, #45511:
URL: https://github.com/apache/airflow/issues/45511
Find a way to emit metrics from the new supervisor process.
Some examples of what needs porting over:
https://github.com/apache/airflow/blob/84907f16af99e455951ac95d36fba5a966ccf763/airflow/jobs/local_task_job_runner.py#L224
https://github.com/apache/airflow/blob/84907f16af99e455951ac95d36fba5a966ccf763/airflow/jobs/local_task_job_runner.py#L347-L361
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "kaxil (via GitHub)" <gi...@apache.org>.
kaxil commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3183783975
Related:
- https://github.com/apache/airflow/issues/52254
- https://github.com/apache/airflow/issues/52368
- https://github.com/apache/airflow/issues/52336
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "antonlin1 (via GitHub)" <gi...@apache.org>.
antonlin1 commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3614673344
not sure if ti failure metrics are out of scope for this issue? I didn't see it being handled in the [associated PR](https://github.com/apache/airflow/pull/58882). Otherwise I put up https://github.com/apache/airflow/pull/59072
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "kaxil (via GitHub)" <gi...@apache.org>.
kaxil commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3434131423
Yes still open, and assigned to you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "KoviAnusha (via GitHub)" <gi...@apache.org>.
KoviAnusha commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3430314390
@kaxil is this still open? If so, can I work on this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "michaelfu1029 (via GitHub)" <gi...@apache.org>.
michaelfu1029 commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3740086410
Will `TaskInstanceStarted` and `TaskInstanceFinished` be covered in this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3889114273
All the related issues are closed, I think we emit all the metrics we did with Airflow 2 now.
#53722 was the PR that ported over the infra and we have had incremental PRs adding metrics like: #55322, #59731. The intent of this task is complete. However, if there are more issues to be created, follow it on with PRs as you like.
@michaelfu1029 for example ^
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "antonlin1 (via GitHub)" <gi...@apache.org>.
antonlin1 commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3616654890
@kaxil , is the idea to centralise all [previously task process emitted metrics](https://github.com/apache/airflow/blob/2.10.4/airflow/models/taskinstance.py#L251-L253) (in airflow 2) from supervisor? https://github.com/apache/airflow/pull/59072 follows airflow 2 very closely in that it's emitted from task runner rather than supervisor.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "KoviAnusha (via GitHub)" <gi...@apache.org>.
KoviAnusha commented on issue #45511:
URL: https://github.com/apache/airflow/issues/45511#issuecomment-3440301762
Thank you
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add/port metrics to the new Execution interface [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh closed issue #45511: Add/port metrics to the new Execution interface
URL: https://github.com/apache/airflow/issues/45511
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org