AIP-49 OpenTelemetry Support - Take Three

["Ferruzzi, Dennis" <fe...@amazon.com.INVALID>]

Third time’s the charm?

Hi folks, looks like AIP-49 [1] hasn’t been touched in a while and I am interested in getting it implemented. If nobody has any objections, I’m going to start coming up with a plan to get this one done in the next little while.  The last PoC for it was almost a year ago - and we all know how much has changed since then - so I'm starting with getting that PoC up and running locally and I'll go from there.

If nobody objects, I'll be getting that PoC working and then maybe set up a planning board?  Once I have the PoC running I'll likely have a few tweaks to the AIP.  Is that possible given that it has already been voted on?

[1] https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-49+OpenTelemetry+Support+for+Apache+Airflow

Re: AIP-49 OpenTelemetry Support - Take Three

[Howard Yoo <ho...@gmail.com>]

Hi everybody. Howard Yoo here.

I authored the AIP-49, and just to give you all some updates, I haven't
been successful in making much progress on this proposal, due to the fact
that my original intention was to publish AIP-49 after my POC on open
telemetry, and wanted to hand it over to whomever was interested in
implementing it. I've been trying to seek some engineering support in my
team to perhaps take it over, but the engineering has been pretty occupied
with other things, and kept pushed back.

Therefore, I wouldn't object to Dennis in terms of getting the work started!
Also, any participation is awesome, so Igor, if. you wanted to take some
work, that would be great!
Please let me know if there's anything that I can be helpful - I believe
having open telemetry to start emitting metrics, logs, and even distributed
traces in Airflow is AWESOME.

Howard

On Fri, Jan 27, 2023 at 8:45 PM Igor Kholopov <ik...@google.com> wrote:

> I'd also be happy to help out with this effort.
>
>  We've been interested in improving the quality of signals produced by
> Airflow for a while - they are critical for making task failure easier and
> more accessible.
>
> Let me know once the plan is updated, I will be happy to pick up some work!
>
>
>
> On Sat, Jan 28, 2023, 12:22 AM Elad Kalif <el...@apache.org> wrote:
>
>> I know Howard (AIP creator) was looking for developers to assist on this.
>> Howard - Can you share status/progress?
>>
>>
>>
>> On Sat, Jan 28, 2023 at 12:50 AM Ferruzzi, Dennis
>> <fe...@amazon.com.invalid> wrote:
>>
>>> Third time’s the charm?
>>>
>>> Hi folks, looks like AIP-49 [1] hasn’t been touched in a while and I am
>>> interested in getting it implemented. If nobody has any objections, I’m
>>> going to start coming up with a plan to get this one done in the next
>>> little while.  The last PoC for it was almost a year ago - and we all know
>>> how much has changed since then - so I'm starting with getting that PoC up
>>> and running locally and I'll go from there.
>>>
>>> If nobody objects, I'll be getting that PoC working and then maybe set
>>> up a planning board?  Once I have the PoC running I'll likely have a few
>>> tweaks to the AIP.  Is that possible given that it has already been voted
>>> on?
>>>
>>> [1]
>>> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-49+OpenTelemetry+Support+for+Apache+Airflow
>>>
>>>

Re: AIP-49 OpenTelemetry Support - Take Three

[Igor Kholopov <ik...@google.com.INVALID>]

I'd also be happy to help out with this effort.

 We've been interested in improving the quality of signals produced by
Airflow for a while - they are critical for making task failure easier and
more accessible.

Let me know once the plan is updated, I will be happy to pick up some work!



On Sat, Jan 28, 2023, 12:22 AM Elad Kalif <el...@apache.org> wrote:

> I know Howard (AIP creator) was looking for developers to assist on this.
> Howard - Can you share status/progress?
>
>
>
> On Sat, Jan 28, 2023 at 12:50 AM Ferruzzi, Dennis
> <fe...@amazon.com.invalid> wrote:
>
>> Third time’s the charm?
>>
>> Hi folks, looks like AIP-49 [1] hasn’t been touched in a while and I am
>> interested in getting it implemented. If nobody has any objections, I’m
>> going to start coming up with a plan to get this one done in the next
>> little while.  The last PoC for it was almost a year ago - and we all know
>> how much has changed since then - so I'm starting with getting that PoC up
>> and running locally and I'll go from there.
>>
>> If nobody objects, I'll be getting that PoC working and then maybe set up
>> a planning board?  Once I have the PoC running I'll likely have a few
>> tweaks to the AIP.  Is that possible given that it has already been voted
>> on?
>>
>> [1]
>> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-49+OpenTelemetry+Support+for+Apache+Airflow
>>
>>

Re: AIP-49 OpenTelemetry Support - Take Three

[Elad Kalif <el...@apache.org>]

I know Howard (AIP creator) was looking for developers to assist on this.
Howard - Can you share status/progress?



On Sat, Jan 28, 2023 at 12:50 AM Ferruzzi, Dennis
<fe...@amazon.com.invalid> wrote:

> Third time’s the charm?
>
> Hi folks, looks like AIP-49 [1] hasn’t been touched in a while and I am
> interested in getting it implemented. If nobody has any objections, I’m
> going to start coming up with a plan to get this one done in the next
> little while.  The last PoC for it was almost a year ago - and we all know
> how much has changed since then - so I'm starting with getting that PoC up
> and running locally and I'll go from there.
>
> If nobody objects, I'll be getting that PoC working and then maybe set up
> a planning board?  Once I have the PoC running I'll likely have a few
> tweaks to the AIP.  Is that possible given that it has already been voted
> on?
>
> [1]
> https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-49+OpenTelemetry+Support+for+Apache+Airflow
>
>