You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airflow.apache.org by "K Mallam, Sunil" <Su...@Teradata.com.INVALID> on 2024/01/03 12:35:32 UTC
Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
Thank you for your kind words, Kaxil and Niko. I appreciate it!
Sunil K Mallam
Staff Product Manager – 3rd Party Developer Tools
[A black and orange logo Description automatically generated]<https://www.teradata.com/>
17095 Via Del Campo Ct.
San Diego, CA 92127
teradata.com<https://www.teradata.com/>
This e-mail is from Teradata Corporation and may contain information that is confidential or proprietary. If you are not the intended recipient, do not read, copy, or distribute the e-mail or any attachments. Instead, please notify the sender and delete the e-mail and any attachments. Thank you.
Please consider the environment before printing.
From: Kaxil Naik <ka...@gmail.com>
Date: Monday, 25 December 2023 at 6:41 PM
To: dev@airflow.apache.org <de...@airflow.apache.org>, K Mallam, Sunil <Su...@Teradata.com>
Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra, Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish <SA...@Teradata.com>
Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
You don't often get email from kaxilnaik@gmail.com. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification>
[CAUTION: External Email]
Adding Sunil back to the thread :)
+1 binding, glad to see the final proposal after months of hard work, well done Sunil and team.
Regards,
Kaxil
On Mon, 25 Dec 2023 at 18:40, Kaxil Naik <ka...@gmail.com>> wrote:
+1 binding, glad to see the final proposal after months of hard work, well done Sunil and team.
On Mon, 25 Dec 2023 at 05:22, Oliveira, Niko <on...@amazon.com.invalid> wrote:
This is fantastic! I love to see the testing and dashboards being invested in from the beginning, never gets old :)
It shows that you really took the time to read the past discussions and documentation we have. I won't be able to look at the code in detail until the new year, but so far this is a great submission and a +1 from me!
Cheers,
Niko
________________________________
From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
Sent: Sunday, December 24, 2023 7:36:02 AM
To: dev@airflow.apache.org<ma...@airflow.apache.org>
Cc: Tworkiewicz, Adam; Mishra, Harishankar; Chinthanippu, Satish
Subject: RE: [EXTERNAL] [COURRIEL EXTERNE] [Discuss] New Airflow Community Provider: Teradata
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur externe. Ne cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne pouvez pas confirmer l’identité de l’expéditeur et si vous n’êtes pas certain que le contenu ne présente aucun risque.
Thank you Jarek and Elad, we appreciate you recognizing the efforts we put in.
Sunil K Mallam
Staff Product Manager – 3rd Party Developer Tools
[A black and orange logo Description automatically generated]<https://www.teradata.com/>
17095 Via Del Campo Ct.
San Diego, CA 92127
teradata.com<http://teradata.com/><https://www.teradata.com/>
This e-mail is from Teradata Corporation and may contain information that is confidential or proprietary. If you are not the intended recipient, do not read, copy, or distribute the e-mail or any attachments. Instead, please notify the sender and delete the e-mail and any attachments. Thank you.
Please consider the environment before printing.
From: Elad Kalif <el...@apache.org>>
Date: Sunday, 24 December 2023 at 12:30 PM
To: dev@airflow.apache.org<ma...@airflow.apache.org> <de...@airflow.apache.org>>
Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra, Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish <SA...@Teradata.com>
Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
[CAUTION: External Email]
Hi Sunil,
Proposal looks very solid and I do see the value in having a Teradata
provider.
I agree with Jarek and I am +1 for it.
On Fri, Dec 22, 2023 at 9:27 PM K Mallam, Sunil
<Su...@teradata.com>.invalid> wrote:
> Hi,
>
>
>
> I’m Sunil Mallam, a Staff Product Manager with Teradata, owning the
> Third-Party Connectors and Integrations.
>
>
>
> Here’s our proposal to be a Community Provider, as we see Airflow being a
> key integration for Teradata’s cloud customers in terms of *orchestrating
> data pipelines and ML workflows *-
>
>
>
> *Why Teradata wants to be a community provider?*
>
> - Teradata has over 700 customers (most of them are from Fortune 1000
> list) who run enterprise workloads.
> - Being on *Airflow’s documentation index provides* *better visibility
> for our user*s and they can easily find Teradata’s provider package,
> without Teradata having to put additional effort into promoting it.
> - Also, our customers have confidence in the quality and stability of
> the provider package if it’s managed and maintained by Teradata, while
> being validated/approved by Airflow.
>
>
>
> *How is it a positive for the Airflow project/community and why should it
> be accepted?*
>
> - We have a dedicated team to manage and maintain the provider package.
> - Teradata will take responsibility for -
> - end-to-end testing efforts, running system tests periodically in
> their environment, and making the status available to Airflow.
> - being available and responsive to any communication from the
> community members.
> - To support our dedication toward contributions, Teradata is a verified
> adapter with dbt
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=frYiNGXU6w7mPhRY2PK7DM7Y%2Bzo9a4zYkrwHTITatxg%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms><https://docs.getdbt.com/docs/supported-data-platforms>> and we’re
> diligent in matching up to its releases (major and minor).
>
>
>
> *What is developed as part of the initial implementation (phase 1) and
> what’s next (phase 2)?*
>
> *Phase 1 *
>
> 1. Building a Hook, Base Operator, and Transfer Operator (Teradata to
> Teradata).
> 2. Creating DAGs for a basic use case (data movement).
> 3. Creating Tests and match Test Coverage.
> 4. Create supporting documentation for users.
> 5. Create a dashboard with system tests status history.
>
>
>
> *Phase 2*
>
> 1. Building a Transfer Operator (Cloud to Teradata and Teradata to
> Cloud).
> 2. Add SSL Support
> 3. Enhancements to match Airflow releases.
> 4. Enhancements to support Teradata VantageCloud use production use
> cases.
> 5. Support specific production use cases for Teradata Customers.
>
>
>
> *Initial Implementation Links*
>
> Implementation:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=noCZSfUrWFPcksWvXe9QSu0xcdM0Y8vF8Etuq69Q2BM%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata><https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
>
> Documentation:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RKoEIa32dCmH3QMC6gOOy4vCQxH2NbOTZygtnJxNCz0%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata><https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
>
> Unit Tests:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=HnLAKCB296kxJrP0D%2BBQwQKXDjVc8Nl%2B0ztXCWoxfi8%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata><https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
>
> System Tests:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KzUvjk5iulQ%2BkahYYOIReDq2HXSW%2FyCETZ9qB09BeGM%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata><https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
>
> System Tests Dashboard: https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5AtofepTW5Ck1y4jC0yHvIefKDXjYSrdC8iK8WQiXcM%3D&reserved=0<https://teradata.github.io/airflow/><https://teradata.github.io/airflow/>
>
>
>
>
>
> Thanks,
>
> *Sunil K Mallam*
> Staff Product Manager – 3rd Party Developer Tools
>
> [image: A black and orange logo Description automatically generated]
> <https://www.teradata.com/>
>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com<http://teradata.com/> <https://www.teradata.com/>
>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
>
> Please consider the environment before printing.
>
>
>
>
>
>
>
Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
Posted by Jarek Potiuk <ja...@potiuk.com>.
Agree,
On Tue, Jan 16, 2024 at 3:38 PM Josh Fell <jo...@astronomer.io.invalid>
wrote:
> Lots of great work here already. I say let's put it to a vote.
>
> On Tue, Jan 16, 2024 at 1:01 AM K Mallam, Sunil
> <Su...@teradata.com.invalid> wrote:
>
> > Hello Airflow Community,
> >
> > I just wanted to follow up on this thread before I start the voting
> thread.
> >
> > So far we’ve have 4 positive responses (with 1 binding vote). Is there
> > anyone else who like to share their feedback?
> >
> >
> > Thanks,
> > SM
> >
> > From: Jarek Potiuk <ja...@potiuk.com>
> > Date: Wednesday, 3 January 2024 at 8:16 PM
> > To: dev@airflow.apache.org <de...@airflow.apache.org>
> > Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > <SA...@Teradata.com>, Kaxil Naik <ka...@gmail.com>
> > Subject: Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > Teradata
> > You get to the voting stage (or lazy consensus) when you decide it's
> ready
> > to vote. Up to you to see if you think it's going to pass the
> > vote/consensus or not.
> >
> > I'd say - so far the response is positive, so I'd wait a few days and
> give
> > a chance to people to react after they came back from holidays .. and
> when
> > you think it's ready - start the vote (or consensus if you see consensus
> > building).
> >
> > J,.
> >
> > On Wed, Jan 3, 2024 at 3:37 PM K Mallam, Sunil
> > <Su...@teradata.com.invalid> wrote:
> >
> > > Hello Airflow Community,
> > >
> > >
> > >
> > > Happy 2024 to you all!
> > >
> > >
> > >
> > > I just wanted to follow up on the discussion related to our proposal
> and
> > > know when we’d get to the voting stage.
> > >
> > >
> > >
> > > Looking forward to your response.
> > >
> > >
> > >
> > >
> > >
> > > Thanks,
> > >
> > > *Sunil K Mallam*
> > > Staff Product Manager – 3rd Party Developer Tools
> > >
> > > [image: A black and orange logo Description automatically generated]
> > > <https://www.teradata.com/>
> > >
> > > 17095 Via Del Campo Ct.
> > > San Diego, CA 92127
> > > teradata.com <https://www.teradata.com/>
> > >
> > > This e-mail is from Teradata Corporation and may contain information
> that
> > > is confidential or proprietary. If you are not the intended recipient,
> do
> > > not read, copy, or distribute the e-mail or any attachments. Instead,
> > > please notify the sender and delete the e-mail and any attachments.
> Thank
> > > you.
> > >
> > > Please consider the environment before printing.
> > >
> > >
> > >
> > > *From: *K Mallam, Sunil <Su...@Teradata.com.INVALID>
> > > *Date: *Wednesday, 3 January 2024 at 6:06 PM
> > > *To: *Kaxil Naik <ka...@gmail.com>, dev@airflow.apache.org <
> > > dev@airflow.apache.org>
> > > *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > > <SA...@Teradata.com>
> > > *Subject: *Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > > Teradata
> > >
> > > You don't often get email from sunil.kmallam@teradata.com.invalid.
> Learn
> > > why this is important <https://aka.ms/LearnAboutSenderIdentification>
> > >
> > > Thank you for your kind words, Kaxil and Niko. I appreciate it!
> > >
> > >
> > >
> > >
> > >
> > > *Sunil K Mallam*
> > > Staff Product Manager – 3rd Party Developer Tools
> > >
> > > [image: A black and orange logo Description automatically generated]
> > > <https://www.teradata.com/>
> > >
> > > 17095 Via Del Campo Ct.
> > > San Diego, CA 92127
> > > teradata.com <https://www.teradata.com/>
> > >
> > > This e-mail is from Teradata Corporation and may contain information
> that
> > > is confidential or proprietary. If you are not the intended recipient,
> do
> > > not read, copy, or distribute the e-mail or any attachments. Instead,
> > > please notify the sender and delete the e-mail and any attachments.
> Thank
> > > you.
> > >
> > > Please consider the environment before printing.
> > >
> > >
> > >
> > > *From: *Kaxil Naik <ka...@gmail.com>
> > > *Date: *Monday, 25 December 2023 at 6:41 PM
> > > *To: *dev@airflow.apache.org <de...@airflow.apache.org>, K Mallam, Sunil
> > > <Su...@Teradata.com>
> > > *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > > <SA...@Teradata.com>
> > > *Subject: *[EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > > Teradata
> > >
> > > You don't often get email from kaxilnaik@gmail.com. Learn why this is
> > > important <https://aka.ms/LearnAboutSenderIdentification>
> > >
> > > [CAUTION: External Email]
> > >
> > >
> > >
> > > Adding Sunil back to the thread :)
> > >
> > >
> > >
> > > +1 binding, glad to see the final proposal after months of hard work,
> > well
> > > done Sunil and team.
> > >
> > >
> > >
> > > Regards,
> > >
> > > Kaxil
> > >
> > >
> > >
> > >
> > >
> > > On Mon, 25 Dec 2023 at 18:40, Kaxil Naik <ka...@gmail.com> wrote:
> > >
> > > +1 binding, glad to see the final proposal after months of hard work,
> > well
> > > done Sunil and team.
> > >
> > >
> > >
> > > On Mon, 25 Dec 2023 at 05:22, Oliveira, Niko
> <onikolas@amazon.com.invalid
> > >
> > > wrote:
> > >
> > > This is fantastic! I love to see the testing and dashboards being
> > invested
> > > in from the beginning, never gets old :)
> > >
> > > It shows that you really took the time to read the past discussions and
> > > documentation we have. I won't be able to look at the code in detail
> > until
> > > the new year, but so far this is a great submission and a +1 from me!
> > >
> > > Cheers,
> > > Niko
> > >
> > > ________________________________
> > > From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
> > > Sent: Sunday, December 24, 2023 7:36:02 AM
> > > To: dev@airflow.apache.org
> > > Cc: Tworkiewicz, Adam; Mishra, Harishankar; Chinthanippu, Satish
> > > Subject: RE: [EXTERNAL] [COURRIEL EXTERNE] [Discuss] New Airflow
> > Community
> > > Provider: Teradata
> > >
> > >
> > > CAUTION: This email originated from outside of the organization. Do not
> > > click links or open attachments unless you can confirm the sender and
> > know
> > > the content is safe.
> > >
> > >
> > >
> > > AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur
> externe.
> > > Ne cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne
> > pouvez
> > > pas confirmer l’identité de l’expéditeur et si vous n’êtes pas certain
> > que
> > > le contenu ne présente aucun risque.
> > >
> > >
> > > Thank you Jarek and Elad, we appreciate you recognizing the efforts we
> > put
> > > in.
> > >
> > >
> > > Sunil K Mallam
> > > Staff Product Manager – 3rd Party Developer Tools
> > > [A black and orange logo Description automatically generated]<
> > > https://www.teradata.com/><https://www.teradata.com/%3e>
> > > 17095 Via Del Campo Ct.
> > > San Diego, CA 92127
> > > teradata.com<https://www.teradata.com/>
> > > This e-mail is from Teradata Corporation and may contain information
> that
> > > is confidential or proprietary. If you are not the intended recipient,
> do
> > > not read, copy, or distribute the e-mail or any attachments. Instead,
> > > please notify the sender and delete the e-mail and any attachments.
> Thank
> > > you.
> > > Please consider the environment before printing.
> > >
> > >
> > >
> > > From: Elad Kalif <el...@apache.org>
> > > Date: Sunday, 24 December 2023 at 12:30 PM
> > > To: dev@airflow.apache.org <de...@airflow.apache.org>
> > > Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > > <SA...@Teradata.com>
> > > Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > Teradata
> > > [CAUTION: External Email]
> > >
> > >
> > > Hi Sunil,
> > >
> > > Proposal looks very solid and I do see the value in having a Teradata
> > > provider.
> > > I agree with Jarek and I am +1 for it.
> > >
> > > On Fri, Dec 22, 2023 at 9:27 PM K Mallam, Sunil
> > > <Su...@teradata.com.invalid> wrote:
> > >
> > > > Hi,
> > > >
> > > >
> > > >
> > > > I’m Sunil Mallam, a Staff Product Manager with Teradata, owning the
> > > > Third-Party Connectors and Integrations.
> > > >
> > > >
> > > >
> > > > Here’s our proposal to be a Community Provider, as we see Airflow
> > being a
> > > > key integration for Teradata’s cloud customers in terms of
> > *orchestrating
> > > > data pipelines and ML workflows *-
> > > >
> > > >
> > > >
> > > > *Why Teradata wants to be a community provider?*
> > > >
> > > > - Teradata has over 700 customers (most of them are from Fortune
> > 1000
> > > > list) who run enterprise workloads.
> > > > - Being on *Airflow’s documentation index provides* *better
> > visibility
> > > > for our user*s and they can easily find Teradata’s provider
> package,
> > > > without Teradata having to put additional effort into promoting
> it.
> > > > - Also, our customers have confidence in the quality and stability
> > of
> > > > the provider package if it’s managed and maintained by Teradata,
> > while
> > > > being validated/approved by Airflow.
> > > >
> > > >
> > > >
> > > > *How is it a positive for the Airflow project/community and why
> should
> > it
> > > > be accepted?*
> > > >
> > > > - We have a dedicated team to manage and maintain the provider
> > > package.
> > > > - Teradata will take responsibility for -
> > > > - end-to-end testing efforts, running system tests periodically
> > in
> > > > their environment, and making the status available to Airflow.
> > > > - being available and responsive to any communication from the
> > > > community members.
> > > > - To support our dedication toward contributions, Teradata is a
> > > verified
> > > > adapter with dbt
> > > > <
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0
> > <https://docs.getdbt.com/docs/supported-data-platforms>
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0
> > <https://docs.getdbt.com/docs/supported-data-platforms>><
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0
> > >><https://docs.getdbt.com/docs/supported-data-platforms> and we’re
> > > > diligent in matching up to its releases (major and minor).
> > > >
> > > >
> > > >
> > > > *What is developed as part of the initial implementation (phase 1)
> and
> > > > what’s next (phase 2)?*
> > > >
> > > > *Phase 1 *
> > > >
> > > > 1. Building a Hook, Base Operator, and Transfer Operator (Teradata
> > to
> > > > Teradata).
> > > > 2. Creating DAGs for a basic use case (data movement).
> > > > 3. Creating Tests and match Test Coverage.
> > > > 4. Create supporting documentation for users.
> > > > 5. Create a dashboard with system tests status history.
> > > >
> > > >
> > > >
> > > > *Phase 2*
> > > >
> > > > 1. Building a Transfer Operator (Cloud to Teradata and Teradata to
> > > > Cloud).
> > > > 2. Add SSL Support
> > > > 3. Enhancements to match Airflow releases.
> > > > 4. Enhancements to support Teradata VantageCloud use production
> use
> > > > cases.
> > > > 5. Support specific production use cases for Teradata Customers.
> > > >
> > > >
> > > >
> > > > *Initial Implementation Links*
> > > >
> > > > Implementation:
> > > >
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata
> > >
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata
> > >>
> > > <
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata
> > >
> > > >
> > > >
> > > > Documentation:
> > > >
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dDeU3VFYbCxH8wzfX0hLvk%2FAf9Z4rc8zJK5ttRwzupc%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata
> > >
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dDeU3VFYbCxH8wzfX0hLvk%2FAf9Z4rc8zJK5ttRwzupc%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata
> > >>
> > > <
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ybAmOnKyrJ83ANgsjuNZ0RRadVWXZ%2BxvAA%2FGveiHRmM%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata
> > >
> > > >
> > > >
> > > > Unit Tests:
> > > >
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata
> > >
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata
> > >>
> > > <
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata
> > >
> > > >
> > > >
> > > > System Tests:
> > > >
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata
> > >
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata
> > >>
> > > <
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0
> > <
> >
> https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata
> > >
> > > >
> > > >
> > > > System Tests Dashboard:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0
> > <https://teradata.github.io/airflow/>
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0
> > ><
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0
> > <https://teradata.github.io/airflow/>>
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > *Sunil K Mallam*
> > > > Staff Product Manager – 3rd Party Developer Tools
> > > >
> > > > [image: A black and orange logo Description automatically generated]
> > > > <https://www.teradata.com/>
> > > >
> > > > 17095 Via Del Campo Ct.
> > > > San Diego, CA 92127
> > > > teradata.com <https://www.teradata.com/>
> > > >
> > > > This e-mail is from Teradata Corporation and may contain information
> > that
> > > > is confidential or proprietary. If you are not the intended
> recipient,
> > do
> > > > not read, copy, or distribute the e-mail or any attachments. Instead,
> > > > please notify the sender and delete the e-mail and any attachments.
> > Thank
> > > > you.
> > > >
> > > > Please consider the environment before printing.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> >
>
Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
Posted by "K Mallam, Sunil" <Su...@Teradata.com.INVALID>.
Great! Thank you, Josh.
Sunil K Mallam
Staff Product Manager – 3rd Party Developer Tools
[A black and orange logo Description automatically generated]<https://www.teradata.com/>
17095 Via Del Campo Ct.
San Diego, CA 92127
teradata.com<https://www.teradata.com/>
This e-mail is from Teradata Corporation and may contain information that is confidential or proprietary. If you are not the intended recipient, do not read, copy, or distribute the e-mail or any attachments. Instead, please notify the sender and delete the e-mail and any attachments. Thank you.
Please consider the environment before printing.
From: Josh Fell <jo...@astronomer.io.INVALID>
Date: Tuesday, 16 January 2024 at 8:09 PM
To: dev@airflow.apache.org <de...@airflow.apache.org>
Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra, Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish <SA...@Teradata.com>, Kaxil Naik <ka...@gmail.com>
Subject: Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
[You don't often get email from josh.d.fell@astronomer.io.invalid. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]
Lots of great work here already. I say let's put it to a vote.
On Tue, Jan 16, 2024 at 1:01 AM K Mallam, Sunil
<Su...@teradata.com.invalid> wrote:
> Hello Airflow Community,
>
> I just wanted to follow up on this thread before I start the voting thread.
>
> So far we’ve have 4 positive responses (with 1 binding vote). Is there
> anyone else who like to share their feedback?
>
>
> Thanks,
> SM
>
> From: Jarek Potiuk <ja...@potiuk.com>
> Date: Wednesday, 3 January 2024 at 8:16 PM
> To: dev@airflow.apache.org <de...@airflow.apache.org>
> Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>, Kaxil Naik <ka...@gmail.com>
> Subject: Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
> You get to the voting stage (or lazy consensus) when you decide it's ready
> to vote. Up to you to see if you think it's going to pass the
> vote/consensus or not.
>
> I'd say - so far the response is positive, so I'd wait a few days and give
> a chance to people to react after they came back from holidays .. and when
> you think it's ready - start the vote (or consensus if you see consensus
> building).
>
> J,.
>
> On Wed, Jan 3, 2024 at 3:37 PM K Mallam, Sunil
> <Su...@teradata.com.invalid> wrote:
>
> > Hello Airflow Community,
> >
> >
> >
> > Happy 2024 to you all!
> >
> >
> >
> > I just wanted to follow up on the discussion related to our proposal and
> > know when we’d get to the voting stage.
> >
> >
> >
> > Looking forward to your response.
> >
> >
> >
> >
> >
> > Thanks,
> >
> > *Sunil K Mallam*
> > Staff Product Manager – 3rd Party Developer Tools
> >
> > [image: A black and orange logo Description automatically generated]
> > <https://www.teradata.com/>
> >
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com <https://www.teradata.com/>
> >
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> >
> > Please consider the environment before printing.
> >
> >
> >
> > *From: *K Mallam, Sunil <Su...@Teradata.com.INVALID>
> > *Date: *Wednesday, 3 January 2024 at 6:06 PM
> > *To: *Kaxil Naik <ka...@gmail.com>, dev@airflow.apache.org <
> > dev@airflow.apache.org>
> > *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > <SA...@Teradata.com>
> > *Subject: *Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > Teradata
> >
> > You don't often get email from sunil.kmallam@teradata.com.invalid. Learn
> > why this is important <https://aka.ms/LearnAboutSenderIdentification>
> >
> > Thank you for your kind words, Kaxil and Niko. I appreciate it!
> >
> >
> >
> >
> >
> > *Sunil K Mallam*
> > Staff Product Manager – 3rd Party Developer Tools
> >
> > [image: A black and orange logo Description automatically generated]
> > <https://www.teradata.com/>
> >
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com <https://www.teradata.com/>
> >
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> >
> > Please consider the environment before printing.
> >
> >
> >
> > *From: *Kaxil Naik <ka...@gmail.com>
> > *Date: *Monday, 25 December 2023 at 6:41 PM
> > *To: *dev@airflow.apache.org <de...@airflow.apache.org>, K Mallam, Sunil
> > <Su...@Teradata.com>
> > *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > <SA...@Teradata.com>
> > *Subject: *[EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > Teradata
> >
> > You don't often get email from kaxilnaik@gmail.com. Learn why this is
> > important <https://aka.ms/LearnAboutSenderIdentification>
> >
> > [CAUTION: External Email]
> >
> >
> >
> > Adding Sunil back to the thread :)
> >
> >
> >
> > +1 binding, glad to see the final proposal after months of hard work,
> well
> > done Sunil and team.
> >
> >
> >
> > Regards,
> >
> > Kaxil
> >
> >
> >
> >
> >
> > On Mon, 25 Dec 2023 at 18:40, Kaxil Naik <ka...@gmail.com> wrote:
> >
> > +1 binding, glad to see the final proposal after months of hard work,
> well
> > done Sunil and team.
> >
> >
> >
> > On Mon, 25 Dec 2023 at 05:22, Oliveira, Niko <onikolas@amazon.com.invalid
> >
> > wrote:
> >
> > This is fantastic! I love to see the testing and dashboards being
> invested
> > in from the beginning, never gets old :)
> >
> > It shows that you really took the time to read the past discussions and
> > documentation we have. I won't be able to look at the code in detail
> until
> > the new year, but so far this is a great submission and a +1 from me!
> >
> > Cheers,
> > Niko
> >
> > ________________________________
> > From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
> > Sent: Sunday, December 24, 2023 7:36:02 AM
> > To: dev@airflow.apache.org
> > Cc: Tworkiewicz, Adam; Mishra, Harishankar; Chinthanippu, Satish
> > Subject: RE: [EXTERNAL] [COURRIEL EXTERNE] [Discuss] New Airflow
> Community
> > Provider: Teradata
> >
> >
> > CAUTION: This email originated from outside of the organization. Do not
> > click links or open attachments unless you can confirm the sender and
> know
> > the content is safe.
> >
> >
> >
> > AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur externe.
> > Ne cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne
> pouvez
> > pas confirmer l’identité de l’expéditeur et si vous n’êtes pas certain
> que
> > le contenu ne présente aucun risque.
> >
> >
> > Thank you Jarek and Elad, we appreciate you recognizing the efforts we
> put
> > in.
> >
> >
> > Sunil K Mallam
> > Staff Product Manager – 3rd Party Developer Tools
> > [A black and orange logo Description automatically generated]<
> > https://www.teradata.com/><https://www.teradata.com/%3e><https://www.teradata.com/%3e%3chttps:/www.teradata.com/%3e%3e>
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com<https://www.teradata.com/>
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> > Please consider the environment before printing.
> >
> >
> >
> > From: Elad Kalif <el...@apache.org>
> > Date: Sunday, 24 December 2023 at 12:30 PM
> > To: dev@airflow.apache.org <de...@airflow.apache.org>
> > Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > <SA...@Teradata.com>
> > Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
> > [CAUTION: External Email]
> >
> >
> > Hi Sunil,
> >
> > Proposal looks very solid and I do see the value in having a Teradata
> > provider.
> > I agree with Jarek and I am +1 for it.
> >
> > On Fri, Dec 22, 2023 at 9:27 PM K Mallam, Sunil
> > <Su...@teradata.com.invalid> wrote:
> >
> > > Hi,
> > >
> > >
> > >
> > > I’m Sunil Mallam, a Staff Product Manager with Teradata, owning the
> > > Third-Party Connectors and Integrations.
> > >
> > >
> > >
> > > Here’s our proposal to be a Community Provider, as we see Airflow
> being a
> > > key integration for Teradata’s cloud customers in terms of
> *orchestrating
> > > data pipelines and ML workflows *-
> > >
> > >
> > >
> > > *Why Teradata wants to be a community provider?*
> > >
> > > - Teradata has over 700 customers (most of them are from Fortune
> 1000
> > > list) who run enterprise workloads.
> > > - Being on *Airflow’s documentation index provides* *better
> visibility
> > > for our user*s and they can easily find Teradata’s provider package,
> > > without Teradata having to put additional effort into promoting it.
> > > - Also, our customers have confidence in the quality and stability
> of
> > > the provider package if it’s managed and maintained by Teradata,
> while
> > > being validated/approved by Airflow.
> > >
> > >
> > >
> > > *How is it a positive for the Airflow project/community and why should
> it
> > > be accepted?*
> > >
> > > - We have a dedicated team to manage and maintain the provider
> > package.
> > > - Teradata will take responsibility for -
> > > - end-to-end testing efforts, running system tests periodically
> in
> > > their environment, and making the status available to Airflow.
> > > - being available and responsive to any communication from the
> > > community members.
> > > - To support our dedication toward contributions, Teradata is a
> > verified
> > > adapter with dbt
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494638293%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=0t%2FD857KpxWbJlBpys64KnFAQ0L8%2F3FbLQahzvreTgU%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494646771%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=iigtv8d8PVXP%2FAs%2B92aoWUCwj%2BdB3vFpOgqwPjaelI8%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>>
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494654108%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=KEAy6DyeQTP9ByJxaxbACmC%2B%2Foey433SzceB%2BRkKgU4%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494661804%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=Pnvwd9b8%2BLMvYqEzr3kOWwjq5sr5BIoXCJxk%2FtfZikc%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>>><
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494669075%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=13m%2BFnL4P7AQYeh6aZq7popXeu3fDN841FvkyiUhob8%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>
> >><https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494675805%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=gQ4pe927gVboRRYJ4ejJAiZ3sBJUadAEs3sF3zzwKL4%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>> and we’re
> > > diligent in matching up to its releases (major and minor).
> > >
> > >
> > >
> > > *What is developed as part of the initial implementation (phase 1) and
> > > what’s next (phase 2)?*
> > >
> > > *Phase 1 *
> > >
> > > 1. Building a Hook, Base Operator, and Transfer Operator (Teradata
> to
> > > Teradata).
> > > 2. Creating DAGs for a basic use case (data movement).
> > > 3. Creating Tests and match Test Coverage.
> > > 4. Create supporting documentation for users.
> > > 5. Create a dashboard with system tests status history.
> > >
> > >
> > >
> > > *Phase 2*
> > >
> > > 1. Building a Transfer Operator (Cloud to Teradata and Teradata to
> > > Cloud).
> > > 2. Add SSL Support
> > > 3. Enhancements to match Airflow releases.
> > > 4. Enhancements to support Teradata VantageCloud use production use
> > > cases.
> > > 5. Support specific production use cases for Teradata Customers.
> > >
> > >
> > >
> > > *Initial Implementation Links*
> > >
> > > Implementation:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494681655%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=xOZj4eoA56XqahxfEFZNbe9GJtUHRlCwUmCP%2BW%2BhdzM%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494686055%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=%2FnpV3JfZVczeBm4g25PLkcEl41Q3zgOScEMTgE5%2FUUU%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494690573%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=MVW017%2B3iyVronIjDsg3wCcZBracPG%2B%2F%2BOSCZ%2FUJdtc%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494694796%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=Xiih2qYRtt8Xep8r%2FA1XwU%2By7eqyTfUHKvY2uXpOvXY%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494698961%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=xOYQV3kjH8B6ZqssH0RmDI3npeAZt1DubGstNvaIBtE%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494703145%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=sdMikRNmYC%2Fxf05K2BpfU%2FMwuK27sDrB5tGefnrROjw%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> >
> > >
> > >
> > > Documentation:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494707327%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=pSR44ql1mWn0A28vBKTFonWrdFk7yTlQtZxBJTDtX%2Bg%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494711905%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=jCUjYnZmhlCdF1ve17Xfmx45%2FDcoBmVpzgn183UGUyQ%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494716493%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=rFcj6UEdT%2Fnh0ngilQqFlLFtSoulamVUe%2BDgkup5I0A%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494721292%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=drrRN3%2BK4%2BZGmCyXrLOfePtuDLnnA8V4r9%2FYbImjV%2Fc%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494726057%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=wFQHaK5sOw%2F8ideuv2doNnWlHDkvOUH96sofe62rIeU%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494730636%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=g9YL9dkkVT9OnUzjvCeZQzJ55gJVyRTuGkQHgVdFmGI%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> >
> > >
> > >
> > > Unit Tests:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494735106%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=OJVOWbJ4vG%2F%2BSoxAmLJw%2FeP9lg7BAPlW3X5p%2BqGX5qI%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494739240%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=qDaxr2CZ5OrX2sqWZUh8%2FLV6Q8AtY6%2FjdyQhOCyhD9o%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494743337%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=KMpfJErbzrKbFoOGNMWB8OT8iY3hDWq4rA1tMFz%2FToE%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494747399%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=5Ot0IWp8JDRRYft%2BiwxauI01cCw358GKYBle3AD4vDY%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494751450%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=PHbU9oeZR5eJQdE7HrUI0n3FG5tDygrKRXdUbwMCI0M%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494755500%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=iwjfjjfRDAg8BVZuMR7k6goawdlP%2Fp41rZO%2Bp3NgJ%2Bk%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> >
> > >
> > >
> > > System Tests:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494759658%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=jcnZlT%2F6B9Xwr1ez48gyNg5oyEfQNomL%2Flww62kPR10%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494763761%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=lv%2FnpWQsDO2dozTBK%2BU4Y%2BSLPLXbHQ4P%2FA6%2B6fcsCes%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494767841%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=VJvoGLN8IyhvK7b6LMNHHafRBcjY%2BZ3gDB7%2FAgK1JfI%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494771958%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=dwOdLTh9Mz1PpJoCsXVR8PBpMifQtJBy39zuMmsynJ4%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494776082%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=53HhfoG%2BXGYXlNe13MA%2BAnDmJShFUsOU1BY7nyxpMn4%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494780195%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=VnQCHU6Yt%2F%2BrguYiVLPrQwAu1bWxfnRTiQy6pMGesH8%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> >
> > >
> > >
> > > System Tests Dashboard:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494784222%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=tqT3HybjxHL%2F1PxjOog5WyhLkGmdlibsmNHiXZvz%2F50%3D&reserved=0<https://teradata.github.io/airflow/>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494788272%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=xuyRrO%2BloujWDO17lRhzTmLoaMorgCslvdE87aAM89A%3D&reserved=0<https://teradata.github.io/airflow/>>
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494792259%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=DK76%2FO43AUtOi2u4v9FZ9uyRTzaMV192WR2fUvsyraE%3D&reserved=0<https://teradata.github.io/airflow/>
> ><
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494796637%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=%2BpXnj%2FIuOhH%2Ba2RERvddMHMNrSmXMYpzuSP6YvlApz8%3D&reserved=0<https://teradata.github.io/airflow/>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C22dff96e61074692c50908dc16a0e479%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638410127494800715%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C62000%7C%7C%7C&sdata=hKSoNV0202DUo3W97tvF1BssPX9oZ0S6npOp5UrdacA%3D&reserved=0<https://teradata.github.io/airflow/>>>
> > >
> > >
> > >
> > >
> > >
> > > Thanks,
> > >
> > > *Sunil K Mallam*
> > > Staff Product Manager – 3rd Party Developer Tools
> > >
> > > [image: A black and orange logo Description automatically generated]
> > > <https://www.teradata.com/>
> > >
> > > 17095 Via Del Campo Ct.
> > > San Diego, CA 92127
> > > teradata.com <https://www.teradata.com/>
> > >
> > > This e-mail is from Teradata Corporation and may contain information
> that
> > > is confidential or proprietary. If you are not the intended recipient,
> do
> > > not read, copy, or distribute the e-mail or any attachments. Instead,
> > > please notify the sender and delete the e-mail and any attachments.
> Thank
> > > you.
> > >
> > > Please consider the environment before printing.
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> >
> >
>
Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
Posted by Josh Fell <jo...@astronomer.io.INVALID>.
Lots of great work here already. I say let's put it to a vote.
On Tue, Jan 16, 2024 at 1:01 AM K Mallam, Sunil
<Su...@teradata.com.invalid> wrote:
> Hello Airflow Community,
>
> I just wanted to follow up on this thread before I start the voting thread.
>
> So far we’ve have 4 positive responses (with 1 binding vote). Is there
> anyone else who like to share their feedback?
>
>
> Thanks,
> SM
>
> From: Jarek Potiuk <ja...@potiuk.com>
> Date: Wednesday, 3 January 2024 at 8:16 PM
> To: dev@airflow.apache.org <de...@airflow.apache.org>
> Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>, Kaxil Naik <ka...@gmail.com>
> Subject: Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
> You get to the voting stage (or lazy consensus) when you decide it's ready
> to vote. Up to you to see if you think it's going to pass the
> vote/consensus or not.
>
> I'd say - so far the response is positive, so I'd wait a few days and give
> a chance to people to react after they came back from holidays .. and when
> you think it's ready - start the vote (or consensus if you see consensus
> building).
>
> J,.
>
> On Wed, Jan 3, 2024 at 3:37 PM K Mallam, Sunil
> <Su...@teradata.com.invalid> wrote:
>
> > Hello Airflow Community,
> >
> >
> >
> > Happy 2024 to you all!
> >
> >
> >
> > I just wanted to follow up on the discussion related to our proposal and
> > know when we’d get to the voting stage.
> >
> >
> >
> > Looking forward to your response.
> >
> >
> >
> >
> >
> > Thanks,
> >
> > *Sunil K Mallam*
> > Staff Product Manager – 3rd Party Developer Tools
> >
> > [image: A black and orange logo Description automatically generated]
> > <https://www.teradata.com/>
> >
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com <https://www.teradata.com/>
> >
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> >
> > Please consider the environment before printing.
> >
> >
> >
> > *From: *K Mallam, Sunil <Su...@Teradata.com.INVALID>
> > *Date: *Wednesday, 3 January 2024 at 6:06 PM
> > *To: *Kaxil Naik <ka...@gmail.com>, dev@airflow.apache.org <
> > dev@airflow.apache.org>
> > *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > <SA...@Teradata.com>
> > *Subject: *Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > Teradata
> >
> > You don't often get email from sunil.kmallam@teradata.com.invalid. Learn
> > why this is important <https://aka.ms/LearnAboutSenderIdentification>
> >
> > Thank you for your kind words, Kaxil and Niko. I appreciate it!
> >
> >
> >
> >
> >
> > *Sunil K Mallam*
> > Staff Product Manager – 3rd Party Developer Tools
> >
> > [image: A black and orange logo Description automatically generated]
> > <https://www.teradata.com/>
> >
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com <https://www.teradata.com/>
> >
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> >
> > Please consider the environment before printing.
> >
> >
> >
> > *From: *Kaxil Naik <ka...@gmail.com>
> > *Date: *Monday, 25 December 2023 at 6:41 PM
> > *To: *dev@airflow.apache.org <de...@airflow.apache.org>, K Mallam, Sunil
> > <Su...@Teradata.com>
> > *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > <SA...@Teradata.com>
> > *Subject: *[EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> > Teradata
> >
> > You don't often get email from kaxilnaik@gmail.com. Learn why this is
> > important <https://aka.ms/LearnAboutSenderIdentification>
> >
> > [CAUTION: External Email]
> >
> >
> >
> > Adding Sunil back to the thread :)
> >
> >
> >
> > +1 binding, glad to see the final proposal after months of hard work,
> well
> > done Sunil and team.
> >
> >
> >
> > Regards,
> >
> > Kaxil
> >
> >
> >
> >
> >
> > On Mon, 25 Dec 2023 at 18:40, Kaxil Naik <ka...@gmail.com> wrote:
> >
> > +1 binding, glad to see the final proposal after months of hard work,
> well
> > done Sunil and team.
> >
> >
> >
> > On Mon, 25 Dec 2023 at 05:22, Oliveira, Niko <onikolas@amazon.com.invalid
> >
> > wrote:
> >
> > This is fantastic! I love to see the testing and dashboards being
> invested
> > in from the beginning, never gets old :)
> >
> > It shows that you really took the time to read the past discussions and
> > documentation we have. I won't be able to look at the code in detail
> until
> > the new year, but so far this is a great submission and a +1 from me!
> >
> > Cheers,
> > Niko
> >
> > ________________________________
> > From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
> > Sent: Sunday, December 24, 2023 7:36:02 AM
> > To: dev@airflow.apache.org
> > Cc: Tworkiewicz, Adam; Mishra, Harishankar; Chinthanippu, Satish
> > Subject: RE: [EXTERNAL] [COURRIEL EXTERNE] [Discuss] New Airflow
> Community
> > Provider: Teradata
> >
> >
> > CAUTION: This email originated from outside of the organization. Do not
> > click links or open attachments unless you can confirm the sender and
> know
> > the content is safe.
> >
> >
> >
> > AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur externe.
> > Ne cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne
> pouvez
> > pas confirmer l’identité de l’expéditeur et si vous n’êtes pas certain
> que
> > le contenu ne présente aucun risque.
> >
> >
> > Thank you Jarek and Elad, we appreciate you recognizing the efforts we
> put
> > in.
> >
> >
> > Sunil K Mallam
> > Staff Product Manager – 3rd Party Developer Tools
> > [A black and orange logo Description automatically generated]<
> > https://www.teradata.com/><https://www.teradata.com/%3e>
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com<https://www.teradata.com/>
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> > Please consider the environment before printing.
> >
> >
> >
> > From: Elad Kalif <el...@apache.org>
> > Date: Sunday, 24 December 2023 at 12:30 PM
> > To: dev@airflow.apache.org <de...@airflow.apache.org>
> > Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> > Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> > <SA...@Teradata.com>
> > Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
> > [CAUTION: External Email]
> >
> >
> > Hi Sunil,
> >
> > Proposal looks very solid and I do see the value in having a Teradata
> > provider.
> > I agree with Jarek and I am +1 for it.
> >
> > On Fri, Dec 22, 2023 at 9:27 PM K Mallam, Sunil
> > <Su...@teradata.com.invalid> wrote:
> >
> > > Hi,
> > >
> > >
> > >
> > > I’m Sunil Mallam, a Staff Product Manager with Teradata, owning the
> > > Third-Party Connectors and Integrations.
> > >
> > >
> > >
> > > Here’s our proposal to be a Community Provider, as we see Airflow
> being a
> > > key integration for Teradata’s cloud customers in terms of
> *orchestrating
> > > data pipelines and ML workflows *-
> > >
> > >
> > >
> > > *Why Teradata wants to be a community provider?*
> > >
> > > - Teradata has over 700 customers (most of them are from Fortune
> 1000
> > > list) who run enterprise workloads.
> > > - Being on *Airflow’s documentation index provides* *better
> visibility
> > > for our user*s and they can easily find Teradata’s provider package,
> > > without Teradata having to put additional effort into promoting it.
> > > - Also, our customers have confidence in the quality and stability
> of
> > > the provider package if it’s managed and maintained by Teradata,
> while
> > > being validated/approved by Airflow.
> > >
> > >
> > >
> > > *How is it a positive for the Airflow project/community and why should
> it
> > > be accepted?*
> > >
> > > - We have a dedicated team to manage and maintain the provider
> > package.
> > > - Teradata will take responsibility for -
> > > - end-to-end testing efforts, running system tests periodically
> in
> > > their environment, and making the status available to Airflow.
> > > - being available and responsive to any communication from the
> > > community members.
> > > - To support our dedication toward contributions, Teradata is a
> > verified
> > > adapter with dbt
> > > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0
> <https://docs.getdbt.com/docs/supported-data-platforms>
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0
> <https://docs.getdbt.com/docs/supported-data-platforms>><
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0
> >><https://docs.getdbt.com/docs/supported-data-platforms> and we’re
> > > diligent in matching up to its releases (major and minor).
> > >
> > >
> > >
> > > *What is developed as part of the initial implementation (phase 1) and
> > > what’s next (phase 2)?*
> > >
> > > *Phase 1 *
> > >
> > > 1. Building a Hook, Base Operator, and Transfer Operator (Teradata
> to
> > > Teradata).
> > > 2. Creating DAGs for a basic use case (data movement).
> > > 3. Creating Tests and match Test Coverage.
> > > 4. Create supporting documentation for users.
> > > 5. Create a dashboard with system tests status history.
> > >
> > >
> > >
> > > *Phase 2*
> > >
> > > 1. Building a Transfer Operator (Cloud to Teradata and Teradata to
> > > Cloud).
> > > 2. Add SSL Support
> > > 3. Enhancements to match Airflow releases.
> > > 4. Enhancements to support Teradata VantageCloud use production use
> > > cases.
> > > 5. Support specific production use cases for Teradata Customers.
> > >
> > >
> > >
> > > *Initial Implementation Links*
> > >
> > > Implementation:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata
> >
> > >
> > >
> > > Documentation:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dDeU3VFYbCxH8wzfX0hLvk%2FAf9Z4rc8zJK5ttRwzupc%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dDeU3VFYbCxH8wzfX0hLvk%2FAf9Z4rc8zJK5ttRwzupc%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ybAmOnKyrJ83ANgsjuNZ0RRadVWXZ%2BxvAA%2FGveiHRmM%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata
> >
> > >
> > >
> > > Unit Tests:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata
> >
> > >
> > >
> > > System Tests:
> > >
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata
> >
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata
> >>
> > <
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata
> >
> > >
> > >
> > > System Tests Dashboard:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0
> <https://teradata.github.io/airflow/>
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0
> ><
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0
> <https://teradata.github.io/airflow/>>
> > >
> > >
> > >
> > >
> > >
> > > Thanks,
> > >
> > > *Sunil K Mallam*
> > > Staff Product Manager – 3rd Party Developer Tools
> > >
> > > [image: A black and orange logo Description automatically generated]
> > > <https://www.teradata.com/>
> > >
> > > 17095 Via Del Campo Ct.
> > > San Diego, CA 92127
> > > teradata.com <https://www.teradata.com/>
> > >
> > > This e-mail is from Teradata Corporation and may contain information
> that
> > > is confidential or proprietary. If you are not the intended recipient,
> do
> > > not read, copy, or distribute the e-mail or any attachments. Instead,
> > > please notify the sender and delete the e-mail and any attachments.
> Thank
> > > you.
> > >
> > > Please consider the environment before printing.
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> >
> >
>
Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
Posted by "K Mallam, Sunil" <Su...@Teradata.com.INVALID>.
Hello Airflow Community,
I just wanted to follow up on this thread before I start the voting thread.
So far we’ve have 4 positive responses (with 1 binding vote). Is there anyone else who like to share their feedback?
Thanks,
SM
From: Jarek Potiuk <ja...@potiuk.com>
Date: Wednesday, 3 January 2024 at 8:16 PM
To: dev@airflow.apache.org <de...@airflow.apache.org>
Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra, Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish <SA...@Teradata.com>, Kaxil Naik <ka...@gmail.com>
Subject: Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
You get to the voting stage (or lazy consensus) when you decide it's ready
to vote. Up to you to see if you think it's going to pass the
vote/consensus or not.
I'd say - so far the response is positive, so I'd wait a few days and give
a chance to people to react after they came back from holidays .. and when
you think it's ready - start the vote (or consensus if you see consensus
building).
J,.
On Wed, Jan 3, 2024 at 3:37 PM K Mallam, Sunil
<Su...@teradata.com.invalid> wrote:
> Hello Airflow Community,
>
>
>
> Happy 2024 to you all!
>
>
>
> I just wanted to follow up on the discussion related to our proposal and
> know when we’d get to the voting stage.
>
>
>
> Looking forward to your response.
>
>
>
>
>
> Thanks,
>
> *Sunil K Mallam*
> Staff Product Manager – 3rd Party Developer Tools
>
> [image: A black and orange logo Description automatically generated]
> <https://www.teradata.com/>
>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com <https://www.teradata.com/>
>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
>
> Please consider the environment before printing.
>
>
>
> *From: *K Mallam, Sunil <Su...@Teradata.com.INVALID>
> *Date: *Wednesday, 3 January 2024 at 6:06 PM
> *To: *Kaxil Naik <ka...@gmail.com>, dev@airflow.apache.org <
> dev@airflow.apache.org>
> *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>
> *Subject: *Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
>
> You don't often get email from sunil.kmallam@teradata.com.invalid. Learn
> why this is important <https://aka.ms/LearnAboutSenderIdentification>
>
> Thank you for your kind words, Kaxil and Niko. I appreciate it!
>
>
>
>
>
> *Sunil K Mallam*
> Staff Product Manager – 3rd Party Developer Tools
>
> [image: A black and orange logo Description automatically generated]
> <https://www.teradata.com/>
>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com <https://www.teradata.com/>
>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
>
> Please consider the environment before printing.
>
>
>
> *From: *Kaxil Naik <ka...@gmail.com>
> *Date: *Monday, 25 December 2023 at 6:41 PM
> *To: *dev@airflow.apache.org <de...@airflow.apache.org>, K Mallam, Sunil
> <Su...@Teradata.com>
> *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>
> *Subject: *[EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
>
> You don't often get email from kaxilnaik@gmail.com. Learn why this is
> important <https://aka.ms/LearnAboutSenderIdentification>
>
> [CAUTION: External Email]
>
>
>
> Adding Sunil back to the thread :)
>
>
>
> +1 binding, glad to see the final proposal after months of hard work, well
> done Sunil and team.
>
>
>
> Regards,
>
> Kaxil
>
>
>
>
>
> On Mon, 25 Dec 2023 at 18:40, Kaxil Naik <ka...@gmail.com> wrote:
>
> +1 binding, glad to see the final proposal after months of hard work, well
> done Sunil and team.
>
>
>
> On Mon, 25 Dec 2023 at 05:22, Oliveira, Niko <on...@amazon.com.invalid>
> wrote:
>
> This is fantastic! I love to see the testing and dashboards being invested
> in from the beginning, never gets old :)
>
> It shows that you really took the time to read the past discussions and
> documentation we have. I won't be able to look at the code in detail until
> the new year, but so far this is a great submission and a +1 from me!
>
> Cheers,
> Niko
>
> ________________________________
> From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
> Sent: Sunday, December 24, 2023 7:36:02 AM
> To: dev@airflow.apache.org
> Cc: Tworkiewicz, Adam; Mishra, Harishankar; Chinthanippu, Satish
> Subject: RE: [EXTERNAL] [COURRIEL EXTERNE] [Discuss] New Airflow Community
> Provider: Teradata
>
>
> CAUTION: This email originated from outside of the organization. Do not
> click links or open attachments unless you can confirm the sender and know
> the content is safe.
>
>
>
> AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur externe.
> Ne cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne pouvez
> pas confirmer l’identité de l’expéditeur et si vous n’êtes pas certain que
> le contenu ne présente aucun risque.
>
>
> Thank you Jarek and Elad, we appreciate you recognizing the efforts we put
> in.
>
>
> Sunil K Mallam
> Staff Product Manager – 3rd Party Developer Tools
> [A black and orange logo Description automatically generated]<
> https://www.teradata.com/><https://www.teradata.com/%3e>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com<https://www.teradata.com/>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
> Please consider the environment before printing.
>
>
>
> From: Elad Kalif <el...@apache.org>
> Date: Sunday, 24 December 2023 at 12:30 PM
> To: dev@airflow.apache.org <de...@airflow.apache.org>
> Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>
> Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
> [CAUTION: External Email]
>
>
> Hi Sunil,
>
> Proposal looks very solid and I do see the value in having a Teradata
> provider.
> I agree with Jarek and I am +1 for it.
>
> On Fri, Dec 22, 2023 at 9:27 PM K Mallam, Sunil
> <Su...@teradata.com.invalid> wrote:
>
> > Hi,
> >
> >
> >
> > I’m Sunil Mallam, a Staff Product Manager with Teradata, owning the
> > Third-Party Connectors and Integrations.
> >
> >
> >
> > Here’s our proposal to be a Community Provider, as we see Airflow being a
> > key integration for Teradata’s cloud customers in terms of *orchestrating
> > data pipelines and ML workflows *-
> >
> >
> >
> > *Why Teradata wants to be a community provider?*
> >
> > - Teradata has over 700 customers (most of them are from Fortune 1000
> > list) who run enterprise workloads.
> > - Being on *Airflow’s documentation index provides* *better visibility
> > for our user*s and they can easily find Teradata’s provider package,
> > without Teradata having to put additional effort into promoting it.
> > - Also, our customers have confidence in the quality and stability of
> > the provider package if it’s managed and maintained by Teradata, while
> > being validated/approved by Airflow.
> >
> >
> >
> > *How is it a positive for the Airflow project/community and why should it
> > be accepted?*
> >
> > - We have a dedicated team to manage and maintain the provider
> package.
> > - Teradata will take responsibility for -
> > - end-to-end testing efforts, running system tests periodically in
> > their environment, and making the status available to Airflow.
> > - being available and responsive to any communication from the
> > community members.
> > - To support our dedication toward contributions, Teradata is a
> verified
> > adapter with dbt
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms>><
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJoSlMsTsFSHt2hrAxw1vGc0fl7l%2BpRcV%2FQpqCz4hsQ%3D&reserved=0>><https://docs.getdbt.com/docs/supported-data-platforms> and we’re
> > diligent in matching up to its releases (major and minor).
> >
> >
> >
> > *What is developed as part of the initial implementation (phase 1) and
> > what’s next (phase 2)?*
> >
> > *Phase 1 *
> >
> > 1. Building a Hook, Base Operator, and Transfer Operator (Teradata to
> > Teradata).
> > 2. Creating DAGs for a basic use case (data movement).
> > 3. Creating Tests and match Test Coverage.
> > 4. Create supporting documentation for users.
> > 5. Create a dashboard with system tests status history.
> >
> >
> >
> > *Phase 2*
> >
> > 1. Building a Transfer Operator (Cloud to Teradata and Teradata to
> > Cloud).
> > 2. Add SSL Support
> > 3. Enhancements to match Airflow releases.
> > 4. Enhancements to support Teradata VantageCloud use production use
> > cases.
> > 5. Support specific production use cases for Teradata Customers.
> >
> >
> >
> > *Initial Implementation Links*
> >
> > Implementation:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ceuqClmz4F21WTTIeoO823YfWoYeQ3u8NHAWIat6HzI%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> >
> >
> > Documentation:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dDeU3VFYbCxH8wzfX0hLvk%2FAf9Z4rc8zJK5ttRwzupc%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899867883838%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dDeU3VFYbCxH8wzfX0hLvk%2FAf9Z4rc8zJK5ttRwzupc%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ybAmOnKyrJ83ANgsjuNZ0RRadVWXZ%2BxvAA%2FGveiHRmM%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> >
> >
> > Unit Tests:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OvP%2Fru%2BpYhdJAovbSPCblHL0AQqM6RQdigOHwpEMZo8%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> >
> >
> > System Tests:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>>
> <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fsQ1SxnruOUOh6WCs9LwZwJJf%2FRL%2Fn2yAaUllq%2FVZao%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> >
> >
> > System Tests Dashboard:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0<https://teradata.github.io/airflow/>
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0><https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7Ca60f94a878d1492551f008dc0c6ac15a%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638398899868040184%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=D8D1lUw2uXenCHZ%2BfMbzcL9CwpHFuUAbGDKzWx2Aw8k%3D&reserved=0<https://teradata.github.io/airflow/>>
> >
> >
> >
> >
> >
> > Thanks,
> >
> > *Sunil K Mallam*
> > Staff Product Manager – 3rd Party Developer Tools
> >
> > [image: A black and orange logo Description automatically generated]
> > <https://www.teradata.com/>
> >
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com <https://www.teradata.com/>
> >
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> >
> > Please consider the environment before printing.
> >
> >
> >
> >
> >
> >
> >
>
>
Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
Posted by Jarek Potiuk <ja...@potiuk.com>.
You get to the voting stage (or lazy consensus) when you decide it's ready
to vote. Up to you to see if you think it's going to pass the
vote/consensus or not.
I'd say - so far the response is positive, so I'd wait a few days and give
a chance to people to react after they came back from holidays .. and when
you think it's ready - start the vote (or consensus if you see consensus
building).
J,.
On Wed, Jan 3, 2024 at 3:37 PM K Mallam, Sunil
<Su...@teradata.com.invalid> wrote:
> Hello Airflow Community,
>
>
>
> Happy 2024 to you all!
>
>
>
> I just wanted to follow up on the discussion related to our proposal and
> know when we’d get to the voting stage.
>
>
>
> Looking forward to your response.
>
>
>
>
>
> Thanks,
>
> *Sunil K Mallam*
> Staff Product Manager – 3rd Party Developer Tools
>
> [image: A black and orange logo Description automatically generated]
> <https://www.teradata.com/>
>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com <https://www.teradata.com/>
>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
>
> Please consider the environment before printing.
>
>
>
> *From: *K Mallam, Sunil <Su...@Teradata.com.INVALID>
> *Date: *Wednesday, 3 January 2024 at 6:06 PM
> *To: *Kaxil Naik <ka...@gmail.com>, dev@airflow.apache.org <
> dev@airflow.apache.org>
> *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>
> *Subject: *Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
>
> You don't often get email from sunil.kmallam@teradata.com.invalid. Learn
> why this is important <https://aka.ms/LearnAboutSenderIdentification>
>
> Thank you for your kind words, Kaxil and Niko. I appreciate it!
>
>
>
>
>
> *Sunil K Mallam*
> Staff Product Manager – 3rd Party Developer Tools
>
> [image: A black and orange logo Description automatically generated]
> <https://www.teradata.com/>
>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com <https://www.teradata.com/>
>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
>
> Please consider the environment before printing.
>
>
>
> *From: *Kaxil Naik <ka...@gmail.com>
> *Date: *Monday, 25 December 2023 at 6:41 PM
> *To: *dev@airflow.apache.org <de...@airflow.apache.org>, K Mallam, Sunil
> <Su...@Teradata.com>
> *Cc: *Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>
> *Subject: *[EXTERNAL] Re: [Discuss] New Airflow Community Provider:
> Teradata
>
> You don't often get email from kaxilnaik@gmail.com. Learn why this is
> important <https://aka.ms/LearnAboutSenderIdentification>
>
> [CAUTION: External Email]
>
>
>
> Adding Sunil back to the thread :)
>
>
>
> +1 binding, glad to see the final proposal after months of hard work, well
> done Sunil and team.
>
>
>
> Regards,
>
> Kaxil
>
>
>
>
>
> On Mon, 25 Dec 2023 at 18:40, Kaxil Naik <ka...@gmail.com> wrote:
>
> +1 binding, glad to see the final proposal after months of hard work, well
> done Sunil and team.
>
>
>
> On Mon, 25 Dec 2023 at 05:22, Oliveira, Niko <on...@amazon.com.invalid>
> wrote:
>
> This is fantastic! I love to see the testing and dashboards being invested
> in from the beginning, never gets old :)
>
> It shows that you really took the time to read the past discussions and
> documentation we have. I won't be able to look at the code in detail until
> the new year, but so far this is a great submission and a +1 from me!
>
> Cheers,
> Niko
>
> ________________________________
> From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
> Sent: Sunday, December 24, 2023 7:36:02 AM
> To: dev@airflow.apache.org
> Cc: Tworkiewicz, Adam; Mishra, Harishankar; Chinthanippu, Satish
> Subject: RE: [EXTERNAL] [COURRIEL EXTERNE] [Discuss] New Airflow Community
> Provider: Teradata
>
>
> CAUTION: This email originated from outside of the organization. Do not
> click links or open attachments unless you can confirm the sender and know
> the content is safe.
>
>
>
> AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur externe.
> Ne cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne pouvez
> pas confirmer l’identité de l’expéditeur et si vous n’êtes pas certain que
> le contenu ne présente aucun risque.
>
>
> Thank you Jarek and Elad, we appreciate you recognizing the efforts we put
> in.
>
>
> Sunil K Mallam
> Staff Product Manager – 3rd Party Developer Tools
> [A black and orange logo Description automatically generated]<
> https://www.teradata.com/>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com<https://www.teradata.com/>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
> Please consider the environment before printing.
>
>
>
> From: Elad Kalif <el...@apache.org>
> Date: Sunday, 24 December 2023 at 12:30 PM
> To: dev@airflow.apache.org <de...@airflow.apache.org>
> Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra,
> Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish
> <SA...@Teradata.com>
> Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
> [CAUTION: External Email]
>
>
> Hi Sunil,
>
> Proposal looks very solid and I do see the value in having a Teradata
> provider.
> I agree with Jarek and I am +1 for it.
>
> On Fri, Dec 22, 2023 at 9:27 PM K Mallam, Sunil
> <Su...@teradata.com.invalid> wrote:
>
> > Hi,
> >
> >
> >
> > I’m Sunil Mallam, a Staff Product Manager with Teradata, owning the
> > Third-Party Connectors and Integrations.
> >
> >
> >
> > Here’s our proposal to be a Community Provider, as we see Airflow being a
> > key integration for Teradata’s cloud customers in terms of *orchestrating
> > data pipelines and ML workflows *-
> >
> >
> >
> > *Why Teradata wants to be a community provider?*
> >
> > - Teradata has over 700 customers (most of them are from Fortune 1000
> > list) who run enterprise workloads.
> > - Being on *Airflow’s documentation index provides* *better visibility
> > for our user*s and they can easily find Teradata’s provider package,
> > without Teradata having to put additional effort into promoting it.
> > - Also, our customers have confidence in the quality and stability of
> > the provider package if it’s managed and maintained by Teradata, while
> > being validated/approved by Airflow.
> >
> >
> >
> > *How is it a positive for the Airflow project/community and why should it
> > be accepted?*
> >
> > - We have a dedicated team to manage and maintain the provider
> package.
> > - Teradata will take responsibility for -
> > - end-to-end testing efforts, running system tests periodically in
> > their environment, and making the status available to Airflow.
> > - being available and responsive to any communication from the
> > community members.
> > - To support our dedication toward contributions, Teradata is a
> verified
> > adapter with dbt
> > <
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=frYiNGXU6w7mPhRY2PK7DM7Y%2Bzo9a4zYkrwHTITatxg%3D&reserved=0
> <https://docs.getdbt.com/docs/supported-data-platforms><
> https://docs.getdbt.com/docs/supported-data-platforms>> and we’re
> > diligent in matching up to its releases (major and minor).
> >
> >
> >
> > *What is developed as part of the initial implementation (phase 1) and
> > what’s next (phase 2)?*
> >
> > *Phase 1 *
> >
> > 1. Building a Hook, Base Operator, and Transfer Operator (Teradata to
> > Teradata).
> > 2. Creating DAGs for a basic use case (data movement).
> > 3. Creating Tests and match Test Coverage.
> > 4. Create supporting documentation for users.
> > 5. Create a dashboard with system tests status history.
> >
> >
> >
> > *Phase 2*
> >
> > 1. Building a Transfer Operator (Cloud to Teradata and Teradata to
> > Cloud).
> > 2. Add SSL Support
> > 3. Enhancements to match Airflow releases.
> > 4. Enhancements to support Teradata VantageCloud use production use
> > cases.
> > 5. Support specific production use cases for Teradata Customers.
> >
> >
> >
> > *Initial Implementation Links*
> >
> > Implementation:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=noCZSfUrWFPcksWvXe9QSu0xcdM0Y8vF8Etuq69Q2BM%3D&reserved=0
> <https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
> <
> https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata
> >
> >
> > Documentation:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RKoEIa32dCmH3QMC6gOOy4vCQxH2NbOTZygtnJxNCz0%3D&reserved=0
> <https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
> <
> https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata
> >
> >
> > Unit Tests:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=HnLAKCB296kxJrP0D%2BBQwQKXDjVc8Nl%2B0ztXCWoxfi8%3D&reserved=0
> <https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata
> >
> >
> > System Tests:
> >
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KzUvjk5iulQ%2BkahYYOIReDq2HXSW%2FyCETZ9qB09BeGM%3D&reserved=0
> <https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
> <
> https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata
> >
> >
> > System Tests Dashboard:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5AtofepTW5Ck1y4jC0yHvIefKDXjYSrdC8iK8WQiXcM%3D&reserved=0
> <https://teradata.github.io/airflow/><https://teradata.github.io/airflow/>
> >
> >
> >
> >
> >
> > Thanks,
> >
> > *Sunil K Mallam*
> > Staff Product Manager – 3rd Party Developer Tools
> >
> > [image: A black and orange logo Description automatically generated]
> > <https://www.teradata.com/>
> >
> > 17095 Via Del Campo Ct.
> > San Diego, CA 92127
> > teradata.com <https://www.teradata.com/>
> >
> > This e-mail is from Teradata Corporation and may contain information that
> > is confidential or proprietary. If you are not the intended recipient, do
> > not read, copy, or distribute the e-mail or any attachments. Instead,
> > please notify the sender and delete the e-mail and any attachments. Thank
> > you.
> >
> > Please consider the environment before printing.
> >
> >
> >
> >
> >
> >
> >
>
>
Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
Posted by "K Mallam, Sunil" <Su...@Teradata.com.INVALID>.
Hello Airflow Community,
Happy 2024 to you all!
I just wanted to follow up on the discussion related to our proposal and know when we’d get to the voting stage.
Looking forward to your response.
Thanks,
Sunil K Mallam
Staff Product Manager – 3rd Party Developer Tools
[A black and orange logo Description automatically generated]<https://www.teradata.com/>
17095 Via Del Campo Ct.
San Diego, CA 92127
teradata.com<https://www.teradata.com/>
This e-mail is from Teradata Corporation and may contain information that is confidential or proprietary. If you are not the intended recipient, do not read, copy, or distribute the e-mail or any attachments. Instead, please notify the sender and delete the e-mail and any attachments. Thank you.
Please consider the environment before printing.
From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
Date: Wednesday, 3 January 2024 at 6:06 PM
To: Kaxil Naik <ka...@gmail.com>, dev@airflow.apache.org <de...@airflow.apache.org>
Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra, Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish <SA...@Teradata.com>
Subject: Re: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
You don't often get email from sunil.kmallam@teradata.com.invalid. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification>
Thank you for your kind words, Kaxil and Niko. I appreciate it!
Sunil K Mallam
Staff Product Manager – 3rd Party Developer Tools
[A black and orange logo Description automatically generated]<https://www.teradata.com/>
17095 Via Del Campo Ct.
San Diego, CA 92127
teradata.com<https://www.teradata.com/>
This e-mail is from Teradata Corporation and may contain information that is confidential or proprietary. If you are not the intended recipient, do not read, copy, or distribute the e-mail or any attachments. Instead, please notify the sender and delete the e-mail and any attachments. Thank you.
Please consider the environment before printing.
From: Kaxil Naik <ka...@gmail.com>
Date: Monday, 25 December 2023 at 6:41 PM
To: dev@airflow.apache.org <de...@airflow.apache.org>, K Mallam, Sunil <Su...@Teradata.com>
Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra, Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish <SA...@Teradata.com>
Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
You don't often get email from kaxilnaik@gmail.com. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification>
[CAUTION: External Email]
Adding Sunil back to the thread :)
+1 binding, glad to see the final proposal after months of hard work, well done Sunil and team.
Regards,
Kaxil
On Mon, 25 Dec 2023 at 18:40, Kaxil Naik <ka...@gmail.com>> wrote:
+1 binding, glad to see the final proposal after months of hard work, well done Sunil and team.
On Mon, 25 Dec 2023 at 05:22, Oliveira, Niko <on...@amazon.com.invalid> wrote:
This is fantastic! I love to see the testing and dashboards being invested in from the beginning, never gets old :)
It shows that you really took the time to read the past discussions and documentation we have. I won't be able to look at the code in detail until the new year, but so far this is a great submission and a +1 from me!
Cheers,
Niko
________________________________
From: K Mallam, Sunil <Su...@Teradata.com.INVALID>
Sent: Sunday, December 24, 2023 7:36:02 AM
To: dev@airflow.apache.org<ma...@airflow.apache.org>
Cc: Tworkiewicz, Adam; Mishra, Harishankar; Chinthanippu, Satish
Subject: RE: [EXTERNAL] [COURRIEL EXTERNE] [Discuss] New Airflow Community Provider: Teradata
CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.
AVERTISSEMENT: Ce courrier électronique provient d’un expéditeur externe. Ne cliquez sur aucun lien et n’ouvrez aucune pièce jointe si vous ne pouvez pas confirmer l’identité de l’expéditeur et si vous n’êtes pas certain que le contenu ne présente aucun risque.
Thank you Jarek and Elad, we appreciate you recognizing the efforts we put in.
Sunil K Mallam
Staff Product Manager – 3rd Party Developer Tools
[A black and orange logo Description automatically generated]<https://www.teradata.com/>
17095 Via Del Campo Ct.
San Diego, CA 92127
teradata.com<http://teradata.com/><https://www.teradata.com/>
This e-mail is from Teradata Corporation and may contain information that is confidential or proprietary. If you are not the intended recipient, do not read, copy, or distribute the e-mail or any attachments. Instead, please notify the sender and delete the e-mail and any attachments. Thank you.
Please consider the environment before printing.
From: Elad Kalif <el...@apache.org>>
Date: Sunday, 24 December 2023 at 12:30 PM
To: dev@airflow.apache.org<ma...@airflow.apache.org> <de...@airflow.apache.org>>
Cc: Tworkiewicz, Adam <Ad...@Teradata.com>, Mishra, Harishankar <Ha...@Teradata.com>, Chinthanippu, Satish <SA...@Teradata.com>
Subject: [EXTERNAL] Re: [Discuss] New Airflow Community Provider: Teradata
[CAUTION: External Email]
Hi Sunil,
Proposal looks very solid and I do see the value in having a Teradata
provider.
I agree with Jarek and I am +1 for it.
On Fri, Dec 22, 2023 at 9:27 PM K Mallam, Sunil
<Su...@teradata.com>.invalid> wrote:
> Hi,
>
>
>
> I’m Sunil Mallam, a Staff Product Manager with Teradata, owning the
> Third-Party Connectors and Integrations.
>
>
>
> Here’s our proposal to be a Community Provider, as we see Airflow being a
> key integration for Teradata’s cloud customers in terms of *orchestrating
> data pipelines and ML workflows *-
>
>
>
> *Why Teradata wants to be a community provider?*
>
> - Teradata has over 700 customers (most of them are from Fortune 1000
> list) who run enterprise workloads.
> - Being on *Airflow’s documentation index provides* *better visibility
> for our user*s and they can easily find Teradata’s provider package,
> without Teradata having to put additional effort into promoting it.
> - Also, our customers have confidence in the quality and stability of
> the provider package if it’s managed and maintained by Teradata, while
> being validated/approved by Airflow.
>
>
>
> *How is it a positive for the Airflow project/community and why should it
> be accepted?*
>
> - We have a dedicated team to manage and maintain the provider package.
> - Teradata will take responsibility for -
> - end-to-end testing efforts, running system tests periodically in
> their environment, and making the status available to Airflow.
> - being available and responsive to any communication from the
> community members.
> - To support our dedication toward contributions, Teradata is a verified
> adapter with dbt
> <https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.getdbt.com%2Fdocs%2Fsupported-data-platforms&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=frYiNGXU6w7mPhRY2PK7DM7Y%2Bzo9a4zYkrwHTITatxg%3D&reserved=0<https://docs.getdbt.com/docs/supported-data-platforms><https://docs.getdbt.com/docs/supported-data-platforms>> and we’re
> diligent in matching up to its releases (major and minor).
>
>
>
> *What is developed as part of the initial implementation (phase 1) and
> what’s next (phase 2)?*
>
> *Phase 1 *
>
> 1. Building a Hook, Base Operator, and Transfer Operator (Teradata to
> Teradata).
> 2. Creating DAGs for a basic use case (data movement).
> 3. Creating Tests and match Test Coverage.
> 4. Create supporting documentation for users.
> 5. Create a dashboard with system tests status history.
>
>
>
> *Phase 2*
>
> 1. Building a Transfer Operator (Cloud to Teradata and Teradata to
> Cloud).
> 2. Add SSL Support
> 3. Enhancements to match Airflow releases.
> 4. Enhancements to support Teradata VantageCloud use production use
> cases.
> 5. Support specific production use cases for Teradata Customers.
>
>
>
> *Initial Implementation Links*
>
> Implementation:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fairflow%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=noCZSfUrWFPcksWvXe9QSu0xcdM0Y8vF8Etuq69Q2BM%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata><https://github.com/Teradata/airflow/tree/td_develop/airflow/providers/teradata>
>
> Documentation:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Fdocs%2Fapache-airflow-providers-teradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RKoEIa32dCmH3QMC6gOOy4vCQxH2NbOTZygtnJxNCz0%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata><https://github.com/Teradata/airflow/tree/td_develop/docs/apache-airflow-providers-teradata>
>
> Unit Tests:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=HnLAKCB296kxJrP0D%2BBQwQKXDjVc8Nl%2B0ztXCWoxfi8%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata><https://github.com/Teradata/airflow/tree/td_develop/tests/providers/teradata>
>
> System Tests:
> https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FTeradata%2Fairflow%2Ftree%2Ftd_develop%2Ftests%2Fsystem%2Fproviders%2Fteradata&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KzUvjk5iulQ%2BkahYYOIReDq2HXSW%2FyCETZ9qB09BeGM%3D&reserved=0<https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata><https://github.com/Teradata/airflow/tree/td_develop/tests/system/providers/teradata>
>
> System Tests Dashboard: https://nam02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fteradata.github.io%2Fairflow%2F&data=05%7C02%7CSunil.KMallam%40teradata.com%7C2a3782d11fce4531fd9708dc044df8d8%7C9151cbaafc6b4f4889bb8c4a71982138%7C0%7C0%7C638389980147820074%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5AtofepTW5Ck1y4jC0yHvIefKDXjYSrdC8iK8WQiXcM%3D&reserved=0<https://teradata.github.io/airflow/><https://teradata.github.io/airflow/>
>
>
>
>
>
> Thanks,
>
> *Sunil K Mallam*
> Staff Product Manager – 3rd Party Developer Tools
>
> [image: A black and orange logo Description automatically generated]
> <https://www.teradata.com/>
>
> 17095 Via Del Campo Ct.
> San Diego, CA 92127
> teradata.com<http://teradata.com/> <https://www.teradata.com/>
>
> This e-mail is from Teradata Corporation and may contain information that
> is confidential or proprietary. If you are not the intended recipient, do
> not read, copy, or distribute the e-mail or any attachments. Instead,
> please notify the sender and delete the e-mail and any attachments. Thank
> you.
>
> Please consider the environment before printing.
>
>
>
>
>
>
>