You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "potiuk (via GitHub)" <gi...@apache.org> on 2025/01/25 22:59:57 UTC
[I] Convert remaining providers to the new structure [airflow]
potiuk opened a new issue, #46045:
URL: https://github.com/apache/airflow/issues/46045
We have now a number of providers converted to the new structure. We have almost 90 of them to be converted. And we have automated scripts that do bulk of the work. This was part of #44511
The list below keeps track of the conversion. The list is generated via:
```
find providers/src -name 'provider.yaml' | sed 's/providers\/src\/airflow\/providers/ - [ ] /' | sed s'/\/provider.yaml//' | sor
```
- [ ] /amazon
- [ ] /apache/beam
- [ ] /apache/cassandra
- [ ] /apache/drill
- [ ] /apache/druid
- [ ] /apache/flink
- [ ] /apache/hdfs
- [ ] /apache/hive
- [ ] /apache/impala
- [ ] /apache/kafka
- [ ] /apache/kylin
- [ ] /apache/livy
- [ ] /apache/pig
- [ ] /apache/pinot
- [ ] /apache/spark
- [ ] /apprise
- [ ] /arangodb
- [ ] /asana
- [ ] /atlassian/jira
- [ ] /cloudant
- [ ] /cncf/kubernetes
- [ ] /cohere
- [ ] /common/compat
- [ ] /common/io
- [ ] /databricks
- [ ] /datadog
- [ ] /dbt/cloud
- [ ] /dingding
- [ ] /discord
- [ ] /docker
- [ ] /elasticsearch
- [ ] /exasol
- [ ] /fab
- [ ] /facebook
- [ ] /ftp
- [ ] /github
- [ ] /google
- [ ] /grpc
- [ ] /hashicorp
- [ ] /http
- [ ] /imap
- [ ] /influxdb
- [ ] /jdbc
- [ ] /jenkins
- [ ] /microsoft/azure
- [ ] /microsoft/mssql
- [ ] /microsoft/psrp
- [ ] /microsoft/winrm
- [ ] /mongo
- [ ] /mysql
- [ ] /neo4j
- [ ] /odbc
- [ ] /openai
- [ ] /openfaas
- [ ] /openlineage
- [ ] /opensearch
- [ ] /opsgenie
- [ ] /oracle
- [ ] /pagerduty
- [ ] /papermill
- [ ] /pgvector
- [ ] /pinecone
- [ ] /postgres
- [ ] /presto
- [ ] /qdrant
- [ ] /redis
- [ ] /salesforce
- [ ] /samba
- [ ] /segment
- [ ] /sendgrid
- [ ] /sftp
- [ ] /singularity
- [ ] /slack
- [ ] /smtp
- [ ] /snowflake
- [ ] /sqlite
- [ ] /ssh
- [ ] /tableau
- [ ] /telegram
- [ ] /teradata
- [ ] /trino
- [ ] /vertica
- [ ] /weaviate
- [ ] /yandex
- [ ] /ydb
- [ ] /zendesk
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614987744
> There should not really be an issue related to the migration but I'd prefer not batching them. In case there is an issue, reverting the batch would be uglier than individually isolating and debugging
Yeah. Resolving the conflicts is not **that** bad and actually the more providers we migrate, the less likely conflicts will be - becase all the conflicting stuff is only when you have adjacent changes in the file - i.e. two providers migrated separatelyt that are "neighbours".
I think our aim should be to migrate providers semi-randomly :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "jason810496 (via GitHub)" <gi...@apache.org>.
jason810496 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2626715887
Working on
- sendgrid
- oracle
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "jscheffl (via GitHub)" <gi...@apache.org>.
jscheffl commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2646126236
Fantastic! Now the cleanup can start!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "rawwar (via GitHub)" <gi...@apache.org>.
rawwar commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614779556
@shubhamraj-git , @vatsrahul1001 , I see you have multiple PR's that have all tests passed. I think it's easier if you raise a single PR by batching them. Otherwise, each PR merge might need you to resolve conflicts, and that's going to take much longer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614572695
Unfortunately a log of those result in conflicts if they are not done in sequence - so you will have to rebase those that have conflicts :(
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2641021408
> [@potiuk](https://github.com/potiuk) I don't know if it's already planned, at least I didn't find any mention in this and open issues. But this structure change broke `CODEOWNERS` (and auto reviewers setting), maybe it should be added to check-list or as a new issue?
Ah. Great point :). Will fix it soon. Thanks @insomnes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "eladkal (via GitHub)" <gi...@apache.org>.
eladkal commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614210109
Lets please make sure we merge open PRs for the providers (if we can) before the conversion.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "kunaljubce (via GitHub)" <gi...@apache.org>.
kunaljubce commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2615070781
Working on:
* /apache/beam #46071 (Ready for review)
* /microsoft/azure
* /microsoft/mssql
* /microsoft/psrp
* /microsoft/winrm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614845077
There should not really be an issue related to the migration but I'd prefer not batching them. In case there is an issue, reverting the batch would be uglier than individually isolating and debugging
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2643404101
@o-nikolas already works on Amazon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2643398527
Two to go !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2646121170
DONE ! 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "vatsrahul1001 (via GitHub)" <gi...@apache.org>.
vatsrahul1001 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614830486
> We really need to batch the providers now - seems that many of them can be fully automated - so I suggest to select a range of those providers (you can provide multiple providers as input to the move script) and submit them together. That will make resolving of the conflict a bit easier.
Yes I have merged `mysql odbc jenkins pagerduty` providers in [PR](https://github.com/apache/airflow/pull/46102)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "rawwar (via GitHub)" <gi...@apache.org>.
rawwar commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614176844
I'll work on Zendesk
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "vatsrahul1001 (via GitHub)" <gi...@apache.org>.
vatsrahul1001 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614220982
[PR](https://github.com/apache/airflow/pull/46049) for Weaviate.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "josix (via GitHub)" <gi...@apache.org>.
josix commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2626395823
Working on `salesforce`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "dabla (via GitHub)" <gi...@apache.org>.
dabla commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2626913762
@kunaljubce I don't see the microsoft provider mentioned here, but found it [here](https://github.com/apache/airflow/pull/46254), but apparently it only relates to azure, while I was already moving all 4 of them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "bugraoz93 (via GitHub)" <gi...@apache.org>.
bugraoz93 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2628957514
I couldn't find any orphan provider, hope I am not missing any 🤞If someone needs extra hands, please let me know. Amazing progress! Kudos all!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "sunank200 (via GitHub)" <gi...@apache.org>.
sunank200 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2627467473
Is the change for `/arangodb` done? I can pick that up
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "dabla (via GitHub)" <gi...@apache.org>.
dabla commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2627867175
> Hi David, Yeah, so the providers and their respective PRs are being marked in the issue created to track this move. I have mentioned that I am taking it up in the issue comments. Also, I initially planned to do all microsoft provider moves in 1 PR. But microsoft/azure itself is changing 200+ files, so it didn't seem like a good idea to punch more providers into it. I am actively working on this one, so feel free to take up the remaining microsoft providers. I will remove them from my comment in the corresponding issue. Hope that clarifies :) Regards, Kunal
> […](#)
Hello Kunal,
Yes thank you for the explanation was a bit confused thanks once again ;-)
Kind regards,
David
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2634282202
> This is amazing, I only noticed the list this morning and it's already "done".
ALMOST
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2645943098
Just Amazon left (and almost there: @o-nikolas ) :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2645824792
> [@potiuk](https://github.com/potiuk) I didn't think it would actually let me do that, but I edited your last comment with the names of the person working on the last two so people don't keep pinging you that they can do them.
cool
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "bugraoz93 (via GitHub)" <gi...@apache.org>.
bugraoz93 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2649046573
Great work! Amazing team effort! This kind of big chunk of work always feels better 😄 Thanks all!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "o-nikolas (via GitHub)" <gi...@apache.org>.
o-nikolas commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2648781964
Awesome! Great work everyone! 😃
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "o-nikolas (via GitHub)" <gi...@apache.org>.
o-nikolas commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2625341372
I've just gone through and audited the list and updated the checklist to be accurate of what's complete. Some things are not complete but claimed/in progress. Here is the current list of unclaimed providers. I have crossed out a couple that I'm going to claim and work on as of this message 😃 So there are 5 left unclaimed as far as I can tell.
- sendgrid
- salesforce
- oracle
- google
- cncf.kubernetes
- ~~cloudant~~
- ~~amazon~~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "dabla (via GitHub)" <gi...@apache.org>.
dabla commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2628108440
I've created [PR ](https://github.com/apache/airflow/pull/46338) to move remaining Microsoft providers
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #46045: Convert remaining providers to the new structure
URL: https://github.com/apache/airflow/issues/46045
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "dabla (via GitHub)" <gi...@apache.org>.
dabla commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2634555086
@potiuk wasn't winrm already converted with my [PR](https://github.com/apache/airflow/pull/46338)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "o-nikolas (via GitHub)" <gi...@apache.org>.
o-nikolas commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2622620302
Hey folks, I'm going to tackle apache/druid and apache/drill
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2628957960
> I couldn't find any orphan provider, hope I am not missing any 🤞If someone needs extra hands, please let me know. Amazing progress! Kudos all!
Indeed !!! I am super impressed :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "kunaljubce (via GitHub)" <gi...@apache.org>.
kunaljubce commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2643405238
For anyone coming in new, `microsoft.azure` PR is in the works :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "shubhamraj-git (via GitHub)" <gi...@apache.org>.
shubhamraj-git commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2648834246
Wooww!! Thanks everyone! It was a great team effort. 😄
On Mon, 10 Feb 2025 at 23:10, Niko Oliveira ***@***.***>
wrote:
> Awesome! Great work everyone! 😃
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/46045#issuecomment-2648781964>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/ALPQ3RRQ5A4WIMMCYBZVUKL2PDQBPAVCNFSM6AAAAABV3Y7SMWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNBYG44DCOJWGQ>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "hardeybisey (via GitHub)" <gi...@apache.org>.
hardeybisey commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2626683707
Will be working on databricks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2627858726
> Is the change for `/arangodb` done? I can pick that up
Ya. Need to rebase my PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "insomnes (via GitHub)" <gi...@apache.org>.
insomnes commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2641019395
@potiuk I don't know if it's already planned, at least I didn't find any mention in this and open issues. But this structure change broke `CODEOWNERS` (and auto reviewers setting), maybe it should be added to check-list or as a new issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2641070513
5 (!) to go !
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "josix (via GitHub)" <gi...@apache.org>.
josix commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2615018004
working on
- /common/compat
- /common/io
- /databricks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614206567
I'm working on Trino
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614281077
> Lets please make sure we merge open PRs for the providers (if we can) before the conversion.
Yeah before attempting to convert a particular provider It would be great to check if there are outsanding PRs. I am going through the PRs from the last few weeks to see if they apply - but if anyone will want to take on a provider - just checking if there are no related PRs before will do the job :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614606975
We really need to batch the providers now - seems that many of them can be fully automated - so I suggest to select a range of those providers (you can provide multiple providers as input to the move script) and submit them together. That will make resolving of the conflict a bit easier.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "rawwar (via GitHub)" <gi...@apache.org>.
rawwar commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2626589022
Will pick on google
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "rawwar (via GitHub)" <gi...@apache.org>.
rawwar commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614723192
Working on sqlite, redis, vertica
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "josix (via GitHub)" <gi...@apache.org>.
josix commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614561045
I'm working on openai and mongodb
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614992223
Working on
/exasol
/influxdb
/apache/impala
/dingding
/apache/cassandra
/yandex
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "amoghrajesh (via GitHub)" <gi...@apache.org>.
amoghrajesh commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2615216345
> > There should not really be an issue related to the migration but I'd prefer not batching them. In case there is an issue, reverting the batch would be uglier than individually isolating and debugging
>
> Yeah. Resolving the conflicts is not **that** bad and actually the more providers we migrate, the less likely conflicts will be - becase all the conflicting stuff is only when you have adjacent changes in the file - i.e. two providers migrated separatelyt that are "neighbours".
>
> I think our aim should be to migrate providers semi-randomly :)
Okay yeah. No neighbours and semi random is something that will almost always work!!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "kunaljubce (via GitHub)" <gi...@apache.org>.
kunaljubce commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2627414478
Hi David,
Yeah, so the providers and their respective PRs are being marked in the
issue created to track this move. I have mentioned that I am taking it up
in the issue comments.
Also, I initially planned to do all microsoft provider moves in 1 PR. But
microsoft/azure itself is changing 200+ files, so it didn't seem like a
good idea to punch more providers into it. I am actively working on this
one, so feel free to take up the remaining microsoft providers. I will
remove them from my comment in the corresponding issue.
Hope that clarifies :)
Regards,
Kunal
On Fri, 31 Jan 2025, 16:21 David Blain, ***@***.***> wrote:
> @kunaljubce <https://github.com/kunaljubce> I don't see the microsoft
> provider mentioned here, but found it here
> <https://github.com/apache/airflow/pull/46254>, but apparently it only
> relates to azure, while I was already moving all 4 of them.
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/46045#issuecomment-2626913762>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AIG3THSPYXCGNIEDVWV3MPD2NNIR3AVCNFSM6AAAAABV3Y7SMWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMRWHEYTGNZWGI>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2641034620
@insomnes https://github.com/apache/airflow/pull/46538 here -> one great thing about the provider move is that it removes a lot of duplication from this file.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #46045: Convert remaining providers to the new structure
URL: https://github.com/apache/airflow/issues/46045
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2646134805
> Fantastic! Now the cleanup can start!
Oh. Absolutely :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2643220173
Three to go:
- [ ] amazon
- [ ] databricks
- [ ] microsoft.azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "Prab-27 (via GitHub)" <gi...@apache.org>.
Prab-27 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2643402117
I 'll work on Amazon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2637795215
> [@potiuk](https://github.com/potiuk) wasn't winrm already converted with my [PR](https://github.com/apache/airflow/pull/46338)?
Yep. Looks like.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "ferruzzi (via GitHub)" <gi...@apache.org>.
ferruzzi commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2644049263
@potiuk I didn't think it would actually let me do that, but I edited your last comment with the names of the person working on the last two so people don't keep pinging you that they can do them.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "jason810496 (via GitHub)" <gi...@apache.org>.
jason810496 commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2614845545
Working on
- https://github.com/apache/airflow/pull/46103
- /apache/pig
- /apache/pinot
- /apache/spark
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "ferruzzi (via GitHub)" <gi...@apache.org>.
ferruzzi commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2631629176
This is amazing, I only noticed the list this morning and it's already "done".
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Convert remaining providers to the new structure [airflow]
Posted by "kunaljubce (via GitHub)" <gi...@apache.org>.
kunaljubce commented on issue #46045:
URL: https://github.com/apache/airflow/issues/46045#issuecomment-2627484959
Ankit, check out the issue https://github.com/apache/airflow/issues/46045
and see if anyone has commented regarding taking this up or linked any PRs
for it. If not, just drop a comment and take it up.
Hope that helps!
Thanks,
Kunal
On Fri, 31 Jan 2025, 19:50 Ankit Chaurasia, ***@***.***>
wrote:
> Is the change for /arangodb done? I can pick that up
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/46045#issuecomment-2627467473>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AIG3THTGRGUJ7PVUFTMR7K32NOBBVAVCNFSM6AAAAABV3Y7SMWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMRXGQ3DONBXGM>
> .
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org