You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@airflow.apache.org by Jarek Potiuk <Ja...@polidea.com> on 2020/06/24 08:44:13 UTC
Airflow Backport Provider Packages 2020.6.24 released
Hello Everyone,
I have a great pleasure to announce that we've just released the Airflow
Backport Provider packages version 2020.6.24.
This has been a true team-work from the community to make it happen. Many
people contributed to it! It originated with AIP-21 and I think the release
today concludes AIP-21 fully.
The Backport provider packages make it possible to easily use Airflow 2.0
Operators, Hooks, Sensors, Secrets, Transfers in Airflow 1.10. More stats
below, but the Backport Provider packages increase the number of
easily-available integrations for Airflow 1.10 users by a whopping *55%*.
It's an intermediate step to make migration to the future 2.0 version
easier. You should be able to use those operators in Airflow 1.10 in
parallel to existing operators, so you can do a gradual. incremental
migration. Later we will have an "upgrade-check" mechanism to help with the
migration process. This is also our way to find out if this is a good
idea to split Airflow 2.0 into separate packages as well - following AIP-8.
You can find more information here:
https://github.com/apache/airflow#backport-packages
I have a kind request - please - use those packages and let us know your
feedback.
This is the first official release of those packages. While it has been
extensively tested, there might be some teething problems. We have a way
now to release each package independently so we should be able to release
and fix some of the problems in much faster cadence than regular Airflow
releases.
Feel free to join the slack channel #backport-packages where you can raise
your questions, comments, issues:
https://apache-airflow.slack.com/archives/C0145R4NPS5
Some stats:
* We have *58* backport packages in total. *599* classes (Operators, Hooks,
Transfers, Sensors, Secrets)
* We have *213* new (!) classes that have not been easily available to 1.10
users so far:
* Operators: 150
* Transfers: 12
* Sensors: 14
* Hooks: 37
* Secrets: 0
* We have 386 classes that were moved. Quite a number of those (hard to say
exactly how many) got new features, options, parameters.
* Operators: 204
* Transfers: 36
* Sensors: 46
* Hooks: 96
* Secrets: 4
The full list of the packages follows:
https://pypi.org/project/apache-airflow-backport-providers-amazon/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-cassandra/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-druid/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-hdfs/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-hive/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-livy/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-pig/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-pinot/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-spark/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-sqoop/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-celery/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-cloudant/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-databricks/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-datadog/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-dingding/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-discord/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-docker/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-elasticsearch/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-email/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-exasol/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-facebook/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-ftp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-google/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-grpc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-hashicorp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-http/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-imap/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jdbc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jenkins/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jira/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-azure/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-mssql/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-winrm/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-mongo/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-mysql/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-odbc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-openfaas/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-opsgenie/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-oracle/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-pagerduty/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-postgres/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-presto/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-qubole/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-redis/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-salesforce/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-samba/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-segment/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-sftp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-singularity/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-slack/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-snowflake/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-sqlite/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-ssh/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-vertica/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-yandex/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-zendesk/2020.6.24/
J.
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>
Fwd: Airflow Backport Provider Packages 2020.6.24 released
Posted by Jarek Potiuk <Ja...@polidea.com>.
Forwarding to the correct "announce" address :)
---------- Forwarded message ---------
From: Jarek Potiuk <Ja...@polidea.com>
Date: Wed, Jun 24, 2020 at 10:44 AM
Subject: Airflow Backport Provider Packages 2020.6.24 released
To: <us...@airflow.apache.org>
Cc: <de...@airflow.apache.org>, <an...@airflow.apache.org>
Hello Everyone,
I have a great pleasure to announce that we've just released the Airflow
Backport Provider packages version 2020.6.24.
This has been a true team-work from the community to make it happen. Many
people contributed to it! It originated with AIP-21 and I think the release
today concludes AIP-21 fully.
The Backport provider packages make it possible to easily use Airflow 2.0
Operators, Hooks, Sensors, Secrets, Transfers in Airflow 1.10. More stats
below, but the Backport Provider packages increase the number of
easily-available integrations for Airflow 1.10 users by a whopping *55%*.
It's an intermediate step to make migration to the future 2.0 version
easier. You should be able to use those operators in Airflow 1.10 in
parallel to existing operators, so you can do a gradual. incremental
migration. Later we will have an "upgrade-check" mechanism to help with the
migration process. This is also our way to find out if this is a good
idea to split Airflow 2.0 into separate packages as well - following AIP-8.
You can find more information here:
https://github.com/apache/airflow#backport-packages
I have a kind request - please - use those packages and let us know your
feedback.
This is the first official release of those packages. While it has been
extensively tested, there might be some teething problems. We have a way
now to release each package independently so we should be able to release
and fix some of the problems in much faster cadence than regular Airflow
releases.
Feel free to join the slack channel #backport-packages where you can raise
your questions, comments, issues:
https://apache-airflow.slack.com/archives/C0145R4NPS5
Some stats:
* We have *58* backport packages in total. *599* classes (Operators, Hooks,
Transfers, Sensors, Secrets)
* We have *213* new (!) classes that have not been easily available to 1.10
users so far:
* Operators: 150
* Transfers: 12
* Sensors: 14
* Hooks: 37
* Secrets: 0
* We have 386 classes that were moved. Quite a number of those (hard to say
exactly how many) got new features, options, parameters.
* Operators: 204
* Transfers: 36
* Sensors: 46
* Hooks: 96
* Secrets: 4
The full list of the packages follows:
https://pypi.org/project/apache-airflow-backport-providers-amazon/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-cassandra/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-druid/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-hdfs/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-hive/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-livy/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-pig/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-pinot/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-spark/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-sqoop/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-celery/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-cloudant/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-databricks/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-datadog/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-dingding/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-discord/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-docker/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-elasticsearch/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-email/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-exasol/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-facebook/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-ftp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-google/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-grpc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-hashicorp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-http/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-imap/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jdbc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jenkins/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jira/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-azure/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-mssql/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-winrm/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-mongo/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-mysql/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-odbc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-openfaas/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-opsgenie/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-oracle/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-pagerduty/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-postgres/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-presto/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-qubole/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-redis/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-salesforce/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-samba/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-segment/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-sftp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-singularity/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-slack/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-snowflake/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-sqlite/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-ssh/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-vertica/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-yandex/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-zendesk/2020.6.24/
J.
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>
Fwd: Airflow Backport Provider Packages 2020.6.24 released
Posted by Jarek Potiuk <Ja...@polidea.com>.
Forwarding to the correct "announce" address :)
---------- Forwarded message ---------
From: Jarek Potiuk <Ja...@polidea.com>
Date: Wed, Jun 24, 2020 at 10:44 AM
Subject: Airflow Backport Provider Packages 2020.6.24 released
To: <us...@airflow.apache.org>
Cc: <de...@airflow.apache.org>, <an...@airflow.apache.org>
Hello Everyone,
I have a great pleasure to announce that we've just released the Airflow
Backport Provider packages version 2020.6.24.
This has been a true team-work from the community to make it happen. Many
people contributed to it! It originated with AIP-21 and I think the release
today concludes AIP-21 fully.
The Backport provider packages make it possible to easily use Airflow 2.0
Operators, Hooks, Sensors, Secrets, Transfers in Airflow 1.10. More stats
below, but the Backport Provider packages increase the number of
easily-available integrations for Airflow 1.10 users by a whopping *55%*.
It's an intermediate step to make migration to the future 2.0 version
easier. You should be able to use those operators in Airflow 1.10 in
parallel to existing operators, so you can do a gradual. incremental
migration. Later we will have an "upgrade-check" mechanism to help with the
migration process. This is also our way to find out if this is a good
idea to split Airflow 2.0 into separate packages as well - following AIP-8.
You can find more information here:
https://github.com/apache/airflow#backport-packages
I have a kind request - please - use those packages and let us know your
feedback.
This is the first official release of those packages. While it has been
extensively tested, there might be some teething problems. We have a way
now to release each package independently so we should be able to release
and fix some of the problems in much faster cadence than regular Airflow
releases.
Feel free to join the slack channel #backport-packages where you can raise
your questions, comments, issues:
https://apache-airflow.slack.com/archives/C0145R4NPS5
Some stats:
* We have *58* backport packages in total. *599* classes (Operators, Hooks,
Transfers, Sensors, Secrets)
* We have *213* new (!) classes that have not been easily available to 1.10
users so far:
* Operators: 150
* Transfers: 12
* Sensors: 14
* Hooks: 37
* Secrets: 0
* We have 386 classes that were moved. Quite a number of those (hard to say
exactly how many) got new features, options, parameters.
* Operators: 204
* Transfers: 36
* Sensors: 46
* Hooks: 96
* Secrets: 4
The full list of the packages follows:
https://pypi.org/project/apache-airflow-backport-providers-amazon/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-cassandra/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-druid/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-hdfs/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-hive/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-livy/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-pig/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-pinot/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-spark/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-apache-sqoop/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-celery/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-cloudant/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-databricks/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-datadog/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-dingding/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-discord/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-docker/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-elasticsearch/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-email/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-exasol/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-facebook/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-ftp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-google/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-grpc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-hashicorp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-http/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-imap/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jdbc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jenkins/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-jira/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-azure/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-mssql/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-microsoft-winrm/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-mongo/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-mysql/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-odbc/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-openfaas/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-opsgenie/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-oracle/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-pagerduty/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-postgres/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-presto/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-qubole/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-redis/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-salesforce/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-samba/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-segment/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-sftp/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-singularity/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-slack/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-snowflake/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-sqlite/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-ssh/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-vertica/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-yandex/2020.6.24/
https://pypi.org/project/apache-airflow-backport-providers-zendesk/2020.6.24/
J.
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>
--
Jarek Potiuk
Polidea <https://www.polidea.com/> | Principal Software Engineer
M: +48 660 796 129 <+48660796129>
[image: Polidea] <https://www.polidea.com/>