You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by ka...@apache.org on 2021/09/20 15:05:26 UTC
[airflow] branch aip-39-docs updated (08c1f51 -> 07d1b1f)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch aip-39-docs
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard 08c1f51 Replace ti.xcom_pull() in extra link example
discard c08db80 Wording tweak
discard 441188d Remove logical date reference in DAG concept
discard da01d3b Don't use dag_maker in Best Practice docs
discard e9f3203 Use run_id in Elasticsearch log ID template
discard bf828a0 Typos and wording/styling tweaks
discard 33d85e4 Inline the example custom timetable DAG
discard 52c378a Fix example DAG
discard 2f30ec0 Make the run_after description a bit vague
discard b3cf323 Fix Elastic tests depending on private function
discard ae098ec Revert TI.xcom_pull() usage
discard c75de69 Fix sentry tests to account for additional tags
discard efb28ee Fix example
discard 3cbbaca More typos
discard 8789110 Airflow's CI is American
discard 74a4d13 Remove execution date reference in docs
discard 12a0042 Rewrite example with new last_automated_dagrun
discard 90ed84a Fix imports in example DAG
discard 25cbd6f Typos
discard 8977cf9 Document timetable registration via plugin
discard 645d3b4 Mention data interval and add timetable how-to
add 9a63bf2 Graceful scheduler shutdown on error (#18092)
add 7b1196b Fix kinesis test (#18337)
add bfe7726 Added more automation on latest version (#18335)
add 87e9865 Fix breeze failing breeze on missing docker config (#18330)
add d9c0e15 Dag bulk_sync_to_db dag_tag only remove not exists (#8231)
add 410e6d7 Initial commit (#18203)
add a54f8d6 Remove 2017-latest from supported MSSQL versions (#18345)
add 7458f1e Remove check for at least one schema in GCSToBigquery (#18150)
add 50e2e6e Explain sentry default environment variable for subprocess hook (#18346)
add 27088c4 Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)
add 4cd190c ECSOperator realtime logging (#17626)
add 2b62a75 fix get_connections deprecation warning in webhdfs hook (#18331)
add dcfa14d add sla_miss_callback section to the documentation (#18305)
add dc94ee2 Improve coverage for airflow.security.kerberos module (#18258)
add e81f14b Deactivating DAGs which have been removed from files (#17121)
add e25eea0 Inclusive Language (#18349)
add 94749b0 Do not display resource statistics during parallell jobs (#18344)
add c0fbe3a Fix broken static check on main (#18351)
add c56ce29 Chart: Update the default Airflow version to ``2.1.4`` (#18354)
add 59b3c5c Doc: Fix broken ``asc`` download link (#18350)
add e5b6f36 Fix links in releasing guide (#18352)
add 7d0df1f Update version added field in config after 2.1.4 release (#18355)
add 7e7304e Add Changelog and other 2.1.4 details (#18353)
add 11e3453 Creating ADF pipeline run operator, sensor + ADF custom conn fields (#17885)
add 14b3e66 Improve coverage for airflow.cli package (#18220)
add 1008d8b Set default branch in codecov.yml (#18361)
add f382a79 Add support for templated fields in PapermillOperator (#18357)
add f76eaec Fix random deadlocks in MSSQL database (#18362)
add c538dd8 Mention data interval and add timetable how-to
add 04bde8a Document timetable registration via plugin
add 37cd4fd Typos
add a7c6fdc Fix imports in example DAG
add 2ecc8d5 Rewrite example with new last_automated_dagrun
add 2640500 Remove execution date reference in docs
add d9be910 Airflow's CI is American
add 4089e7b More typos
add 9080c75 Fix example
add 4edaaa8 Fix sentry tests to account for additional tags
add 77ddc36 Revert TI.xcom_pull() usage
add 0d68aa0 Fix Elastic tests depending on private function
add 67a35e5 Make the run_after description a bit vague
add 087a498 Fix example DAG
add 93e6782 Inline the example custom timetable DAG
add 53d0b4a Typos and wording/styling tweaks
add dcce6c8 Use run_id in Elasticsearch log ID template
add 1555a7f Don't use dag_maker in Best Practice docs
add 834ec82 Remove logical date reference in DAG concept
add 11cd2f1 Wording tweak
add 07d1b1f Replace ti.xcom_pull() in extra link example
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (08c1f51)
\
N -- N -- N refs/heads/aip-39-docs (07d1b1f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 3 +-
.../airflow_helmchart_bug_report.yml | 3 +-
.../airflow_providers_bug_report.yml | 3 +-
.github/workflows/ci.yml | 21 +
.pre-commit-config.yaml | 6 +
BREEZE.rst | 2 +-
CHANGELOG.txt | 49 ++
COMMITTERS.rst | 2 +-
README.md | 14 +-
STATIC_CODE_CHECKS.rst | 2 +-
UPDATING.md | 5 +
airflow/cli/commands/celery_command.py | 18 +-
airflow/cli/commands/scheduler_command.py | 24 +-
airflow/config_templates/config.yml | 2 +-
airflow/dag_processing/processor.py | 14 +-
airflow/hooks/subprocess.py | 3 +
airflow/models/dag.py | 20 +-
airflow/models/serialized_dag.py | 2 +-
.../example_emr_job_flow_automatic_steps.py | 2 +-
.../example_emr_job_flow_manual_steps.py | 2 +-
airflow/providers/amazon/aws/operators/ecs.py | 142 +++-
.../amazon/aws/transfers/redshift_to_s3.py | 14 +-
.../amazon/aws/transfers/s3_to_redshift.py | 15 +-
airflow/providers/apache/hdfs/hooks/webhdfs.py | 35 +-
.../google/cloud/hooks/cloud_memorystore.py | 2 +-
.../google/cloud/operators/cloud_memorystore.py | 2 +-
.../providers/google/cloud/operators/dataproc.py | 6 +-
.../google/cloud/transfers/gcs_to_bigquery.py | 5 -
.../azure/example_dags/example_adf_run_pipeline.py | 69 ++
airflow/providers/microsoft/azure/hooks/adx.py | 79 +--
.../microsoft/azure/hooks/azure_data_factory.py | 771 +--------------------
.../{azure_data_factory.py => data_factory.py} | 162 +++--
.../microsoft/azure/operators/data_factory.py | 174 +++++
airflow/providers/microsoft/azure/provider.yaml | 13 +-
.../microsoft/azure/sensors/data_factory.py | 75 ++
airflow/providers/papermill/operators/papermill.py | 7 +-
.../yandex/operators/yandexcloud_dataproc.py | 2 +-
airflow/providers_manager.py | 4 +-
airflow/security/kerberos.py | 16 +-
airflow/settings.py | 30 +-
airflow/utils/db.py | 2 +-
airflow/utils/process_utils.py | 17 +-
breeze-complete | 1 +
chart/Chart.yaml | 2 +-
chart/UPDATING.rst | 4 +-
chart/values.schema.json | 4 +-
chart/values.yaml | 4 +-
codecov.yml | 1 +
dev/README_RELEASE_AIRFLOW.md | 7 +-
dev/provider_packages/prepare_provider_packages.py | 1 +
.../operators/cloud/dataproc.rst | 2 +-
.../connections/adf.rst | 30 +-
.../operators/adf_run_pipeline.rst | 57 ++
docs/apache-airflow/concepts/dags.rst | 2 +
docs/apache-airflow/concepts/tasks.rst | 48 +-
docs/apache-airflow/howto/set-up-database.rst | 24 +-
.../installation/installing-from-sources.rst | 2 +-
docs/apache-airflow/logging-monitoring/errors.rst | 21 +
.../extending/add-apt-packages/Dockerfile | 2 +-
.../add-build-essential-extend/Dockerfile | 2 +-
.../extending/add-providers/Dockerfile | 2 +-
.../extending/add-pypi-packages/Dockerfile | 2 +-
.../extending/embedding-dags/Dockerfile | 2 +-
.../extending/writable-directory/Dockerfile | 2 +-
.../restricted/restricted_environments.sh | 4 +-
docs/docker-stack/entrypoint.rst | 50 +-
scripts/ci/docker-compose/backend-mssql.yml | 17 +-
.../ci/docker-compose/mssql_create_airflow_db.sql | 3 +-
scripts/ci/images/ci_run_prod_image_test.sh | 8 +-
scripts/ci/libraries/_build_images.sh | 15 +-
scripts/ci/libraries/_parallel.sh | 9 +-
.../ci/pre_commit/pre_commit_update_versions.py | 61 ++
scripts/docker/install_airflow.sh | 2 +-
scripts/in_container/bin/install_aws.sh | 2 +-
scripts/in_container/bin/install_az.sh | 2 +-
scripts/in_container/bin/install_gcloud.sh | 2 +-
scripts/in_container/bin/install_imgcat.sh | 2 +-
scripts/in_container/bin/install_java.sh | 2 +-
scripts/in_container/bin/install_kubectl.sh | 2 +-
scripts/in_container/bin/install_terraform.sh | 2 +-
setup.py | 2 +-
tests/cli/commands/test_celery_command.py | 145 ++++
tests/cli/commands/test_kerberos_command.py | 102 +++
tests/cli/commands/test_plugins_command.py | 20 +
.../cli/commands/test_rotate_fernet_key_command.py | 113 +++
tests/cli/commands/test_scheduler_command.py | 17 +
tests/core/test_providers_manager.py | 2 +-
tests/core/test_sentry.py | 2 +-
tests/core/test_sqlalchemy_config.py | 2 +-
tests/dag_processing/test_processor.py | 57 +-
tests/models/test_dagbag.py | 8 +-
tests/models/test_dagrun.py | 2 +-
tests/providers/amazon/aws/hooks/test_kinesis.py | 21 +-
tests/providers/amazon/aws/operators/test_ecs.py | 177 ++++-
.../amazon/aws/transfers/test_redshift_to_s3.py | 83 +++
.../amazon/aws/transfers/test_s3_to_redshift.py | 103 ++-
tests/providers/apache/hdfs/hooks/test_webhdfs.py | 59 +-
tests/providers/microsoft/azure/hooks/test_adx.py | 30 +-
.../azure/hooks/test_azure_data_factory.py | 60 +-
.../azure/operators/test_azure_data_factory.py | 177 +++++
.../azure/sensors/test_azure_data_factory.py | 76 ++
.../papermill/operators/test_papermill.py | 24 +
tests/security/test_kerberos.py | 256 ++++++-
tests/www/views/test_views_home.py | 5 +-
104 files changed, 2603 insertions(+), 1184 deletions(-)
create mode 100644 airflow/providers/microsoft/azure/example_dags/example_adf_run_pipeline.py
copy airflow/providers/microsoft/azure/hooks/{azure_data_factory.py => data_factory.py} (84%)
create mode 100644 airflow/providers/microsoft/azure/operators/data_factory.py
create mode 100644 airflow/providers/microsoft/azure/sensors/data_factory.py
create mode 100644 docs/apache-airflow-providers-microsoft-azure/operators/adf_run_pipeline.rst
copy airflow/providers/google/cloud/example_dags/example_bigquery_query.sql => scripts/ci/docker-compose/mssql_create_airflow_db.sql (90%)
create mode 100755 scripts/ci/pre_commit/pre_commit_update_versions.py
create mode 100644 tests/cli/commands/test_kerberos_command.py
create mode 100644 tests/cli/commands/test_rotate_fernet_key_command.py
create mode 100644 tests/providers/microsoft/azure/operators/test_azure_data_factory.py
create mode 100644 tests/providers/microsoft/azure/sensors/test_azure_data_factory.py