You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by bb...@apache.org on 2022/03/31 19:07:59 UTC
[airflow] branch mapped-task-drawer updated (cca23ed -> 4754c83)
This is an automated email from the ASF dual-hosted git repository.
bbovenzi pushed a change to branch mapped-task-drawer
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard cca23ed Fix url params, hide last item breadcrumb links
discard 5abd094 init_api_connexion in tests
discard 0cf72be Fix undefined variables in tests
discard ae60914 Split TaskInstance details component
discard 0a499de Update filter upstream link
discard 8903144 Replace hard coded urls in react components
discard 4fafbd6 Replace hard coded urls
discard 4e5cd39 Fix argument count errors
discard 98038a0 Anticipate when the 'Accept' header is not present
discard c95e3cd remove request as arg
discard 0f0227b pass request as arg
discard dfef296 Clean up views.py endpoints
discard cdfa956 Handle task/run action sideeffects by separating autorefresh and treeData hooks
discard 6efcd8c Address PR feedback
discard 063cfc3 revert useTreeData changes
discard 767ddb4 auto-refresh task instance details
discard 5019652 autorefresh dag run details
discard fcd4a8d Improve button UX
discard 6c89b28 Fix TimezoneEvent import
discard dd17874 Add timezone provider
discard a6113c5 Fix task/run label, dialog focus, dag details overflow, panel open/close
discard 4e29eec Code cleanup and fix task clear
discard e9c8dcb Fix dialog scrolling
discard 9495a67 Update confirm modals for runs and tasks
discard 0843a2a confirm mark task failed/success
discard 841f86d fix extra links, hide local TZ if UTC,
discard dfd56e6 download log bug fixes
discard 54c86e7 add extra links to TI details
discard 255dbd9 download logs and external logs
discard bb7471e update TI and DR buttons
discard e194390 fix test with mock providers
discard 53e19e5 move ref and selection to providers
discard 7434502 make UI and tree work with mapped tasks
add 91c958d Fix failing exec in Breeze (#22623)
add 143702e Fix /rendered-templates for mapped operator (#22396)
add 7e0e7c7 Rewrite ti.xcom_pull() to consider map indexes (#22609)
add 347e202 Bump black version for other pre-commit hooks (#22599)
add 97cf769 Fix: Add extra headers to all livy API requests instead of only to post_batch (#22510)
add c25ee43 Use "terminate-instances" instead of "stop-instances" (#22636)
add 88165b3 Do not log the hook connection details even at DEBUG level (#22627)
add 55ee62e Add doc for LocalFilesystemToS3Operator (#22574)
add 9798c8c Add more fields to REST API get DAG(dags/dag_id) endpoint (#22637)
add dae5640 Set `webhook_endpoint` as templated field in `DiscordWebhookOperator`(#22570)
add 25b62a7 Further improves image caching for Breeze (#22625)
add 7ca4e93 Add API endpoint to list mapped task instances (#22341)
add a089861 Better description for UPGRADE_TO_NEWER_DEPENDENCIES parameter (#22644)
add b081198 adding check system test in breeze2 (#22645)
add 52a91aa removed unnecessary dependence on bcrypt (#22498)
add 730b426 Only hide rendered button for mapped summaries (#22633)
add f414167 Fix passing string to upgrade-to-newer-dependencies (#22649)
add 27d72d7 If k8s is not installed, add if condition to exclude DAG(local_kubernetes_executor) (#22556)
add e97953a Make sure build-prod-image works in the new Breeze2 (#22660)
add becbb4a Fixing task status for non-running and non-committed tasks (#22410)
add 616a5dd Add doc and sample dag for MongoToS3Operator (#22575)
add 1b12c93 Refactor `DatabricksJobRunLink` to not create ad hoc TaskInstances (#22571)
add 8d3c6c5 Fixes ScheduleInterval spec (#22635)
add 327eab3 Add links for BigQuery Data Transfer (#22280)
add 515cbd4 make UI and tree work with mapped tasks
add 8d46de9 move ref and selection to providers
add 4fe13dc fix test with mock providers
add 987ea5a update TI and DR buttons
add 1fade13 download logs and external logs
add 57f3142 add extra links to TI details
add a75d80e download log bug fixes
add dfb5b17 fix extra links, hide local TZ if UTC,
add 790e6b8 confirm mark task failed/success
add f7d97f4 Update confirm modals for runs and tasks
add a6c4fe5 Fix dialog scrolling
add d083769 Code cleanup and fix task clear
add 03c0bdc Fix task/run label, dialog focus, dag details overflow, panel open/close
add 5a07b8d Add timezone provider
add 4180ca4 Fix TimezoneEvent import
add 74d8b03 Improve button UX
add 856d3f4 autorefresh dag run details
add 9c24468 auto-refresh task instance details
add c714872 revert useTreeData changes
add 2739675 Address PR feedback
add 2ddb476 Handle task/run action sideeffects by separating autorefresh and treeData hooks
add 5c96a85 Clean up views.py endpoints
add f73374b pass request as arg
add c44271c remove request as arg
add 5328eaf Anticipate when the 'Accept' header is not present
add b5e727d Fix argument count errors
add 62047b9 Replace hard coded urls
add 78ec306 Replace hard coded urls in react components
add d65aeb3 Update filter upstream link
add 136a4f4 Split TaskInstance details component
add a8fd594 Fix undefined variables in tests
add 76a5642 init_api_connexion in tests
add 8654787 Fix url params, hide last item breadcrumb links
add 4754c83 Update task run failed copy
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (cca23ed)
\
N -- N -- N refs/heads/mapped-task-drawer (4754c83)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.pre-commit-config.yaml | 8 +-
Dockerfile | 32 +-
Dockerfile.ci | 42 ++-
IMAGES.rst | 8 +-
airflow/api/common/mark_tasks.py | 15 +-
.../endpoints/task_instance_endpoint.py | 112 ++++++
airflow/api_connexion/openapi/v1.yaml | 174 ++++++++-
airflow/api_connexion/schemas/dag_schema.py | 15 +
airflow/decorators/base.py | 1 +
.../example_dags/example_kubernetes_executor.py | 1 +
.../example_local_kubernetes_executor.py | 52 +--
airflow/hooks/base.py | 12 -
airflow/models/abstractoperator.py | 2 +-
airflow/models/baseoperator.py | 30 +-
airflow/models/dag.py | 2 +-
airflow/models/mappedoperator.py | 31 +-
airflow/models/taskinstance.py | 162 +++++---
airflow/models/xcom.py | 6 +-
.../amazon/aws/example_dags/example_local_to_s3.py | 5 +-
...example_ftp_to_s3.py => example_mongo_to_s3.py} | 22 +-
.../providers/amazon/aws/transfers/local_to_s3.py | 4 +
.../providers/amazon/aws/transfers/mongo_to_s3.py | 4 +
airflow/providers/amazon/provider.yaml | 2 +
airflow/providers/apache/livy/hooks/livy.py | 14 +-
.../providers/databricks/operators/databricks.py | 23 +-
.../providers/discord/operators/discord_webhook.py | 4 +-
.../cloud/links/{dataflow.py => bigquery_dts.py} | 32 +-
.../google/cloud/operators/bigquery_dts.py | 28 ++
.../providers/google/cloud/sensors/bigquery_dts.py | 4 +
airflow/providers/google/provider.yaml | 1 +
airflow/serialization/serialized_objects.py | 63 ++--
airflow/utils/db.py | 2 +-
airflow/www/static/js/dag.js | 4 +-
.../tree/details/content/dagRun/MarkFailedRun.jsx | 2 +-
airflow/www/views.py | 18 +-
breeze | 11 +-
chart/dockerfiles/pgbouncer/Dockerfile | 2 +-
dev/breeze/src/airflow_breeze/breeze.py | 8 +-
dev/breeze/src/airflow_breeze/ci/build_image.py | 8 +
dev/breeze/src/airflow_breeze/ci/build_params.py | 9 +-
dev/breeze/src/airflow_breeze/global_constants.py | 1 +
.../src/airflow_breeze/prod/build_prod_image.py | 9 +-
dev/breeze/src/airflow_breeze/prod/prod_params.py | 15 +-
dev/breeze/src/airflow_breeze/shell/enter_shell.py | 2 +
dev/breeze/src/airflow_breeze/utils/run_utils.py | 16 +
dev/breeze/tests/test_prod_image.py | 2 +-
.../operators/transfer/dynamodb_to_s3.rst | 4 +-
.../operators/transfer/google_api_to_s3.rst | 4 +-
.../operators/transfer/imap_attachment_to_s3.rst | 4 +-
.../transfer/{ftp_to_s3.rst => local_to_s3.rst} | 23 +-
.../transfer/{ftp_to_s3.rst => mongo_to_s3.rst} | 27 +-
.../operators/transfer/redshift_to_s3.rst | 4 +-
.../operators/transfer/s3_to_redshift.rst | 4 +-
.../operators/transfer/salesforce_to_s3.rst | 2 +-
docs/docker-stack/build-arg-ref.rst | 8 +-
scripts/ci/images/ci_stop_arm_instance.sh | 2 +-
scripts/ci/libraries/_build_images.sh | 48 +++
.../pre_commit_inline_scripts_in_docker.py | 2 +-
.../ci/pre_commit/pre_commit_lint_dockerfile.sh | 16 +-
scripts/ci/pre_commit/pre_commit_mypy.sh | 2 +-
scripts/docker/airflow-scheduler-autorestart.sh | 0
scripts/docker/clean-logs.sh | 0
scripts/docker/entrypoint_exec.sh | 4 +-
tests/api/common/test_mark_tasks.py | 30 +-
tests/api_connexion/endpoints/test_dag_endpoint.py | 295 +++++++++++++++
.../test_mapped_task_instance_endpoint.py | 419 +++++++++++++++------
.../endpoints/test_task_instance_endpoint.py | 9 +
tests/api_connexion/schemas/test_dag_schema.py | 48 +++
tests/models/test_taskinstance.py | 33 +-
.../google/cloud/operators/test_bigquery_dts.py | 4 +-
.../google/cloud/sensors/test_bigquery_dts.py | 6 +-
tests/serialization/test_dag_serialization.py | 24 +-
72 files changed, 1585 insertions(+), 457 deletions(-)
copy airflow/providers/amazon/aws/example_dags/{example_ftp_to_s3.py => example_mongo_to_s3.py} (62%)
copy airflow/providers/google/cloud/links/{dataflow.py => bigquery_dts.py} (57%)
copy docs/apache-airflow-providers-amazon/operators/transfer/{ftp_to_s3.rst => local_to_s3.rst} (69%)
copy docs/apache-airflow-providers-amazon/operators/transfer/{ftp_to_s3.rst => mongo_to_s3.rst} (57%)
mode change 100755 => 100644 scripts/docker/airflow-scheduler-autorestart.sh
mode change 100755 => 100644 scripts/docker/clean-logs.sh