You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/07/06 08:32:11 UTC
[GitHub] [airflow] ephraimbuddy opened a new issue, #24863: Status of testing of Apache Airflow 2.3.3rc2
ephraimbuddy opened a new issue, #24863:
URL: https://github.com/apache/airflow/issues/24863
### Body
We have a kind request for all the contributors to the latest [Apache Airflow RC 2.3.3rc2](https://pypi.org/project/apache-airflow/2.3.3rc2/).
Could you please help us to test the RC versions of Airflow?
Please let us know in the comment if the issue is addressed in the latest RC.
- [ ] [Switch Markdown engine to markdown-it-py (#19702)](https://github.com/apache/airflow/pull/19702): @torbjornvatn @uranusjr
Linked issues:
- [Switch Markdown engine to markdown-it-py (#16435)](https://github.com/apache/airflow/issues/16435)
- [ ] [Fix StatD timing metric units (#21106)](https://github.com/apache/airflow/pull/21106): @viktorvia
Linked issues:
- [Some timing metrics are in seconds but reported as milliseconds (#20804)](https://github.com/apache/airflow/issues/20804)
- [ ] [Parse error for task added to multiple groups (#23071)](https://github.com/apache/airflow/pull/23071): @wolfier @uranusjr
Linked issues:
- [Using TaskGroup without context manager (Graph view visual bug) (#14864)](https://github.com/apache/airflow/issues/14864)
- [ ] [Check bag DAG schedule_interval match tiemtable (#23113)](https://github.com/apache/airflow/pull/23113): @sdebruyn @uranusjr
Linked issues:
- [Show DAG parse error if 'timetable' and 'schedule_interval' are set together (#23087)](https://github.com/apache/airflow/issues/23087)
- [ ] [Allow for LOGGING_LEVEL=DEBUG (#23360)](https://github.com/apache/airflow/pull/23360): @GApfel
- [ ] [Fix closing connection dbapi.get_pandas_df (#23452)](https://github.com/apache/airflow/pull/23452): @bauerfranz @hubert-pietron
Linked issues:
- [closing connection chunks in DbApiHook.get_pandas_df (#22947)](https://github.com/apache/airflow/issues/22947)
- [ ] [Fix permission issue for dag that has dot in name (#23510)](https://github.com/apache/airflow/pull/23510): @ephraimbuddy
- [ ] [ExternalTaskSensor respects soft_fail if the external task enters a failed_state (#23647)](https://github.com/apache/airflow/pull/23647): @alexbegg @argibbs
Linked issues:
- [ExternalTaskSensor should skip if soft_fail=True and external task in one of the failed_states (#19754)](https://github.com/apache/airflow/issues/19754)
- [ ] [Fix mapped task immutability after clear (#23667)](https://github.com/apache/airflow/pull/23667): @ephraimbuddy
- [ ] [Maintain grid view selection on filtering upstream (#23779)](https://github.com/apache/airflow/pull/23779): @bbovenzi
- [ ] [Add TaskInstance State 'REMOVED' to finished states and success states (#23797)](https://github.com/apache/airflow/pull/23797): @ephraimbuddy
- [ ] [Do not fail requeued TIs (#23846)](https://github.com/apache/airflow/pull/23846): @tanelk @malthe
Linked issues:
- [Race condition between Triggerer and Scheduler (#23824)](https://github.com/apache/airflow/issues/23824)
- [Fix race condition between triggerer and scheduler (#21316)](https://github.com/apache/airflow/pull/21316)
- [ ] [Remove special serde logic for mapped op_kwargs (#23860)](https://github.com/apache/airflow/pull/23860): @erdos2n @uranusjr
Linked issues:
- [Dynamic Task Mapping not working with op_kwargs in PythonOperator (#23833)](https://github.com/apache/airflow/issues/23833)
- [ ] [Grid fix details button truncated and small UI tweaks (#23934)](https://github.com/apache/airflow/pull/23934): @pierrejeambrun
- [ ] [Replace `use_task_execution_date` with `use_task_logical_date` (#23983)](https://github.com/apache/airflow/pull/23983): @eladkal
- [ ] [Drop Python 3.6 compatibility objects/modules (#24048)](https://github.com/apache/airflow/pull/24048): @Taragolis
- [ ] [Removing magic numbers from api_connecxion (#24050)](https://github.com/apache/airflow/pull/24050): @bernardocouto
- [ ] [Rename Permissions to Permission Pairs. (#24065)](https://github.com/apache/airflow/pull/24065): @gbonazzoli @jhtimmins @zachliu
Linked issues:
- [Random "duplicate key value violates unique constraint" errors when initializing the postgres database (#23512)](https://github.com/apache/airflow/issues/23512)
- [Airflow 2.3.1 - gunicorn keeps removing and adding Permission menu access on Permissions to role Admin (#23926)](https://github.com/apache/airflow/issues/23926)
- [ ] [Handle occasional deadlocks in trigger with retries (#24071)](https://github.com/apache/airflow/pull/24071): @potiuk @humit0
Linked issues:
- [Triggerer process die with DB Deadlock (#23639)](https://github.com/apache/airflow/issues/23639)
- [ ] [Reduce grid view API calls (#24083)](https://github.com/apache/airflow/pull/24083): @bbovenzi
- [ ] [Unify return_code interface for task runner (#24093)](https://github.com/apache/airflow/pull/24093): @pingzh
- [ ] [Do not support MSSQL less than v2017 in code (#24095)](https://github.com/apache/airflow/pull/24095): @ephraimbuddy
- [ ] [Refactor `DagRun.verify_integrity` (#24114)](https://github.com/apache/airflow/pull/24114): @ephraimbuddy
- [ ] [Don't crash scheduler if exec config has old k8s objects (#24117)](https://github.com/apache/airflow/pull/24117): @dstandish @patryk126p
Linked issues:
- [Airflow 2.3 scheduler error: 'V1Container' object has no attribute '_startup_probe' (#23727)](https://github.com/apache/airflow/issues/23727)
- [ ] [Fix useTasks crash on error (#24152)](https://github.com/apache/airflow/pull/24152): @bbovenzi
- [ ] [Apply per-run log templates to log handlers (#24153)](https://github.com/apache/airflow/pull/24153): @uranusjr
- [ ] [Prevent dag dependencies page from crashing (#24166)](https://github.com/apache/airflow/pull/24166): @bbovenzi
- [ ] [Update 'rich' to latest version across the board. (#24186)](https://github.com/apache/airflow/pull/24186): @potiuk
- [ ] [ScheduleInterval nullable true added in openapi spec (#24253)](https://github.com/apache/airflow/pull/24253): @Bowrna @omarsmak
Linked issues:
- [ScheduleInterval schema in OpenAPI specs should have "nullable: true" otherwise generated OpenAPI client will throw an error in case of nullable "schedule_interval" (#22358)](https://github.com/apache/airflow/issues/22358)
- [ ] [Use `get_hostname` instead of `socket.getfqdn` (#24260)](https://github.com/apache/airflow/pull/24260): @jedcunningham
- [ ] [Optimize calendar view for cron scheduled DAGs (#24262)](https://github.com/apache/airflow/pull/24262): @jedcunningham @potiuk
Linked issues:
- [Calendar view is taking too long to load in airflow 2.3.0 (#23602)](https://github.com/apache/airflow/issues/23602)
- [ ] [Speed up grid_data endpoint by 10x (#24284)](https://github.com/apache/airflow/pull/24284): @ashb
- [ ] [Fix bugs in URI constructor for MySQL connection (#24320)](https://github.com/apache/airflow/pull/24320): @MaksYermak
- [ ] [Check for run_id for grid task groups (#24327)](https://github.com/apache/airflow/pull/24327): @bbovenzi @jedcunningham
Linked issues:
- [Fix and speed up grid view (#23947)](https://github.com/apache/airflow/pull/23947)
- [Grid data: do not load all mapped instances (#23813)](https://github.com/apache/airflow/pull/23813)
- [ ] [`TI.log_url` fix for `map_index` (#24335)](https://github.com/apache/airflow/pull/24335): @fritz-astronomer
Linked issues:
- [`TI.log_url` is incorrect with mapped tasks (#24328)](https://github.com/apache/airflow/issues/24328)
- [ ] [Add typescript (#24337)](https://github.com/apache/airflow/pull/24337): @bbovenzi
- [ ] [DebugExecutor use ti.run() instead of ti._run_raw_task (#24357)](https://github.com/apache/airflow/pull/24357): @o-nikolas @sarvothaman
Linked issues:
- [Backfill crashes with "KeyError: TaskInstanceKey" when task has retries (#13322)](https://github.com/apache/airflow/issues/13322)
- [ ] [Mask secrets in stdout for CLI command (#24362)](https://github.com/apache/airflow/pull/24362): @alex-astronomer @marclamberti @uranusjr
Linked issues:
- [Mask secrets in stdout for `airflow tasks test ...` CLI command (#17476) (#21281)](https://github.com/apache/airflow/pull/21281)
- [Sensitive variables don't get masked when rendered with airflow tasks test (#17476)](https://github.com/apache/airflow/issues/17476)
- [ ] [Add tests for the grid_data endpoint (#24375)](https://github.com/apache/airflow/pull/24375): @ashb
- [ ] [Fix links to sources for examples (#24386)](https://github.com/apache/airflow/pull/24386): @potiuk
- [ ] [Upgrade FAB to 4.1.1 (#24399)](https://github.com/apache/airflow/pull/24399): @potiuk
- [ ] [Fix flaky order of returned dag runs (#24405)](https://github.com/apache/airflow/pull/24405): @potiuk
- [ ] [Improve grid rendering performance with a custom tooltip (#24417)](https://github.com/apache/airflow/pull/24417): @bbovenzi
- [ ] [Upgrade to react 18 and chakra 2 (#24430)](https://github.com/apache/airflow/pull/24430): @bbovenzi
- [ ] [Remove framer-motion from custom tooltip (#24449)](https://github.com/apache/airflow/pull/24449): @bbovenzi
- [ ] [Add missing types to FSHook (#24470)](https://github.com/apache/airflow/pull/24470): @lmarvaud
- [ ] [Return empty dict if Pod JSON encoding fails (#24478)](https://github.com/apache/airflow/pull/24478): @dstandish
- [ ] [Upgrade to webpack 5 (#24485)](https://github.com/apache/airflow/pull/24485): @bbovenzi
- [ ] [Add indexes for CASCADE deletes for task_instance (#24488)](https://github.com/apache/airflow/pull/24488): @wolfier @dstandish
Linked issues:
- [`airflow db clean task_instance` takes a long time (#24484)](https://github.com/apache/airflow/issues/24484)
- [ ] [Remove internet explorer support (#24495)](https://github.com/apache/airflow/pull/24495): @bbovenzi
- [ ] [Add cache_ok flag to sqlalchemy TypeDecorators. (#24499)](https://github.com/apache/airflow/pull/24499): @jkinkead @NK74
Linked issues:
- [SAWarning: TypeDecorator UtcDateTime(timezone=True) will not produce a cache key because the ``cache_ok`` attribute is not set to True (#22647)](https://github.com/apache/airflow/issues/22647)
- [ ] [Fix toast messages (#24505)](https://github.com/apache/airflow/pull/24505): @bbovenzi
- [ ] [Fix deprecated log_id_template value (#24506)](https://github.com/apache/airflow/pull/24506): @jedcunningham
- [ ] [Migrate jsx files that affect run/task selection to tsx (#24509)](https://github.com/apache/airflow/pull/24509): @bbovenzi
- [ ] [Seed log_template table (#24511)](https://github.com/apache/airflow/pull/24511): @jedcunningham
- [ ] [Update flask-appbuilder authlib/oauth dependency (#24516)](https://github.com/apache/airflow/pull/24516): @potiuk
- [ ] [Get rid of TimedJSONWebSignatureSerializer (#24519)](https://github.com/apache/airflow/pull/24519): @potiuk
Linked issues:
- [Upgrade to FlaskAppBuilder 4.0.* (#22397)](https://github.com/apache/airflow/issues/22397)
- [ ] [Do not calculate grid root instances (#24528)](https://github.com/apache/airflow/pull/24528): @bbovenzi
- [ ] [Patch sql_alchemy_conn if old Postgres schemes used (#24569)](https://github.com/apache/airflow/pull/24569): @dstandish @slyapustin
Linked issues:
- [Patch sql_alchemy_conn if old postgres scheme used (#22333)](https://github.com/apache/airflow/pull/22333)
- [ ] [Fix migration 0080_2_0_2 - Replace null values before setting column not null (#24585)](https://github.com/apache/airflow/pull/24585): @tm-drtina @ephraimbuddy
Linked issues:
- [Support generating SQL script for upgrades (#20962)](https://github.com/apache/airflow/pull/20962)
- [Migration changes column to NOT NULL without updating NULL data first (#24566)](https://github.com/apache/airflow/issues/24566)
- [ ] [Move fallible ti.task.dag assignment back inside try/except block (#24533) (#24592)](https://github.com/apache/airflow/pull/24592): @ejk43
Linked issues:
- [es_task_handler.py crashes accessing "View Logs in Elasticsearch" (#24533)](https://github.com/apache/airflow/issues/24533)
- [ ] [Upgrade FAB to 4.1.2 (#24619)](https://github.com/apache/airflow/pull/24619): @potiuk
- [ ] [We now need at least Flask-WTF 0.15 (#24621)](https://github.com/apache/airflow/pull/24621): @ashb @potiuk
Linked issues:
- [Upgrade FAB to 4.1.1 (#24399)](https://github.com/apache/airflow/pull/24399)
- [ ] [Don't render child rows for closed groups (#24637)](https://github.com/apache/airflow/pull/24637): @bbovenzi
- [ ] [Fix timestamp defaults for sensorinstance (#24638)](https://github.com/apache/airflow/pull/24638): @dstandish
- [ ] [Fix Grid vertical scrolling (#24684)](https://github.com/apache/airflow/pull/24684): @bbovenzi
- [ ] [Debounce status highlighting in Grid view (#24710)](https://github.com/apache/airflow/pull/24710): @bbovenzi
- [ ] [Address all yarn test warnings (#24722)](https://github.com/apache/airflow/pull/24722): @bbovenzi
- [ ] [Fix grid date ticks (#24738)](https://github.com/apache/airflow/pull/24738): @bbovenzi
Linked issues:
- [Fix Grid vertical scrolling (#24684)](https://github.com/apache/airflow/pull/24684)
- [ ] [Remove upper-binding for SQLAlchemy (#24819)](https://github.com/apache/airflow/pull/24819): @potiuk
- [ ] [Fix cycle bug with attaching label to task group (#24847)](https://github.com/apache/airflow/pull/24847): @ashb @rustikk
Linked issues:
- [Applying labels to task groups shows a cycle in the graph view for the dag (#19785)](https://github.com/apache/airflow/issues/19785)
- [ ] [improve grid date tick spacing (#24849)](https://github.com/apache/airflow/pull/24849): @bbovenzi
Thanks to all who contributed to the release (probably not a complete list!):
@bbovenzi @slyapustin @ejk43 @marclamberti @tanelk @jhtimmins @bernardocouto @gbonazzoli @potiuk @wolfier @torbjornvatn @hubert-pietron @GApfel @malthe @rustikk @Bowrna @ephraimbuddy @fritz-astronomer @omarsmak @jedcunningham @NK74 @sdebruyn @sarvothaman @ashb @eladkal @jkinkead @patryk126p @bauerfranz @alex-astronomer @uranusjr @argibbs @tm-drtina @erdos2n @humit0 @zachliu @pierrejeambrun @o-nikolas @lmarvaud @Taragolis @dstandish @alexbegg @pingzh @viktorvia @MaksYermak
### Committer
- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ejk43 commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
ejk43 commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1178088291
A quick note on issue https://github.com/apache/airflow/issues/24533
I believe the relevant change (https://github.com/apache/airflow/pull/24592) would be packaged as part of apache-airflow-providers-elasticsearch, not apache-airflow 2.3.3rc3 -- so I dont think this is actually solved with the 2.3.3rc3 release. May need a bump to apache-airflow-providers-elasticsearch?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1178102002
> I believe the relevant change (#24592) would be packaged as part of apache-airflow-providers-elasticsearch, not apache-airflow 2.3.3rc3 -- so I dont think this is actually solved with the 2.3.3rc3 release. May need a bump to apache-airflow-providers-elasticsearch?
I think this was fix in both "core" and "es provider" - but the way it is implemented, does not require both sides to be fixed they are rather independent. So ES provider (when released) will fix the second part of the problem independently.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] zoid-w commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
zoid-w commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1177291917
#23833 is addressed by #23860 tested/verified on :
- 2.3.3rc2-python3.10
- 2.3.3rc3-python3.10
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ephraimbuddy closed issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
ephraimbuddy closed issue #24863: Status of testing of Apache Airflow 2.3.3rc3
URL: https://github.com/apache/airflow/issues/24863
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] phanikumv commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
phanikumv commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1177306704
Tested that airflow example_python_operator DAG runs successfully after bringing up airflow using 2.3.3rc3 image. Though this isn't related any of the fixes above, it ensured that the image is stable.
cc @kaxil
<img width="955" alt="image" src="https://user-images.githubusercontent.com/94376113/177740243-f49e1ad0-5591-4ad3-b4ad-56602490d171.png">
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] raphaelauv commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
raphaelauv commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1177891268
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] tronlightracer commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
tronlightracer commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1176823026
I'm looking over all of these and will write some tests for what I'm able to. Thanks @ephraimbuddy for consolidating these issues.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] ephraimbuddy commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
ephraimbuddy commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1179587003
Airflow 2.3.3 has been released. Thank you all for testing this release
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc3
Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1178364736
I tested most of my stuff (marked is as ok). There is PR #24071 where It's hard to reproduce the problem as it was occasional deadlock so I asked the users who raised it in #23639 to help to test it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] GApfel commented on issue #24863: Status of testing of Apache Airflow 2.3.3rc2
Posted by GitBox <gi...@apache.org>.
GApfel commented on issue #24863:
URL: https://github.com/apache/airflow/issues/24863#issuecomment-1176087436
#23360 is addressed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org