You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/06/19 15:19:11 UTC
[GitHub] [airflow] shamoji-tech commented on issue #9410: gcs_task_handler.py does not write log to GCS bucket.
shamoji-tech commented on issue #9410:
URL: https://github.com/apache/airflow/issues/9410#issuecomment-646693292
this is the worker's log.
```
[root@universe-ml-core-cvr-training-workernode ~]# docker logs -tf core-cvr_worker_1
2020-06-19T13:49:13.836645173Z [2020-06-19 13:49:13,830] {settings.py:212} DEBUG - Setting up DB connection pool (PID 1)
2020-06-19T13:49:13.836683719Z [2020-06-19 13:49:13,831] {settings.py:253} DEBUG - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=1
2020-06-19T13:49:13.883590720Z [2020-06-19 13:49:13,879] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/__init__.py
2020-06-19T13:49:13.883623361Z [2020-06-19 13:49:13,880] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/evaluate.py
2020-06-19T13:49:14.929180992Z [2020-06-19 13:49:14,928] {dask_link.py:128} DEBUG - No module named 'dask'
2020-06-19T13:49:15.588659054Z /usr/local/lib/python3.7/site-packages/patsy/constraint.py:13: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:49:15.588691324Z from collections import Mapping
2020-06-19T13:49:15.880582543Z /usr/local/lib/python3.7/site-packages/tensorflow/python/util/nest.py:1287: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:49:15.880619514Z _pywrap_tensorflow.RegisterType("Sequence", _collections.Sequence)
2020-06-19T13:49:16.190622636Z /usr/local/lib/python3.7/site-packages/tensorflow/python/training/tracking/object_identity.py:112: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:49:16.190658552Z class ObjectIdentitySet(collections.MutableSet):
2020-06-19T13:49:17.397609315Z [2020-06-19 13:49:17,389] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/learning.py
2020-06-19T13:49:17.397643985Z [2020-06-19 13:49:17,391] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/model_push.py
2020-06-19T13:49:17.397648570Z [2020-06-19 13:49:17,393] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/__init__.py
2020-06-19T13:49:17.397652248Z [2020-06-19 13:49:17,393] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/data_dao.py
2020-06-19T13:49:17.397655731Z [2020-06-19 13:49:17,395] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_dao.py
2020-06-19T13:49:17.397659099Z [2020-06-19 13:49:17,397] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_flag_dao.py
2020-06-19T13:49:17.408597277Z [2020-06-19 13:49:17,398] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/__init__.py
2020-06-19T13:49:17.408615732Z [2020-06-19 13:49:17,398] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/mailer.py
2020-06-19T13:49:17.408620239Z [2020-06-19 13:49:17,399] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/tempfile.py
2020-06-19T13:49:17.408623941Z [2020-06-19 13:49:17,400] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/__init__.py
2020-06-19T13:49:17.408645917Z [2020-06-19 13:49:17,400] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_constructor.py
2020-06-19T13:49:17.408650027Z [2020-06-19 13:49:17,401] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_filterer.py
2020-06-19T13:49:17.408653569Z [2020-06-19 13:49:17,402] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/__init__.py
2020-06-19T13:49:17.408656835Z [2020-06-19 13:49:17,403] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/encoder.py
2020-06-19T13:49:17.408660231Z [2020-06-19 13:49:17,403] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/feature_embedding.py
2020-06-19T13:49:17.408663690Z [2020-06-19 13:49:17,405] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/key_classifier.py
2020-06-19T13:49:17.408667069Z [2020-06-19 13:49:17,407] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/metrics.py
2020-06-19T13:49:17.408670488Z [2020-06-19 13:49:17,408] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/__init__.py
2020-06-19T13:49:17.419580997Z [2020-06-19 13:49:17,408] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/entity_embedding.py
2020-06-19T13:49:17.560622986Z [2020-06-19 13:49:17,557] {cli_action_loggers.py:42} DEBUG - Adding <function default_action_log at 0x7f31a541d290> to pre execution callback
2020-06-19T13:49:17.786755013Z [2020-06-19 13:49:17,784] {cli_action_loggers.py:68} DEBUG - Calling callbacks: [<function default_action_log at 0x7f31a541d290>]
2020-06-19T13:49:18.344613991Z [2020-06-19 13:49:18,340: DEBUG/MainProcess] | Worker: Preparing bootsteps.
2020-06-19T13:49:18.365589986Z [2020-06-19 13:49:18,354: DEBUG/MainProcess] | Worker: Building graph...
2020-06-19T13:49:18.365610311Z [2020-06-19 13:49:18,355: DEBUG/MainProcess] | Worker: New boot order: {Beat, StateDB, Timer, Hub, Pool, Autoscaler, Consumer}
2020-06-19T13:49:18.463596770Z [2020-06-19 13:49:18,460: DEBUG/MainProcess] | Consumer: Preparing bootsteps.
2020-06-19T13:49:18.463620130Z [2020-06-19 13:49:18,460: DEBUG/MainProcess] | Consumer: Building graph...
2020-06-19T13:49:18.635613097Z [2020-06-19 13:49:18,632: DEBUG/MainProcess] | Consumer: New boot order: {Connection, Events, Heart, Mingle, Tasks, Control, Gossip, Agent, event loop}
2020-06-19T13:49:18.703602112Z [2020-06-19 13:49:18,700: DEBUG/MainProcess] | Worker: Starting Hub
2020-06-19T13:49:18.703634599Z [2020-06-19 13:49:18,700: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:18.703638879Z [2020-06-19 13:49:18,700: DEBUG/MainProcess] | Worker: Starting Pool
2020-06-19T13:49:19.610624124Z [2020-06-19 13:49:19,600] {settings.py:212} DEBUG - Setting up DB connection pool (PID 12)
2020-06-19T13:49:19.610660247Z [2020-06-19 13:49:19,607] {settings.py:253} DEBUG - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=12
2020-06-19T13:49:19.692620871Z [2020-06-19 13:49:19,691] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/__init__.py
2020-06-19T13:49:19.692660664Z [2020-06-19 13:49:19,691] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/evaluate.py
2020-06-19T13:49:21.160619636Z [2020-06-19 13:49:21,152] {dask_link.py:128} DEBUG - No module named 'dask'
2020-06-19T13:49:22.022624437Z /usr/local/lib/python3.7/site-packages/patsy/constraint.py:13: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:49:22.022658894Z from collections import Mapping
2020-06-19T13:49:22.644631191Z /usr/local/lib/python3.7/site-packages/tensorflow/python/util/nest.py:1287: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:49:22.644670509Z _pywrap_tensorflow.RegisterType("Sequence", _collections.Sequence)
2020-06-19T13:49:23.338626624Z /usr/local/lib/python3.7/site-packages/tensorflow/python/training/tracking/object_identity.py:112: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:49:23.338666451Z class ObjectIdentitySet(collections.MutableSet):
2020-06-19T13:49:23.865610043Z [2020-06-19 13:49:23,861: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:23.865646085Z [2020-06-19 13:49:23,862: DEBUG/MainProcess] | Worker: Starting Consumer
2020-06-19T13:49:23.865650232Z [2020-06-19 13:49:23,862: DEBUG/MainProcess] | Consumer: Starting Connection
2020-06-19T13:49:24.114595620Z [2020-06-19 13:49:24,110: INFO/MainProcess] Connected to redis://:**@airflow-masternode-stg.asia-northeast2-a.c.microad-system-development.internal:7001/1
2020-06-19T13:49:24.114630014Z [2020-06-19 13:49:24,111: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:24.114634641Z [2020-06-19 13:49:24,111: DEBUG/MainProcess] | Consumer: Starting Events
2020-06-19T13:49:24.172594327Z [2020-06-19 13:49:24,162: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:24.172620450Z [2020-06-19 13:49:24,162: DEBUG/MainProcess] | Consumer: Starting Heart
2020-06-19T13:49:24.211602623Z [2020-06-19 13:49:24,205: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:24.211628320Z [2020-06-19 13:49:24,205: DEBUG/MainProcess] | Consumer: Starting Mingle
2020-06-19T13:49:24.211643782Z [2020-06-19 13:49:24,205: INFO/MainProcess] mingle: searching for neighbors
2020-06-19T13:49:24.744617004Z [2020-06-19 13:49:24,742] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/learning.py
2020-06-19T13:49:24.755580622Z [2020-06-19 13:49:24,745] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/model_push.py
2020-06-19T13:49:24.755598070Z [2020-06-19 13:49:24,746] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/__init__.py
2020-06-19T13:49:24.755611022Z [2020-06-19 13:49:24,747] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/data_dao.py
2020-06-19T13:49:24.755623754Z [2020-06-19 13:49:24,748] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_dao.py
2020-06-19T13:49:24.755627315Z [2020-06-19 13:49:24,750] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_flag_dao.py
2020-06-19T13:49:24.755630613Z [2020-06-19 13:49:24,751] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/__init__.py
2020-06-19T13:49:24.755633933Z [2020-06-19 13:49:24,751] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/mailer.py
2020-06-19T13:49:24.755637161Z [2020-06-19 13:49:24,752] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/tempfile.py
2020-06-19T13:49:24.755640305Z [2020-06-19 13:49:24,753] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/__init__.py
2020-06-19T13:49:24.755643501Z [2020-06-19 13:49:24,753] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_constructor.py
2020-06-19T13:49:24.755646846Z [2020-06-19 13:49:24,754] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_filterer.py
2020-06-19T13:49:24.766572143Z [2020-06-19 13:49:24,756] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/__init__.py
2020-06-19T13:49:24.766587903Z [2020-06-19 13:49:24,756] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/encoder.py
2020-06-19T13:49:24.766592243Z [2020-06-19 13:49:24,757] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/feature_embedding.py
2020-06-19T13:49:24.766595768Z [2020-06-19 13:49:24,758] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/key_classifier.py
2020-06-19T13:49:24.766599232Z [2020-06-19 13:49:24,761] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/metrics.py
2020-06-19T13:49:24.766602711Z [2020-06-19 13:49:24,761] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/__init__.py
2020-06-19T13:49:24.766606196Z [2020-06-19 13:49:24,762] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/entity_embedding.py
2020-06-19T13:49:24.876610350Z [2020-06-19 13:49:24,871] {cli_action_loggers.py:42} DEBUG - Adding <function default_action_log at 0x7f361c7d28c0> to pre execution callback
2020-06-19T13:49:25.103303067Z [2020-06-19 13:49:25,100] {cli_action_loggers.py:68} DEBUG - Calling callbacks: [<function default_action_log at 0x7f361c7d28c0>]
2020-06-19T13:49:25.143607448Z Starting flask
2020-06-19T13:49:25.143642984Z * Serving Flask app "airflow.bin.cli" (lazy loading)
2020-06-19T13:49:25.143675612Z * Environment: production
2020-06-19T13:49:25.143679787Z WARNING: This is a development server. Do not use it in a production deployment.
2020-06-19T13:49:25.143683095Z Use a production WSGI server instead.
2020-06-19T13:49:25.143686156Z * Debug mode: off
2020-06-19T13:49:25.144564395Z [2020-06-19 13:49:25,144] {_internal.py:122} INFO - * Running on http://0.0.0.0:8793/ (Press CTRL+C to quit)
2020-06-19T13:49:25.340736043Z [2020-06-19 13:49:25,336: INFO/MainProcess] mingle: sync with 1 nodes
2020-06-19T13:49:25.340780381Z [2020-06-19 13:49:25,339: DEBUG/MainProcess] mingle: processing reply from celery@900e6b76425f
2020-06-19T13:49:25.340785520Z [2020-06-19 13:49:25,339: INFO/MainProcess] mingle: sync complete
2020-06-19T13:49:25.340789370Z [2020-06-19 13:49:25,339: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:25.340793023Z [2020-06-19 13:49:25,339: DEBUG/MainProcess] | Consumer: Starting Tasks
2020-06-19T13:49:25.346609746Z [2020-06-19 13:49:25,345: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:25.346627767Z [2020-06-19 13:49:25,345: DEBUG/MainProcess] | Consumer: Starting Control
2020-06-19T13:49:25.354271663Z [2020-06-19 13:49:25,353: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:25.354286461Z [2020-06-19 13:49:25,353: DEBUG/MainProcess] | Consumer: Starting Gossip
2020-06-19T13:49:25.362428312Z [2020-06-19 13:49:25,359: DEBUG/MainProcess] ^-- substep ok
2020-06-19T13:49:25.362442405Z [2020-06-19 13:49:25,359: DEBUG/MainProcess] | Consumer: Starting event loop
2020-06-19T13:49:25.362446749Z [2020-06-19 13:49:25,359: DEBUG/MainProcess] | Worker: Hub.register Pool...
2020-06-19T13:49:25.362450440Z [2020-06-19 13:49:25,360: INFO/MainProcess] celery@76e4eef48dd7 ready.
2020-06-19T13:49:25.362453701Z [2020-06-19 13:49:25,360: DEBUG/MainProcess] basic.qos: prefetch_count->8
2020-06-19T13:49:25.647084709Z [2020-06-19 13:49:25,646: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:49:25.647123597Z [2020-06-19 13:49:25,646: INFO/MainProcess] Events of group {task} enabled by remote.
2020-06-19T13:49:25.809207667Z [2020-06-19 13:49:25,808: DEBUG/MainProcess] celery@900e6b76425f joined the party
2020-06-19T13:49:30.646774795Z [2020-06-19 13:49:30,646: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:49:35.641381145Z [2020-06-19 13:49:35,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:49:40.641033020Z [2020-06-19 13:49:40,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:49:45.648628714Z [2020-06-19 13:49:45,648: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:49:50.640349925Z [2020-06-19 13:49:50,639: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:49:55.641643915Z [2020-06-19 13:49:55,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:00.643809298Z [2020-06-19 13:50:00,643: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:05.643526697Z [2020-06-19 13:50:05,642: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:10.641347171Z [2020-06-19 13:50:10,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:15.641603370Z [2020-06-19 13:50:15,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:20.642043471Z [2020-06-19 13:50:20,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:25.641917942Z [2020-06-19 13:50:25,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:30.640558733Z [2020-06-19 13:50:30,639: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:35.642328583Z [2020-06-19 13:50:35,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:40.646651621Z [2020-06-19 13:50:40,646: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:45.641884947Z [2020-06-19 13:50:45,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:50.650725495Z [2020-06-19 13:50:50,650: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:50:55.641812007Z [2020-06-19 13:50:55,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:00.641021611Z [2020-06-19 13:51:00,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:05.641467982Z [2020-06-19 13:51:05,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:10.644857545Z [2020-06-19 13:51:10,644: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:15.645758697Z [2020-06-19 13:51:15,645: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:20.640588083Z [2020-06-19 13:51:20,639: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:25.654703051Z [2020-06-19 13:51:25,654: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:30.641790447Z [2020-06-19 13:51:30,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:35.641423675Z [2020-06-19 13:51:35,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:40.641085548Z [2020-06-19 13:51:40,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:45.644073316Z [2020-06-19 13:51:45,643: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:50.641048670Z [2020-06-19 13:51:50,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:51:55.641933297Z [2020-06-19 13:51:55,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:00.640238471Z [2020-06-19 13:52:00,639: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:05.641708831Z [2020-06-19 13:52:05,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:10.641585279Z [2020-06-19 13:52:10,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:15.644893151Z [2020-06-19 13:52:15,644: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:20.644609366Z [2020-06-19 13:52:20,644: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:25.642832929Z [2020-06-19 13:52:25,642: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:30.641616517Z [2020-06-19 13:52:30,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:35.641398378Z [2020-06-19 13:52:35,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:40.641104085Z [2020-06-19 13:52:40,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:45.642708006Z [2020-06-19 13:52:45,642: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:50.644939163Z [2020-06-19 13:52:50,644: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:52:55.641749883Z [2020-06-19 13:52:55,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:00.641576276Z [2020-06-19 13:53:00,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:05.654376948Z [2020-06-19 13:53:05,653: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:05.670594921Z [2020-06-19 13:53:05,668: INFO/MainProcess] Received task: airflow.executors.celery_executor.execute_command[2645503b-53aa-49b8-a7cc-017e3d37af57]
2020-06-19T13:53:05.670629682Z [2020-06-19 13:53:05,669: DEBUG/MainProcess] TaskPool: Apply <function _fast_trace_task at 0x7f31a3c80b90> (args:('airflow.executors.celery_executor.execute_command', '2645503b-53aa-49b8-a7cc-017e3d37af57', {'lang': 'py', 'task': 'airflow.executors.celery_executor.execute_command', 'id': '2645503b-53aa-49b8-a7cc-017e3d37af57', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '2645503b-53aa-49b8-a7cc-017e3d37af57', 'parent_id': None, 'argsrepr': "[['airflow', 'run', 'core-cvr_test_dag', 'print_date', '2020-06-19T13:52:47.927938+00:00', '--local', '--pool', 'default_pool', '-sd', '/usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py']]", 'kwargsrepr': '{}', 'origin': 'gen31983@230eb62501ec', 'reply_to': 'ab44fb4d-a579-3d61-9093-5afbdbf93e75', 'correlation_id': '2645503b-53aa-49b8-a7cc-017e3d37af57', 'hostname': 'celery@76e4eef48dd7', 'delivery_info': {'exchange': '', 'routing_key': 'ML-universe-ml-core-cvr-training-workernode', 'priority': 0, 'redelivered': None}, 'args': [['airflow', 'run', 'core-cvr_test_dag', 'print_date',... kwargs:{})
2020-06-19T13:53:05.675579289Z [2020-06-19 13:53:05,673: INFO/ForkPoolWorker-7] Executing command in Celery: ['airflow', 'run', 'core-cvr_test_dag', 'print_date', '2020-06-19T13:52:47.927938+00:00', '--local', '--pool', 'default_pool', '-sd', '/usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py']
2020-06-19T13:53:05.680566223Z [2020-06-19 13:53:05,675: DEBUG/MainProcess] Task accepted: airflow.executors.celery_executor.execute_command[2645503b-53aa-49b8-a7cc-017e3d37af57] pid:22
2020-06-19T13:53:06.740640394Z [2020-06-19 13:53:06,733] {settings.py:212} DEBUG - Setting up DB connection pool (PID 24)
2020-06-19T13:53:06.740677118Z [2020-06-19 13:53:06,734] {settings.py:253} DEBUG - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=24
2020-06-19T13:53:06.773615400Z [2020-06-19 13:53:06,771] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/__init__.py
2020-06-19T13:53:06.773656635Z [2020-06-19 13:53:06,771] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/evaluate.py
2020-06-19T13:53:07.462647602Z [2020-06-19 13:53:07,454] {dask_link.py:128} DEBUG - No module named 'dask'
2020-06-19T13:53:07.921617621Z /usr/local/lib/python3.7/site-packages/patsy/constraint.py:13: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:07.921654796Z from collections import Mapping
2020-06-19T13:53:08.230710842Z /usr/local/lib/python3.7/site-packages/tensorflow/python/util/nest.py:1287: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:08.230747005Z _pywrap_tensorflow.RegisterType("Sequence", _collections.Sequence)
2020-06-19T13:53:08.508619641Z /usr/local/lib/python3.7/site-packages/tensorflow/python/training/tracking/object_identity.py:112: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:08.508656657Z class ObjectIdentitySet(collections.MutableSet):
2020-06-19T13:53:09.558618142Z [2020-06-19 13:53:09,550] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/learning.py
2020-06-19T13:53:09.558653137Z [2020-06-19 13:53:09,552] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/model_push.py
2020-06-19T13:53:09.558657697Z [2020-06-19 13:53:09,554] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/__init__.py
2020-06-19T13:53:09.558661170Z [2020-06-19 13:53:09,554] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/data_dao.py
2020-06-19T13:53:09.558664752Z [2020-06-19 13:53:09,556] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_dao.py
2020-06-19T13:53:09.558668228Z [2020-06-19 13:53:09,558] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_flag_dao.py
2020-06-19T13:53:09.569603234Z [2020-06-19 13:53:09,558] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/__init__.py
2020-06-19T13:53:09.569634682Z [2020-06-19 13:53:09,559] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/mailer.py
2020-06-19T13:53:09.569639448Z [2020-06-19 13:53:09,560] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/tempfile.py
2020-06-19T13:53:09.569643140Z [2020-06-19 13:53:09,561] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/__init__.py
2020-06-19T13:53:09.569646759Z [2020-06-19 13:53:09,561] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_constructor.py
2020-06-19T13:53:09.569650247Z [2020-06-19 13:53:09,562] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_filterer.py
2020-06-19T13:53:09.569653624Z [2020-06-19 13:53:09,563] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/__init__.py
2020-06-19T13:53:09.569656916Z [2020-06-19 13:53:09,564] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/encoder.py
2020-06-19T13:53:09.569660285Z [2020-06-19 13:53:09,564] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/feature_embedding.py
2020-06-19T13:53:09.569663666Z [2020-06-19 13:53:09,566] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/key_classifier.py
2020-06-19T13:53:09.569666990Z [2020-06-19 13:53:09,568] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/metrics.py
2020-06-19T13:53:09.569670332Z [2020-06-19 13:53:09,569] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/__init__.py
2020-06-19T13:53:09.580586298Z [2020-06-19 13:53:09,569] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/entity_embedding.py
2020-06-19T13:53:09.684658261Z [2020-06-19 13:53:09,683] {cli_action_loggers.py:42} DEBUG - Adding <function default_action_log at 0x7f957f4898c0> to pre execution callback
2020-06-19T13:53:09.896857923Z [2020-06-19 13:53:09,894] {cli_action_loggers.py:68} DEBUG - Calling callbacks: [<function default_action_log at 0x7f957f4898c0>]
2020-06-19T13:53:09.935604423Z [2020-06-19 13:53:09,932] {settings.py:212} DEBUG - Setting up DB connection pool (PID 24)
2020-06-19T13:53:09.935629273Z [2020-06-19 13:53:09,932] {settings.py:220} DEBUG - settings.configure_orm(): Using NullPool
2020-06-19T13:53:10.041082025Z [2020-06-19 13:53:10,037] {__init__.py:51} INFO - Using executor CeleryExecutor
2020-06-19T13:53:10.041135810Z [2020-06-19 13:53:10,038] {dagbag.py:396} INFO - Filling up the DagBag from /usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py
2020-06-19T13:53:10.041140204Z [2020-06-19 13:53:10,038] {dagbag.py:225} DEBUG - Importing /usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py
2020-06-19T13:53:10.050321521Z [2020-06-19 13:53:10,046] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag>
2020-06-19T13:53:10.050342906Z [2020-06-19 13:53:10,046] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag_default>
2020-06-19T13:53:10.050346913Z [2020-06-19 13:53:10,047] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag_ML>
2020-06-19T13:53:10.123254059Z Running %s on host %s <TaskInstance: core-cvr_test_dag.print_date 2020-06-19T13:52:47.927938+00:00 [queued]> 76e4eef48dd7
2020-06-19T13:53:10.584612655Z [2020-06-19 13:53:10,581] {cli_action_loggers.py:86} DEBUG - Calling callbacks: []
2020-06-19T13:53:10.641570110Z [2020-06-19 13:53:10,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:15.641402949Z [2020-06-19 13:53:15,640: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:20.172601614Z [2020-06-19 13:53:20,169] {cli_action_loggers.py:86} DEBUG - Calling callbacks: []
2020-06-19T13:53:20.172638510Z [2020-06-19 13:53:20,170] {settings.py:278} DEBUG - Disposing DB connection pool (PID 24)
2020-06-19T13:53:20.643608338Z [2020-06-19 13:53:20,642: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:20.899941705Z [2020-06-19 13:53:20,897: INFO/ForkPoolWorker-7] Task airflow.executors.celery_executor.execute_command[2645503b-53aa-49b8-a7cc-017e3d37af57] succeeded in 15.224881013000413s: None
2020-06-19T13:53:25.644817123Z [2020-06-19 13:53:25,644: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:25.849099768Z [2020-06-19 13:53:25,847: INFO/MainProcess] Received task: airflow.executors.celery_executor.execute_command[7e87939d-e77f-4851-9fb3-531348f9ba07]
2020-06-19T13:53:25.849147387Z [2020-06-19 13:53:25,847: DEBUG/MainProcess] TaskPool: Apply <function _fast_trace_task at 0x7f31a3c80b90> (args:('airflow.executors.celery_executor.execute_command', '7e87939d-e77f-4851-9fb3-531348f9ba07', {'lang': 'py', 'task': 'airflow.executors.celery_executor.execute_command', 'id': '7e87939d-e77f-4851-9fb3-531348f9ba07', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'retries': 0, 'timelimit': [None, None], 'root_id': '7e87939d-e77f-4851-9fb3-531348f9ba07', 'parent_id': None, 'argsrepr': "[['airflow', 'run', 'core-cvr_test_dag', 'print_the_context', '2020-06-19T13:52:47.927938+00:00', '--local', '--pool', 'default_pool', '-sd', '/usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py']]", 'kwargsrepr': '{}', 'origin': 'gen32067@230eb62501ec', 'reply_to': '79d4da7f-3250-3225-9b70-3e15e86986c9', 'correlation_id': '7e87939d-e77f-4851-9fb3-531348f9ba07', 'hostname': 'celery@76e4eef48dd7', 'delivery_info': {'exchange': '', 'routing_key': 'ML-universe-ml-core-cvr-training-workernode', 'priority': 0, 'redelivered': None}, 'args': [['airflow', 'run', 'core-cvr_test_dag', 'print_the_context',... kwargs:{})
2020-06-19T13:53:25.861655022Z [2020-06-19 13:53:25,850: INFO/ForkPoolWorker-7] Executing command in Celery: ['airflow', 'run', 'core-cvr_test_dag', 'print_the_context', '2020-06-19T13:52:47.927938+00:00', '--local', '--pool', 'default_pool', '-sd', '/usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py']
2020-06-19T13:53:25.862143369Z [2020-06-19 13:53:25,853: DEBUG/MainProcess] Task accepted: airflow.executors.celery_executor.execute_command[7e87939d-e77f-4851-9fb3-531348f9ba07] pid:22
2020-06-19T13:53:25.862155812Z [2020-06-19 13:53:25,856: INFO/MainProcess] Received task: airflow.executors.celery_executor.execute_command[eca9a8cb-99ec-42f0-9176-b81bc4cb8292]
2020-06-19T13:53:25.862160459Z [2020-06-19 13:53:25,857: DEBUG/MainProcess] TaskPool: Apply <function _fast_trace_task at 0x7f31a3c80b90> (args:('airflow.executors.celery_executor.execute_command', 'eca9a8cb-99ec-42f0-9176-b81bc4cb8292', {'lang': 'py', 'task': 'airflow.executors.celery_executor.execute_command', 'id': 'eca9a8cb-99ec-42f0-9176-b81bc4cb8292', 'shadow': None, 'eta': None, 'expires': None, 'group': None, 'retries': 0, 'timelimit': [None, None], 'root_id': 'eca9a8cb-99ec-42f0-9176-b81bc4cb8292', 'parent_id': None, 'argsrepr': "[['airflow', 'run', 'core-cvr_test_dag', 'sleep', '2020-06-19T13:52:47.927938+00:00', '--local', '--pool', 'default_pool', '-sd', '/usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py']]", 'kwargsrepr': '{}', 'origin': 'gen32067@230eb62501ec', 'reply_to': '79d4da7f-3250-3225-9b70-3e15e86986c9', 'correlation_id': 'eca9a8cb-99ec-42f0-9176-b81bc4cb8292', 'hostname': 'celery@76e4eef48dd7', 'delivery_info': {'exchange': '', 'routing_key': 'ML-universe-ml-core-cvr-training-workernode', 'priority': 0, 'redelivered': None}, 'args': [['airflow', 'run', 'core-cvr_test_dag', 'sleep', '2020-06-19T13:52:47.927938+00:00',... kwargs:{})
2020-06-19T13:53:25.866571995Z [2020-06-19 13:53:25,864: INFO/ForkPoolWorker-8] Executing command in Celery: ['airflow', 'run', 'core-cvr_test_dag', 'sleep', '2020-06-19T13:52:47.927938+00:00', '--local', '--pool', 'default_pool', '-sd', '/usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py']
2020-06-19T13:53:25.876625224Z [2020-06-19 13:53:25,866: DEBUG/MainProcess] Task accepted: airflow.executors.celery_executor.execute_command[eca9a8cb-99ec-42f0-9176-b81bc4cb8292] pid:23
2020-06-19T13:53:27.931629981Z [2020-06-19 13:53:27,929] {settings.py:212} DEBUG - Setting up DB connection pool (PID 31)
2020-06-19T13:53:27.931675005Z [2020-06-19 13:53:27,930] {settings.py:253} DEBUG - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=31
2020-06-19T13:53:27.939683899Z [2020-06-19 13:53:27,933] {settings.py:212} DEBUG - Setting up DB connection pool (PID 30)
2020-06-19T13:53:27.939707039Z [2020-06-19 13:53:27,934] {settings.py:253} DEBUG - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=30
2020-06-19T13:53:28.015589148Z [[2020-06-19 13:53:28,013] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/__init__.py
2020-06-19T13:53:28.015619250Z [2020-06-19 13:53:28,014] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/evaluate.py
2020-06-19T13:53:28.023652618Z 2020-06-19 13:53:28,011] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/__init__.py
2020-06-19T13:53:28.023666175Z [2020-06-19 13:53:28,016] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/evaluate.py
2020-06-19T13:53:29.343605746Z [2020-06-19 13:53:29,342] {dask_link.py:128} DEBUG - No module named 'dask'
2020-06-19T13:53:29.351640586Z [2020-06-19 13:53:29,344] {dask_link.py:128} DEBUG - No module named 'dask'
2020-06-19T13:53:30.167613030Z /usr/local/lib/python3.7/site-packages/patsy/constraint.py:13: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:30.167651932Z from collections import Mapping
2020-06-19T13:53:30.175658658Z /usr/local/lib/python3.7/site-packages/patsy/constraint.py:13: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:30.175673326Z from collections import Mapping
2020-06-19T13:53:30.646618200Z [2020-06-19 13:53:30,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:30.748615035Z /usr/local/lib/python3.7/site-packages/tensorflow/python/util/nest.py:1287: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:30.748652377Z _pywrap_tensorflow.RegisterType("Sequence", _collections.Sequence)
2020-06-19T13:53:30.752806667Z /usr/local/lib/python3.7/site-packages/tensorflow/python/util/nest.py:1287: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:30.752821990Z _pywrap_tensorflow.RegisterType("Sequence", _collections.Sequence)
2020-06-19T13:53:31.334615075Z /usr/local/lib/python3.7/site-packages/tensorflow/python/training/tracking/object_identity.py:112: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:31.334655920Z class ObjectIdentitySet(collections.MutableSet):
2020-06-19T13:53:31.342675520Z /usr/local/lib/python3.7/site-packages/tensorflow/python/training/tracking/object_identity.py:112: DeprecationWarning: Using or importing the ABCs from 'collections' instead of from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop working
2020-06-19T13:53:31.342691413Z class ObjectIdentitySet(collections.MutableSet):
2020-06-19T13:53:33.459609167Z [2020-06-19 13:53:33,456] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/learning.py
2020-06-19T13:53:33.459646248Z [2020-06-19 13:53:33,458] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/model_push.py
2020-06-19T13:53:33.467652572Z [2020-06-19 13:53:33,459] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/learning.py
2020-06-19T13:53:33.467666668Z [2020-06-19 13:53:33,462] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/model_push.py
2020-06-19T13:53:33.468036588Z [2020-06-19 13:53:33,464] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/__init__.py
2020-06-19T13:53:33.468045530Z [2020-06-19 13:53:33,465] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/data_dao.py
2020-06-19T13:53:33.468058351Z [2020-06-19 13:53:33,466] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_dao.py
2020-06-19T13:53:33.471577985Z [2020-06-19 13:53:33,469] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/__init__.py
2020-06-19T13:53:33.471595271Z [2020-06-19 13:53:33,469] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/data_dao.py
2020-06-19T13:53:33.471600132Z [2020-06-19 13:53:33,471] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_dao.py
2020-06-19T13:53:33.479628516Z [2020-06-19 13:53:33,473] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_flag_dao.py
2020-06-19T13:53:33.479640605Z [2020-06-19 13:53:33,474] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/__init__.py
2020-06-19T13:53:33.479645318Z [2020-06-19 13:53:33,474] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/mailer.py
2020-06-19T13:53:33.479964906Z [2020-06-19 13:53:33,476] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/dao/model_flag_dao.py
2020-06-19T13:53:33.479973531Z [2020-06-19 13:53:33,477] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/__init__.py
2020-06-19T13:53:33.479977883Z [2020-06-19 13:53:33,477] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/mailer.py
2020-06-19T13:53:33.479981819Z [2020-06-19 13:53:33,478] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/tempfile.py
2020-06-19T13:53:33.483573968Z [2020-06-19 13:53:33,480] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/lib/tempfile.py
2020-06-19T13:53:33.483589815Z [2020-06-19 13:53:33,481] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/__init__.py
2020-06-19T13:53:33.483594894Z [2020-06-19 13:53:33,481] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_constructor.py
2020-06-19T13:53:33.483598870Z [2020-06-19 13:53:33,482] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_filterer.py
2020-06-19T13:53:33.491628846Z [2020-06-19 13:53:33,479] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/__init__.py
2020-06-19T13:53:33.491640761Z [2020-06-19 13:53:33,484] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_constructor.py
2020-06-19T13:53:33.491645408Z [2020-06-19 13:53:33,485] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/preprocess/feature_filterer.py
2020-06-19T13:53:33.491649156Z [2020-06-19 13:53:33,486] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/__init__.py
2020-06-19T13:53:33.491652841Z [2020-06-19 13:53:33,486] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/encoder.py
2020-06-19T13:53:33.491968222Z [2020-06-19 13:53:33,487] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/__init__.py
2020-06-19T13:53:33.491976346Z [2020-06-19 13:53:33,488] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/encoder.py
2020-06-19T13:53:33.491980312Z [2020-06-19 13:53:33,489] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/feature_embedding.py
2020-06-19T13:53:33.491984076Z [2020-06-19 13:53:33,490] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/key_classifier.py
2020-06-19T13:53:33.495572815Z [2020-06-19 13:53:33,487] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/feature_embedding.py
2020-06-19T13:53:33.495588603Z [2020-06-19 13:53:33,493] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/key_classifier.py
2020-06-19T13:53:33.502610736Z [2020-06-19 13:53:33,496] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/metrics.py
2020-06-19T13:53:33.502622661Z [2020-06-19 13:53:33,497] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/__init__.py
2020-06-19T13:53:33.502627216Z [2020-06-19 13:53:33,497] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/entity_embedding.py
2020-06-19T13:53:33.502918830Z [2020-06-19 13:53:33,500] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/metrics.py
2020-06-19T13:53:33.502927368Z [2020-06-19 13:53:33,500] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/__init__.py
2020-06-19T13:53:33.502931243Z [2020-06-19 13:53:33,501] {plugins_manager.py:178} DEBUG - Importing plugin module /usr/local/airflow/plugins/train/trainer/model/entity_embedding.py
2020-06-19T13:53:33.735649202Z [2020-06-19 13:53:33,726] {cli_action_loggers.py:42} DEBUG[2020-06-19 13:53:33,734] {cli_action_loggers.py:42} DEBUG - Adding <function default_action_log at 0x7f58c3e678c0> to pre execution callback
2020-06-19T13:53:33.743647394Z - Adding <function default_action_log at 0x7efe735d08c0> to pre execution callback
2020-06-19T13:53:34.179673378Z [2020-06-19 13:53:34,178] {cli_action_loggers.py:68} DEBUG - Calling callbacks: [<function default_action_log at 0x7f58c3e678c0>]
2020-06-19T13:53:34.185721841Z [2020-06-19 13:53:34,182] {cli_action_loggers.py:68} DEBUG - Calling callbacks: [<function default_action_log at 0x7efe735d08c0>]
2020-06-19T13:53:34.233604665Z [2020-06-19 13:53:34,229] {settings.py:212} DEBUG - Setting up DB connection pool (PID 30)
2020-06-19T13:53:34.233642334Z [2020-06-19 13:53:34,230] {settings.py:220} DEBUG - settings.configure_orm(): Using NullPool
2020-06-19T13:53:34.244581864Z [2020-06-19 13:53:34,242] {settings.py:212} DEBUG - Setting up DB connection pool (PID 31)
2020-06-19T13:53:34.244601794Z [2020-06-19 13:53:34,242] {settings.py:220} DEBUG - settings.configure_orm(): Using NullPool
2020-06-19T13:53:34.419612341Z [2020-06-19 13:53:34,416] {__init__.py:51} INFO - Using executor CeleryExecutor
2020-06-19T13:53:34.419648733Z [2020-06-19 13:53:34,417] {dagbag.py:396} INFO - Filling up the DagBag from /usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py
2020-06-19T13:53:34.419653814Z [2020-06-19 13:53:34,417] {dagbag.py:225} DEBUG - Importing /usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py
2020-06-19T13:53:34.427731957Z [2020-06-19 13:53:34,426] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag>
2020-06-19T13:53:34.431668740Z [2020-06-19 13:53:34,426] {dagbag.py:[2020-06-19 13:53:34,430] {__init__.py:51} INFO - Using executor CeleryExecutor
2020-06-19T13:53:34.435631245Z [2020-06-19 13:53:34,431] {dagbag.py:396} INFO - Filling up the DagBag from /usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py
2020-06-19T13:53:34.435643482Z [2020-06-19 13:53:34,432] {dagbag.py:225} DEBUG - Importing /usr/local/airflow/dags/core-cvr/master/wf_test_core_cvr.py
2020-06-19T13:53:34.438570149Z 363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag_default>
2020-06-19T13:53:34.438585935Z [2020-06-19 13:53:34,436] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag_ML>
2020-06-19T13:53:34.444170697Z [2020-06-19 13:53:34,440] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag>
2020-06-19T13:53:34.444182664Z [2020-06-19 13:53:34,440] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag_default>
2020-06-19T13:53:34.444187086Z [2020-06-19 13:53:34,441] {dagbag.py:363} DEBUG - Loaded DAG <DAG: core-cvr_test_dag_ML>
2020-06-19T13:53:34.540553655Z Running %s on host %s <TaskInstance: core-cvr_test_dag.sleep 2020-06-19T13:52:47.927938+00:00 [queued]> 76e4eef48dd7
2020-06-19T13:53:34.550486053Z Running %s on host %s <TaskInstance: core-cvr_test_dag.print_the_context 2020-06-19T13:52:47.927938+00:00 [queued]> 76e4eef48dd7
2020-06-19T13:53:35.252662260Z [2020-06-19 13:53:35,249] {cli_action_loggers.py:86} DEBUG - Calling callbacks: []
2020-06-19T13:53:35.318583960Z [2020-06-19 13:53:35,315] {cli_action_loggers.py:86} DEBUG - Calling callbacks: []
2020-06-19T13:53:35.645694444Z [2020-06-19 13:53:35,645: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:40.642468158Z [2020-06-19 13:53:40,641: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:44.599594753Z [2020-06-19 13:53:44,596] {cli_action_loggers.py:86} DEBUG - Calling callbacks: []
2020-06-19T13:53:44.599619032Z [2020-06-19 13:53:44,598] {settings.py:278} DEBUG - Disposing DB connection pool (PID 31)
2020-06-19T13:53:44.641600584Z [2020-06-19 13:53:44,640] {cli_action_loggers.py:86} DEBUG - Calling callbacks: []
2020-06-19T13:53:44.644724722Z [2020-06-19 13:53:44,642] {settings.py:278} DEBUG - Disposing DB connection pool (PID 30)
2020-06-19T13:53:45.655607563Z [2020-06-19 13:53:45,654: DEBUG/MainProcess] pidbox received method enable_events() [reply_to:None ticket:None]
2020-06-19T13:53:46.192714982Z [2020-06-19 13:53:46,190: INFO/ForkPoolWorker-7] Task airflow.executors.celery_executor.execute_command[7e87939d-e77f-4851-9fb3-531348f9ba07] succeeded in 20.34044556399749s: None
2020-06-19T13:53:46.226388025Z [2020-06-19 13:53:46,224: INFO/ForkPoolWorker-8] Task airflow.executors.celery_executor.execute_command[eca9a8cb-99ec-42f0-9176-b81bc4cb8292] succeeded in 20.36025506599981s: None
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org