You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/10/08 23:57:54 UTC
[GitHub] [airflow] sreev opened a new issue #11366: missing logs from the included libraries
sreev opened a new issue #11366:
URL: https://github.com/apache/airflow/issues/11366
airflow (LoggingMixin) -> NEW_DAG (airflow.models.DAG, LoggingMixin) -> a library (logging) -> another library (logging)
my_dag.py:
dag = NEW_DAG(...)
SomeOperator(..., dag=dag)
a library (logging):
this has log = logging.getLogger(__name__)
Attempt 1:
In NEW_DAG.__init__:
self.log.info(..) : these lines appear in the terminal where i started airflow.
and none from rest of the methods.
Attempt 2:
I added log = logging.getLogger(__name__) in NEW_DAG.
log.info(..) : these lines appear until __init__ is called, in the terminal where i started airflow.
and none from anywhere else, including methods.
In __init__:
self.log.info(..) : these lines appear in the terminal where i started airflow.
and none from rest of the methods.
Attempt 3:
I added log = logging.getLogger(__name__) in NEW_DAG.
And removed LoggingMixin form class NEW_DAG(airflow.models.DAG)
log.info(..) : these lines appear until __init__ is called, in the terminal where i started airflow.
and none from anywhere else, including methods.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] sreev edited a comment on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
sreev edited a comment on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-713244902
the logs seems piped into themselves.
here is a sample logs lines from running `% airflow scheduler` in my local on mac.
```
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:496} INFO - job_run_ids: ["b0678e61-5174-4538-bf60-0960a10e94cf"]
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:155} INFO - marquez_run_id: b0678e61-5174-4538-bf60-0960a10e94cf
```
steps to reproduce, so you can see the log above.
follow the steps from the airflow quick start. add the below step.
- edit airflow.cfg
- log_format = [%%(asctime)s] {%%(module)s.%%(filename)s:%%(lineno)d} %%(levelname)s - %%(message)s
watch the logs in the terminal that started `airflow scheduler`
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] sreev commented on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
sreev commented on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-705893919
Conversation before creating the git issue:
https://apache-airflow.slack.com/archives/CCQ7EGB1P/p1602027042396900
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-713878165
Can you update your first post to match the template? In particular, I am interested in the Airflow version.
https://raw.githubusercontent.com/apache/airflow/master/.github/ISSUE_TEMPLATE/bug_report.md
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal closed issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
eladkal closed issue #11366:
URL: https://github.com/apache/airflow/issues/11366
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-705888764
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] sreev commented on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
sreev commented on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-705893919
Conversation before creating the git issue:
https://apache-airflow.slack.com/archives/CCQ7EGB1P/p1602027042396900
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] sreev edited a comment on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
sreev edited a comment on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-713244902
the logs seems piped into themselves.
here is a sample logs lines from running `% airflow scheduler` in my local on mac.
```
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:496} INFO - job_run_ids: ["b0678e61-5174-4538-bf60-0960a10e94cf"]
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:155} INFO - marquez_run_id: b0678e61-5174-4538-bf60-0960a10e94cf
```
steps to reproduce, so you can see the log above.
install airflow (v1.10.12 or above)
edit airflow.cfg
- log_format = [%%(asctime)s] {%%(module)s.%%(filename)s:%%(lineno)d} %%(levelname)s - %%(message)s
airflow webserver -p 8080 (one terminal)
airflow scheduler (two terminal)
- watch the logs in this terminal
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] sreev edited a comment on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
sreev edited a comment on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-713244902
the logs seems piped into themselves.
here is a sample logs lines from running `% airflow scheduler` in my local on mac.
```
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:496} INFO - job_run_ids: ["b0678e61-5174-4538-bf60-0960a10e94cf"]
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:155} INFO - marquez_run_id: b0678e61-5174-4538-bf60-0960a10e94cf
```
steps to reproduce, so you can see the log above.
- install airflow (v1.10.12 or above)
- edit airflow.cfg
- log_format = [%%(asctime)s] {%%(module)s.%%(filename)s:%%(lineno)d} %%(levelname)s - %%(message)s
- airflow webserver -p 8080 (one terminal)
- airflow scheduler (two terminal)
- watch the logs in this terminal
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] sreev commented on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
sreev commented on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-713244902
the logs seems piped into themselves.
here is a sample logs lines from running `% airflow scheduler` in my local on mac.
```
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:496} INFO - job_run_ids: ["b0678e61-5174-4538-bf60-0960a10e94cf"]
[2020-10-20 18:47:29,294] {logging_mixin.logging_mixin.py:112} INFO - [2020-10-20 18:47:29,294] {dag.dag.py:155} INFO - marquez_run_id: b0678e61-5174-4538-bf60-0960a10e94cf
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] boring-cyborg[bot] commented on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-705888764
Thanks for opening your first issue here! Be sure to follow the issue template!
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] eladkal commented on issue #11366: missing logs from the included libraries
Posted by GitBox <gi...@apache.org>.
eladkal commented on issue #11366:
URL: https://github.com/apache/airflow/issues/11366#issuecomment-921715798
This issue is reported against older version of Airflow.
Please check against latest version. If needed we will reopen this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org