You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "bhavin patel (JIRA)" <ji...@apache.org> on 2018/05/03 18:00:00 UTC
[jira] [Updated] (AIRFLOW-2413) log dir name mismatch with UI on
/log
[ https://issues.apache.org/jira/browse/AIRFLOW-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
bhavin patel updated AIRFLOW-2413:
----------------------------------
Description:
every time i tried to look for logs in UI , it gave me error message.
here is the url that makes the call
{code:java}
http://localhost:8080/admin/airflow/log?dag_id=Struct-Pipeline-Runner&task_id=struct-event-model.02-sem-fill-mapping&execution_date=2018-05-03T14%3A54%3A22
{code}
{code:java}
*** Log file isn't local.
*** Fetching here: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
*** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for url: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
{code}
upon investigating I have found that the dir name generated by snowplow logger is not consistent with the name generated by UI
{code:java}
~ $ ls -la .../airflow/logs/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-0
2018-04-23T00:00:00/ 2018-04-25T00:00:00/ 2018-04-30T20:05:43+00:00/ 2018-05-02T16:29:38+00:00/ 2018-05-02T20:11:39+00:00/ 2018-05-03T14:54:22+00:00/
{code}
was:
every time i tried to look for logs in UI , it gave me error message.
{code:java}
*** Log file isn't local.
*** Fetching here: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
*** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for url: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
{code}
upon investigating I have found that the dir name generated by snowplow logger is not consistent with the name generated by UI
{code:java}
~ $ ls -la .../airflow/logs/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-0
2018-04-23T00:00:00/ 2018-04-25T00:00:00/ 2018-04-30T20:05:43+00:00/ 2018-05-02T16:29:38+00:00/ 2018-05-02T20:11:39+00:00/ 2018-05-03T14:54:22+00:00/
{code}
> log dir name mismatch with UI on /log
> -------------------------------------
>
> Key: AIRFLOW-2413
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2413
> Project: Apache Airflow
> Issue Type: Bug
> Components: logging
> Affects Versions: Airflow 2.0
> Reporter: bhavin patel
> Priority: Minor
>
> every time i tried to look for logs in UI , it gave me error message.
>
> here is the url that makes the call
> {code:java}
> http://localhost:8080/admin/airflow/log?dag_id=Struct-Pipeline-Runner&task_id=struct-event-model.02-sem-fill-mapping&execution_date=2018-05-03T14%3A54%3A22
> {code}
> {code:java}
> *** Log file isn't local.
> *** Fetching here: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
> *** Failed to fetch log file from worker. 404 Client Error: NOT FOUND for url: http://1.0.0.127.in-addr.arpa:8793/log/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-05-03T14:54:22/1.log
> {code}
>
>
> upon investigating I have found that the dir name generated by snowplow logger is not consistent with the name generated by UI
>
>
> {code:java}
> ~ $ ls -la .../airflow/logs/Struct-Pipeline-Runner/struct-event-model.02-sem-fill-mapping/2018-0
> 2018-04-23T00:00:00/ 2018-04-25T00:00:00/ 2018-04-30T20:05:43+00:00/ 2018-05-02T16:29:38+00:00/ 2018-05-02T20:11:39+00:00/ 2018-05-03T14:54:22+00:00/
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)