[jira] [Commented] (AIRFLOW-3567) Logs are not fetched from S3 when using AIM policy

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-3567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850116#comment-16850116 ] 

ASF GitHub Bot commented on AIRFLOW-3567:
-----------------------------------------

spektom commented on pull request #4372: AIRFLOW-3567 Show an error in case logs can't be fetched from S3
URL: https://github.com/apache/airflow/pull/4372
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Logs are not fetched from S3 when using AIM policy
> --------------------------------------------------
>
>                 Key: AIRFLOW-3567
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-3567
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: logging
>    Affects Versions: 1.10.1
>            Reporter: Michael Spector
>            Priority: Major
>
> The remote logging is configured as follows:
> {code:python}
> remote_logging=True
> remote_log_conn_id=''
> remote_base_log_folder='s3://logs-bucket/airflow/analytics-airflow'
> encrypt_s3_logs=False
> {code}
> Logs on S3 are created successfully, however when trying to access them via UI we're getting something like this:
> {code:bash}
> Log file does not exist: /var/lib/airflow/logs/jobname/taskname/2018-12-25T03:00:00+00:00/1.log 
> Fetching from: http://10.118.19.142:50192/log/jobname/taskname/2018-12-25T03:00:00+00:00/1.log
> {code}
> Which means that logs fetcher falls back to FileTaskHandler.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)